Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time error in arbitrary timestep interpolation. #29

Closed
Mrzzz-ft opened this issue Sep 29, 2024 · 1 comment
Closed

Time error in arbitrary timestep interpolation. #29

Mrzzz-ft opened this issue Sep 29, 2024 · 1 comment

Comments

@Mrzzz-ft
Copy link

Mrzzz-ft commented Sep 29, 2024

When I use the official provided weights, everything worked fine. But when I use it to retrain a model on my own dataset which is built on the Vimeo90k_septuplet, things get bad. For example, if two frames are inserted between two frames, the time of the two frames appears to be distorted, and the third frame regressed from the second frame, especially in the foot of the right people.

001
002
003
004

I train it with lr=1e-4~2e-5,batch_size=16, epoch=150. Is this caused by the parameters?

@Mrzzz-ft
Copy link
Author

The problem is due to the reversal of I0 and I1, without reversal of timestep.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant