Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can you provide arbitrary frame interpolation training code #11

Open
JRStudio-107 opened this issue Jun 21, 2023 · 5 comments
Open

Can you provide arbitrary frame interpolation training code #11

JRStudio-107 opened this issue Jun 21, 2023 · 5 comments

Comments

@JRStudio-107
Copy link

The existing version only includes the fixed step fill frame training process, I want to learn the process of arbitrary frame interpolation, thx

@GuozhenZhang1999
Copy link
Collaborator

Thanks for your concern! We won't provide the training code that supports arbitrary temporal interpolation in order to reduce the complexity of the code base. But it should be noticed that the configuration of the training dataset is the only thing that needs to be changed (we follow the setting of RIFE); the rest of the training process is essentially the same for both fixed- and arbitrary-training.

@JRStudio-107
Copy link
Author

Thank you for your reply. In fact, while waiting for your reply, I have built arbitrary temporal interpolation training methods, also referring to RIFE's Settings. However, during the training process, my training loss is almost unchanged, and the performance of PSNR test after each epoch becomes worse and worse with the training, the interpolation frame calculated by the trained model is all black, have you ever encountered similar cases?

@GuozhenZhang1999
Copy link
Collaborator

No, the training process was very stable. You can see if the time step is computed correctly and passed into the model.

@fuqianya
Copy link

Hello, @JRStudio-107 and @GuozhenZhang1999 I am also interested in exploring the training of arbitrary temporal interpolation. Could you plz release the relevant code in another branch or repo?

@nighting0le01
Copy link

Hi I wanted to ask if the arbitrary timestep training code can be shared? How can I reproduce the results??

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants