-
Notifications
You must be signed in to change notification settings - Fork 102
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
有人一起跑吗,怎么感觉效果一般? #12
Comments
同尝试了一下,效果有点惊悚。。。 观察到的问题如下:
参考 X-Portrait 增加关键点控制可能会好一些? |
感谢大家的使用体验和反馈建议,目前我们的方法在运动幅度较小的场景能够生成自然流畅的视频生成结果,如主页的视频生成结果所示。然而如大家所说,我们内部测试Megactor仍然存在limitation:泛化性不足,细节生成的一致性不足等等。我们内部正在进一步优化Megactor,已经有一定的改进,欢迎大家关注我们的后续改进版本。 Thank you all for your valuable feedback and insights based on your usage experiences. Currently, our method is capable of generating natural and smooth video synthesis results in scenarios with minimal movements, as demonstrated by the video generation examples on our homepage. However, as many of you have pointed out, our internal tests reveal several limitations of Megactor, including inadequate generalization capability and inconsistent detail generation, among others. We are actively working internally to further optimize Megactor and have already made notable improvements. We warmly welcome you to stay tuned for our upcoming enhanced versions. |
我们发现了开源代码推理config的inference.yaml的一个Bug。该Bug会导致推理的效果变差。具体的原因是我们采用的frames=16进行了训练,推理config的参数上为frames=8。该Bug已经Fixed,修改部分见 https://github.com/megvii-research/megactor/blob/main/configs/inference/inference.yaml#L23 。 We discovered a bug in the inference.yaml configuration for open-source code inference, which led to degraded performance. Specifically, the issue arose because we trained the model with frames=16, while the inference configuration was set with frames=8. The bug has been fixed, and the modifications can be seen at the https://github.com/megvii-research/megactor/blob/main/configs/inference/inference.yaml#L23 . |
I think,感觉跑完以后效果没有那么好,方法有点熟悉,就像是缝合了AniPortrait和EMO的story
postpoint和referencenet的desc比较熟悉 And generation deatils 的抖动有点明显
有后续有新版本可以戳一下......
The text was updated successfully, but these errors were encountered: