stage1 for a customized video

[cmmclee]

Hello, the effects in the demo look great. I have a question, how to get such parameters from a customized video? --smpl __assets__/demo_seq/smpl_1.mp4 --hamer __assets__/demo_seq/hamer_1.mp4 --dwpose _assets__/demo_seq/dwpose_1.pkl

[theFoxofSky]

We get the pose sequences using the following methods:
SMPL: https://github.com/caizhongang/SMPLer-X
HAMER: https://github.com/geopavlakos/hamer
DWPose: https://github.com/IDEA-Research/DWPose

Note that we rewrote the rendering code for SMPL and HAMER, making the pose colorful.
But if you want to train your own RealisDance, you can just use the standard SMPL and HAMER (without color).

[theFoxofSky]

We will also release the rendering codes, but this may take a while as they are not cleaned up yet.

[cmmclee]

Thank you very much for your quick reply. In addition, what I want to know is, if I only use ‘standard SMPL and HAMER’, can I get as good an effect as in the demo?

[theFoxofSky]

I have not tried this on the ckpt we released. However, I tried training an earlier version of the RealisDance model using standard SMPL and HAMER, which achieved similar results for most cases when using longer training steps.

[yuchenli-sony]

great THANK U FOR UR EXCELLENT WORK