DanceToMusic

​ This is the official repository accompanying the paper "Dance2Music: Automatic Dance-driven Music Generation", by Gunjan Aggarwal & Devi Parikh.

Paper link.
This repo requires OpenPose for running on GPU and OpenVINO for running on CPU.
To install OpenPose follow the instructions given here. Make sure to enable the BUILD_PYTHON flag while installing.
To install OpenVINO follow the instructions given here.

Live OpenPose

Run this on a GPU machine -

python Dance2Music_openpose.py

​

Run on an existing video using OpenPose

Run this on a GPU machine -

python Dance2Music_openpose.py --input video_fname

​

Live OpenVINO -

Can be run on a CPU -

python Dance2Music_openvino.py

​

Run on an existing video using OpenVINO -

Can be run on a CPU -

python Dance2Music_openvino.py --input video_fname

For offline music generation -

cd offline
bash launch.sh /path/to/inp/dir /path/to/out/dir

Example script -

cd offline
bash launch.sh test_videos out_results