Practical Application?

[ghost]

Hi! I'm very interested in your project, I'm currently working on an open source project that should be able to interpolate the face (with expression) in video frames of person a into something that looks more like person b.

What I have so far:

Dataset Generation

• Extracting frames from many youtube videos of person a or person b
• Running facial recognition and alignment to save every training usable region of interest with the correct people into personA and personB folders

Translation Utility

• Provide low fps video of person a, for each frame extract the region of interest (face)
• Run it through some kind of image translation (I would like to use your project for that)
• Then save the result back into the original region of interest. (possibly add color correction, etc of modified roi with pix2pix)

What I want to use your project for:

Image Translation
personA->personB conversion (or at least a high similarity, like in the male->female projects) of regions of interest in individual videoframes

What I don't understand

How to use your project for this purpose ;) Can you point me in a direction, so that I can set up your project for this specific application?