Improve color and style transfer from the source

[realisticdreamer114514]

I tried to swap between a source image with blonde hair and pale skin, and a target with brown hair and tanned skin. The outcome has the shape of the source image but the color of the underlying target image (brown hair instead of blonde hair).

This is similar to one of your examples: https://github.com/LeslieZhoa/HeadSwap/blob/main/assets/1-e6de879a-f3c2-47f8-9588-feab95df7b9e.png
The source image has blonde hair but the output has black hair like the target.

I'm hoping for improvements that allows me to choose from keeping the color of the target or using the color from source. Would this require further model training? If this does, you might release improved code and models since I don't have the hardware to train anything yet.