Skip to content

Latest commit

 

History

History
29 lines (20 loc) · 2.35 KB

goal.md

File metadata and controls

29 lines (20 loc) · 2.35 KB

The Philosophical aspects of Face Renovation

The term "renovation" is originated from the Latin verb novare, which means "to make new". Different from "restoration", renovation is mainly used for things of significant aesthetic and historic value, e.g. renovating an art piece, an old church, or an inhabitant of wild lifes.

Restoration, Recreation, and Renovation

The major distinction of face renovation against other face-processing tasks is the ability to consistently produce high-quality renovation results regardless of input conditions. In contrast, the quality of face restoration algorithms generally deteriorate rapidly along the input degradation level, and are not suitable for real-world applications. Recently a new work PULSE propose a new generative-based restoration framework by optimizing the latent vector over a pretrained StyleGAN manifold. However, the iteratively optimized result is often different from the original input in terms of gender, race and general disposition. In this regard, we think PULSE is not qualified as a restoration (or super-resolution) algorithm, what it does is just "face recreation".

Here is an illustration to the distinction between restoration(ESRGAN, 4x), recreation(PULSE) and renovation(ours): 20200704205403

The "racial bias" of PULSE

Recently, there has been some accusations towards PULSE for turning a pixelated Obama figure into a white guy, which quickly escalates from an academic issue to an act of racism.

We test the fairness of our HiFaceGAN over 13 famous colored people, and observe 3 gender changes and 9 color-to-white cases for PULSE. In contrast, HiFaceGAN always preserves the input person's essential characteristics regardless of the gender, race and head pose of the input.

NOTE: Our HiFaceGAN is also trained on the gender-biased FFHQ dataset.

From left to right: Original image, 16x downsampled input, PULSE, our HiFaceGAN black