Skip to content

adobe/3D-FM-GAN

3D-FM GAN: Towards 3D-Controllable Face Manipulation [ECCV 2022] (Paper)(Webpage)(Video)(Poster)

Overview

The architecture of 3D-FM GAN is shown in the below image, where the inputs to the model are a photo image and a render image, and the output is a manipulated image bearing the identity from the photo while having the same facial attributes of pose, expression, and illumination as the render one.

Environment Setup:

  • Conda_Env_Setup/2021_summer_env.yml: Use conda env create -f Conda_Env_Setup/2021_summer_env.yml to install the conda environment.

Training

  • train_3_encoder.py & train_3_encoder_hyperparams.py: Training script and training hyper-parameter macros for 3-encoder architecture. Use python3 train_3_encoder.py to kick-off training.

Evaluation

  • Evaluation/quant_eval.py: Methods for quantitative evaluation, including FID, identity cosine similarity, landmark similarity, and face content similarity.

  • Evaluation/visual_eval.py: Methods for visual evaluation by feed-forwarding different (photo,render) pairs to the model and visualize the outputs to assess the model's editability.

About

No description, website, or topics provided.

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published