The architecture of 3D-FM GAN is shown in the below image, where the inputs to the model are a photo image and a render image, and the output is a manipulated image bearing the identity from the photo while having the same facial attributes of pose, expression, and illumination as the render one.
Conda_Env_Setup/2021_summer_env.yml: Useconda env create -f Conda_Env_Setup/2021_summer_env.ymlto install the conda environment.
train_3_encoder.py&train_3_encoder_hyperparams.py: Training script and training hyper-parameter macros for 3-encoder architecture. Usepython3 train_3_encoder.pyto kick-off training.
-
Evaluation/quant_eval.py: Methods for quantitative evaluation, including FID, identity cosine similarity, landmark similarity, and face content similarity. -
Evaluation/visual_eval.py: Methods for visual evaluation by feed-forwarding different (photo,render) pairs to the model and visualize the outputs to assess the model's editability.
