𝗗𝗮𝘆-𝟮𝟭𝟯 𝗖𝗼𝗺𝗽𝘂𝘁𝗲𝗿 𝗩𝗶𝘀𝗶𝗼𝗻 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗦𝗽𝗮𝘁𝗶𝗮𝗹-𝗣𝗵𝗮𝘀𝗲 𝗦𝗵𝗮𝗹𝗹𝗼𝘄 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴: Rethinking Face Forgery Detection in Frequency Domain by @University of Science and Technology of China and Alibaba Group Follow me for a similar post: 🇮🇳 Ashish Patel Interesting Facts : 🔸 This is a paper in CVPR2021 with over 1 citations. ------------------------------------------------------------------- 𝗔𝗺𝗮𝘇𝗶𝗻𝗴 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 : https://lnkd.in/e9UmmCy ------------------------------------------------------------------- 𝗜𝗠𝗣𝗢𝗥𝗧𝗔𝗡𝗖𝗘 🔸The remarkable success in face forgery techniques has received considerable attention in computer vision due to security concerns. We observe that up-sampling is a necessary step of most face forgery techniques, and cumulative up-sampling will result in obvious changes in the frequency domain, especially in the phase spectrum. 🔸According to the property of natural images, the phase spectrum preserves abundant frequency components that provide extra information and complement the loss of the amplitude spectrum. To this end, we present a novel Spatial-Phase Shallow Learning (SPSL) method, which combines spatial image and phase spectrum to capture the up-sampling artifacts of face forgery to improve the transferability, for face forgery detection. And we also theoretically analyze the validity of utilizing the phase spectrum. 🔸Moreover, we notice that local texture information is more crucial than high-level semantic information for the face forgery detection task. So we reduce the receptive fields by shallowing the network to suppress high-level features and focus on the local region. 🔸Extensive experiments show that SPSL can achieve the state-of-the-art performance on cross-datasets evaluation as well as multi-class classification and obtain comparable results on single dataset evaluation. #computervision #artificialintelligence #deeplearning
One more insightful post by 🇮🇳 Ashish Patel 🙂
I cannot agree more the importance of phase.. my own research also exploit that. Thanks for sharing