地标
计算机科学
人工智能
面子(社会学概念)
光学(聚焦)
对抗制
剪裁(形态学)
深度学习
遮罩(插图)
机器学习
计算机视觉
模式识别(心理学)
艺术
视觉艺术
社会学
哲学
物理
光学
语言学
社会科学
作者
Yuezun Li,Peipei Sun,Honggang Qi,Siwei Lyu
标识
DOI:10.1016/j.cviu.2024.103935
摘要
The recent development of Deep Neural Networks (DNN) has significantly increased the realism of AI-synthesized faces, with the most notable examples being the DeepFakes. In particular, DeepFake can synthesize the face of the target subject from the face of another subject, while retaining the same face attributes. With the increased number of social media portals, DeepFake videos rapidly spread through the Internet, causing a broad negative impact on society. Recent countermeasures to combat DeepFake focus on detection, a passive defense that is not able to prevent or slow down the generation of DeepFakes. Therefore in this paper, we focus on proactive defense and describe a new method named LandmarkBreaker, which is the first dedicated solution to obstruct the generation of DeepFake videos by disrupting facial landmark extraction, inspired by the observation that facial landmark extraction is an indispensable step for face alignment required in DeepFake synthesis. To disrupt facial landmark extraction, we design adversarial perturbations meticulously by optimizing a loss function in an iterative manner. Furthermore, we develop LandmarkBreaker++, which can further reduce the perceptibility of adversarial perturbations using a gradient clipping and face masking strategy. We validate our method on three state-of-the-art facial landmark extractors and investigate the defense performance on a recent Celeb-DF dataset, which demonstrates the efficacy of our method in obstructing the generation of DeepFake videos.
科研通智能强力驱动
Strongly Powered by AbleSci AI