LandmarkBreaker: A proactive method to obstruct DeepFakes via disrupting facial landmark extraction

地标 计算机科学 人工智能 面子(社会学概念) 光学(聚焦) 对抗制 剪裁(形态学) 深度学习 遮罩(插图) 机器学习 计算机视觉 模式识别(心理学) 艺术 社会科学 语言学 哲学 物理 社会学 光学 视觉艺术
作者
Yuezun Li,Peipei Sun,Honggang Qi,Siwei Lyu
出处
期刊:Computer Vision and Image Understanding [Elsevier]
卷期号:240: 103935-103935
标识
DOI:10.1016/j.cviu.2024.103935
摘要

The recent development of Deep Neural Networks (DNN) has significantly increased the realism of AI-synthesized faces, with the most notable examples being the DeepFakes. In particular, DeepFake can synthesize the face of the target subject from the face of another subject, while retaining the same face attributes. With the increased number of social media portals, DeepFake videos rapidly spread through the Internet, causing a broad negative impact on society. Recent countermeasures to combat DeepFake focus on detection, a passive defense that is not able to prevent or slow down the generation of DeepFakes. Therefore in this paper, we focus on proactive defense and describe a new method named LandmarkBreaker, which is the first dedicated solution to obstruct the generation of DeepFake videos by disrupting facial landmark extraction, inspired by the observation that facial landmark extraction is an indispensable step for face alignment required in DeepFake synthesis. To disrupt facial landmark extraction, we design adversarial perturbations meticulously by optimizing a loss function in an iterative manner. Furthermore, we develop LandmarkBreaker++, which can further reduce the perceptibility of adversarial perturbations using a gradient clipping and face masking strategy. We validate our method on three state-of-the-art facial landmark extractors and investigate the defense performance on a recent Celeb-DF dataset, which demonstrates the efficacy of our method in obstructing the generation of DeepFake videos.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
科研通AI2S应助封不迟采纳,获得10
刚刚
勤恳迎天发布了新的文献求助10
2秒前
5秒前
JIANGSHUI完成签到,获得积分10
7秒前
MMrian完成签到,获得积分10
11秒前
12秒前
12秒前
852应助zz采纳,获得10
15秒前
18秒前
18秒前
伍秋望完成签到,获得积分10
18秒前
20秒前
rocky15应助黄嘉慧采纳,获得20
21秒前
奶瓶完成签到 ,获得积分10
22秒前
齐小明发布了新的文献求助10
23秒前
Yw_M完成签到,获得积分10
27秒前
sjlllll发布了新的文献求助10
28秒前
考研大拿发布了新的文献求助10
29秒前
30秒前
31秒前
wanci应助WTT采纳,获得10
34秒前
科研通AI2S应助向路路采纳,获得10
34秒前
大个应助怡然平露采纳,获得10
34秒前
科研通AI2S应助张腾昊采纳,获得10
37秒前
lifescience1完成签到,获得积分10
38秒前
40秒前
41秒前
怡然平露完成签到,获得积分10
43秒前
43秒前
zz发布了新的文献求助10
45秒前
怡然平露发布了新的文献求助10
47秒前
海绵胡完成签到,获得积分10
48秒前
科研通AI2S应助张腾昊采纳,获得10
52秒前
53秒前
54秒前
zz完成签到,获得积分10
57秒前
光溜溜的大门牙完成签到,获得积分10
58秒前
娃哈哈发布了新的文献求助10
59秒前
1分钟前
大个应助科研通管家采纳,获得10
1分钟前
高分求助中
Sustainable Land Management: Strategies to Cope with the Marginalisation of Agriculture 1000
Corrosion and Oxygen Control 600
Python Programming for Linguistics and Digital Humanities: Applications for Text-Focused Fields 500
Love and Friendship in the Western Tradition: From Plato to Postmodernity 500
Heterocyclic Stilbene and Bibenzyl Derivatives in Liverworts: Distribution, Structures, Total Synthesis and Biological Activity 500
重庆市新能源汽车产业大数据招商指南(两链两图两池两库两平台两清单两报告) 400
Division and square root. Digit-recurrence algorithms and implementations 400
热门求助领域 (近24小时)
化学 材料科学 医学 生物 有机化学 工程类 生物化学 纳米技术 物理 内科学 计算机科学 化学工程 复合材料 遗传学 基因 物理化学 催化作用 电极 光电子学 量子力学
热门帖子
关注 科研通微信公众号,转发送积分 2548783
求助须知:如何正确求助?哪些是违规求助? 2176691
关于积分的说明 5605753
捐赠科研通 1897461
什么是DOI,文献DOI怎么找? 946990
版权声明 565447
科研通“疑难数据库(出版商)”最低求助积分说明 503985