Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness

对抗制 计算机科学 稳健性(进化) 分类 机器学习 人工智能 一般化 领域(数学) 实证研究 数据科学 误传 脆弱性(计算) 欺骗 数据挖掘 模式 资源(消歧) 联营 经验证据 管理科学 边距(机器学习)
作者
Hong-Hanh Nguyen-Le,Van-Tuan Tran,Dinh-Thuc Nguyen,Nhien‐An Le‐Khac
出处
期刊:Artificial Intelligence Review [Springer Science+Business Media]
卷期号:59 (10) 被引量:32
标识
DOI:10.1007/s10462-026-11608-4
摘要

Abstract Deepfakes (DFs) have emerged as a significant threat in recent years. They are exploited for malicious purposes such as impersonation, misinformation dissemination, and artistic style imitation, raising critical ethical and security concerns. This survey presents a comprehensive cross-modality analysis of passive DF detection, examining image, video, and audio modalities simultaneously. Distinct from multimodal detection which fuses multiple data streams (e.g., audio-visual, text-visual), our cross-modality analysis investigates the interconnected relationships, shared methodological principles, and common vulnerabilities across independent modalities. We systematically categorize detection approaches based on their underlying methodologies: forensic-based, data-driven, fingerprint-based, and hybrid techniques for visual modalities, and handcrafted versus learnable features for audio. We also extend our analysis beyond mere detection accuracy to include essential performance dimensions for real-world deployment, including generalization and robustness. Additionally, this survey provides a unified evaluation protocol across 10 popular datasets to assess detection accuracy, generalization, and robustness in each modality. Specifically, we conduct extensive empirical evaluations across three critical dimensions: (1) verification of reported within-domain accuracy for 13 unimodal detectors, (2) cross-domain generalization assessment of 33 methods specifically designed to enhance generalization capability, and (3) robustness evaluation of 6 methods against adversarial attacks. Our experiments reveal a persistent generalization gap, with performance degradations of $$10-15\%$$ in out-of-distribution scenarios, and vulnerability to white-box adversarial attacks exceeding $$80\%$$ success rates. We also analyze the advantages and limitations of existing datasets, benchmarks, and evaluation metrics for passive DF detection. Finally, we propose future research directions to address these unexplored and emerging issues in the field of passive DF detection. This survey serves as a comprehensive resource for researchers and practitioners, providing insights into the current landscape, methodological approaches, and promising future directions in this rapidly evolving field.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
2秒前
三分之二发布了新的文献求助10
2秒前
李轩发布了新的文献求助10
2秒前
家海燕完成签到 ,获得积分10
2秒前
Mia123的应助被科研通管家采纳,获得10
3秒前
远山完成签到 ,获得积分10
3秒前
香蕉觅云的应助被科研通管家采纳,获得10
3秒前
3秒前
今后的应助被科研通管家采纳,获得10
3秒前
lixia发布了新的文献求助10
3秒前
脑洞疼的应助被科研通管家采纳,获得10
3秒前
水煮电吹风的应助被一一采纳,获得10
3秒前
赘婿的应助被科研通管家采纳,获得10
3秒前
爆米花的应助被科研通管家采纳,获得10
3秒前
JamesPei的应助被科研通管家采纳,获得10
4秒前
orixero的应助被科研通管家采纳,获得10
4秒前
Jasper的应助被科研通管家采纳,获得10
4秒前
隐形曼青的应助被科研通管家采纳,获得10
4秒前
大个的应助被科研通管家采纳,获得10
4秒前
ss的应助被科研通管家采纳,获得10
4秒前
乐乐的应助被科研通管家采纳,获得10
4秒前
4秒前
852的应助被科研通管家采纳,获得30
5秒前
情怀的应助被科研通管家采纳,获得10
5秒前
顾矜的应助被科研通管家采纳,获得10
5秒前
斯文败类的应助被科研通管家采纳,获得10
5秒前
烟花的应助被科研通管家采纳,获得10
5秒前
pupugepi发布了新的文献求助10
6秒前
lht完成签到,获得积分10
6秒前
DW的应助被果郭采纳,获得10
6秒前
英姑的应助被tang采纳,获得10
7秒前
flysky120发布了新的文献求助10
8秒前
8秒前
8秒前
大模型的应助被PennyYe采纳,获得10
9秒前
冷艳妙柏完成签到,获得积分10
9秒前
jujuezhe完成签到,获得积分10
10秒前
Lemon完成签到,获得积分10
10秒前
酷波er的应助被饱满的慕凝采纳,获得10
11秒前
11秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8177667
求助须知:如何正确求助?哪些是违规求助? 9568537
关于积分的说明 21799700
捐赠科研通 7772307
什么是DOI,文献DOI怎么找? 3432429
关于科研通互助平台的介绍 2556651
邀请新用户注册赠送积分活动 2478011