Continuous fake media detection: Adapting deepfake detectors to new generative techniques

计算机科学 探测器 生成语法 人工智能 机器学习 模式识别(心理学) 计算机视觉 电信
作者
Francesco Tassone,Luca Maiano,Irene Amerini
出处
期刊:Computer Vision and Image Understanding [Elsevier BV]
卷期号:249: 104143-104143 被引量:8
标识
DOI:10.1016/j.cviu.2024.104143
摘要

Generative techniques continue to evolve at an impressively high rate, driven by the hype about these technologies. This rapid advancement severely limits the application of deepfake detectors, which, despite numerous efforts by the scientific community, struggle to achieve sufficiently robust performance against the ever-changing content. To address these limitations, in this paper, we propose an analysis of two continuous learning techniques on a Short and a Long sequence of fake media. Both sequences include a complex and heterogeneous range of deepfakes (generated images and videos) from GANs, computer graphics techniques, and unknown sources. Our experiments show that continual learning could be important in mitigating the need for generalizability. In fact, we show that, although with some limitations, continual learning methods help to maintain good performance across the entire training sequence. For these techniques to work in a sufficiently robust way, however, it is necessary that the tasks in the sequence share similarities. In fact, according to our experiments, the order and similarity of the tasks can affect the performance of the models over time. To address this problem, we show that it is possible to group tasks based on their similarity. This small measure allows for a significant improvement even in longer sequences. This result suggests that continual techniques can be combined with the most promising detection methods, allowing them to catch up with the latest generative techniques. In addition to this, we propose an overview of how this learning approach can be integrated into a deepfake detection pipeline for continuous integration and continuous deployment (CI/CD). This allows you to keep track of different funds, such as social networks, new generative tools, or third-party datasets, and through the integration of continuous learning, allows constant maintenance of the detectors.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
无花果应助吴仕萍采纳,获得10
刚刚
TJL完成签到 ,获得积分10
1秒前
情怀应助cys采纳,获得10
1秒前
英姑应助zzzzz采纳,获得10
1秒前
我是老大应助WNing采纳,获得10
1秒前
ding应助WNing采纳,获得10
1秒前
汉堡包应助WNing采纳,获得10
1秒前
ljj发布了新的文献求助10
1秒前
所所应助风中的芷蕾采纳,获得10
2秒前
Richs发布了新的文献求助10
2秒前
joyce930728完成签到 ,获得积分10
2秒前
科目三应助温婉的向真采纳,获得10
2秒前
2秒前
3秒前
3秒前
张沛发布了新的文献求助10
3秒前
3秒前
科目三应助Ann采纳,获得10
3秒前
李健的小迷弟应助ljj采纳,获得10
4秒前
carrot完成签到,获得积分10
4秒前
NexusExplorer应助无情的说采纳,获得10
4秒前
4秒前
5秒前
5秒前
zhz发布了新的文献求助10
5秒前
6秒前
6秒前
shuang发布了新的文献求助10
6秒前
Ava应助minnnnnnn采纳,获得10
6秒前
fu发布了新的文献求助10
8秒前
桐桐应助无情科研狗采纳,获得10
9秒前
9秒前
9秒前
9秒前
OnlyHarbour发布了新的文献求助10
10秒前
斯文败类应助123采纳,获得10
10秒前
10秒前
桃铱铱完成签到,获得积分10
11秒前
orixero应助我的天呐采纳,获得10
11秒前
万能图书馆应助糯米采纳,获得10
12秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
The Cambridge History of China: Volume 4, Sui and T'ang China, 589–906 AD, Part Two 1500
Cowries - A Guide to the Gastropod Family Cypraeidae 1200
Quality by Design - An Indispensable Approach to Accelerate Biopharmaceutical Product Development 800
Pulse width control of a 3-phase inverter with non sinusoidal phase voltages 777
The Cambridge Handbook of Second Language Acquisition (2nd)[第二版] 666
Signals, Systems, and Signal Processing 610
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6401718
求助须知:如何正确求助?哪些是违规求助? 8219462
关于积分的说明 17419181
捐赠科研通 5454645
什么是DOI,文献DOI怎么找? 2882629
邀请新用户注册赠送积分活动 1859081
关于科研通互助平台的介绍 1700817