Continuous fake media detection: Adapting deepfake detectors to new generative techniques

计算机科学 探测器 生成语法 人工智能 机器学习 模式识别(心理学) 计算机视觉 电信
作者
Francesco Tassone,Luca Maiano,Irene Amerini
出处
期刊:Computer Vision and Image Understanding [Elsevier BV]
卷期号:249: 104143-104143 被引量:8
标识
DOI:10.1016/j.cviu.2024.104143
摘要

Generative techniques continue to evolve at an impressively high rate, driven by the hype about these technologies. This rapid advancement severely limits the application of deepfake detectors, which, despite numerous efforts by the scientific community, struggle to achieve sufficiently robust performance against the ever-changing content. To address these limitations, in this paper, we propose an analysis of two continuous learning techniques on a Short and a Long sequence of fake media. Both sequences include a complex and heterogeneous range of deepfakes (generated images and videos) from GANs, computer graphics techniques, and unknown sources. Our experiments show that continual learning could be important in mitigating the need for generalizability. In fact, we show that, although with some limitations, continual learning methods help to maintain good performance across the entire training sequence. For these techniques to work in a sufficiently robust way, however, it is necessary that the tasks in the sequence share similarities. In fact, according to our experiments, the order and similarity of the tasks can affect the performance of the models over time. To address this problem, we show that it is possible to group tasks based on their similarity. This small measure allows for a significant improvement even in longer sequences. This result suggests that continual techniques can be combined with the most promising detection methods, allowing them to catch up with the latest generative techniques. In addition to this, we propose an overview of how this learning approach can be integrated into a deepfake detection pipeline for continuous integration and continuous deployment (CI/CD). This allows you to keep track of different funds, such as social networks, new generative tools, or third-party datasets, and through the integration of continuous learning, allows constant maintenance of the detectors.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
FashionBoy应助peggy采纳,获得10
1秒前
充电宝应助浮沉采纳,获得10
2秒前
自由完成签到,获得积分20
4秒前
万能图书馆应助momo采纳,获得10
5秒前
5秒前
哈哈哈完成签到,获得积分10
5秒前
6秒前
斯文败类应助naiz采纳,获得40
7秒前
NexusExplorer应助渺茫的星辰采纳,获得10
8秒前
sci2025opt完成签到 ,获得积分10
8秒前
11秒前
轻松大王完成签到,获得积分10
11秒前
贾克斯完成签到,获得积分20
11秒前
Rain发布了新的文献求助10
11秒前
搜集达人应助violenceee采纳,获得10
12秒前
科研通AI6.3应助费代云采纳,获得10
13秒前
14秒前
15秒前
16秒前
自由发布了新的文献求助40
16秒前
16秒前
徐枘发布了新的文献求助10
18秒前
曾经的嘉熙完成签到 ,获得积分10
18秒前
19秒前
缓慢念云完成签到,获得积分10
20秒前
隐形曼青应助六点采纳,获得10
20秒前
21秒前
21秒前
昏睡的科研小白完成签到 ,获得积分10
23秒前
康阿蛋发布了新的文献求助10
25秒前
情怀应助瞌睡的小付采纳,获得10
25秒前
26秒前
26秒前
26秒前
dd发布了新的文献求助10
26秒前
26秒前
27秒前
dylan发布了新的文献求助10
28秒前
科研通AI6.4应助七月不远采纳,获得10
28秒前
酷波er应助不朽阳神采纳,获得10
28秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Römisch-Germanische Forschungen 1000
APA handbook of comparative psychology: Basic concepts, methods, neural substrate, and behavior 1000
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
The fast track to determining transfer functions of linear circuits: The student guide 500
Electric machines: theory, operating applications, and controls 500
The Analytical and Numerical Solution of Electric and Magnetic Fields 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7604097
求助须知:如何正确求助?哪些是违规求助? 9179909
关于积分的说明 19660561
捐赠科研通 7179276
什么是DOI,文献DOI怎么找? 3269289
关于科研通互助平台的介绍 2433351
邀请新用户注册赠送积分活动 2263331