Narrowing Domain Gaps With Bridging Samples for Generalized Face Forgery Detection

桥接(联网) 计算机科学 规范化(社会学) 人工智能 数据挖掘 计算机安全 人类学 社会学
作者
Yang Yu,Rongrong Ni,Siyuan Yang,Yao Zhao,Alex C. Kot
出处
期刊:IEEE Transactions on Multimedia [Institute of Electrical and Electronics Engineers]
卷期号:26: 3405-3417 被引量:2
标识
DOI:10.1109/tmm.2023.3310341
摘要

Face forgery technology has developed rapidly, causing severe security issues in society. Recently, with the continuous emergence of forgery techniques and types, most forensics methods suffer from the generalization problem. In particular, it is difficult for existing generalized methods to detect fake faces with unseen fake types. The reason is that the distribution gaps among cross-forgery types are too large. In this paper, we propose a novel generalized framework to narrow large gaps based on bridging cross-domain alignment to solve this problem. Specifically, our framework consists of three key steps: preventing, bridging and aligning distribution gaps. Firstly, in the feature mining stage, taking advantage of the ability of Instance Normalization (IN) to better tolerate domain gaps, we design Adaptive Batch and Instance Normalization (ABIN) to replace the commonly used BN to adaptively extract features to preliminarily prevent domain gaps. Secondly, we propose to generate bridging samples distributed among the inter-domains to fill large gaps based on progressive linear interpolation operation. Finally, with the help of bridging samples, the cross-domain alignment is performed to better narrow distribution gaps to refine data distribution, which helps to learn a more generalized framework. Extensive experiments show that our proposed framework achieves the state-of-the-art generalized performance.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
1秒前
小北完成签到,获得积分10
1秒前
3秒前
4秒前
didi发布了新的文献求助10
4秒前
宇文向雪发布了新的文献求助10
5秒前
fullsun完成签到,获得积分10
6秒前
6秒前
速溶baka完成签到,获得积分10
6秒前
ch发布了新的文献求助10
7秒前
聪明的小海豚完成签到,获得积分20
7秒前
心空完成签到,获得积分10
10秒前
10秒前
10秒前
谈笑间应助MIku采纳,获得10
12秒前
13秒前
彭于晏应助与光同尘采纳,获得10
13秒前
13秒前
14秒前
Jack发布了新的文献求助10
15秒前
谈笑间应助朴素海亦采纳,获得10
15秒前
FelixChen应助路人甲采纳,获得10
15秒前
16秒前
16秒前
17秒前
Orange应助赵楠采纳,获得10
17秒前
丘比特应助嘻嘻采纳,获得10
17秒前
笨笨芯发布了新的文献求助10
18秒前
你怎么这么可爱啊完成签到,获得积分10
18秒前
19秒前
科研通AI5应助宇文向雪采纳,获得10
19秒前
19秒前
juno发布了新的文献求助10
20秒前
arcadia完成签到 ,获得积分10
21秒前
21秒前
a3979107完成签到,获得积分10
21秒前
21秒前
酷波er应助笨笨芯采纳,获得30
21秒前
21秒前
高分求助中
Basic Discrete Mathematics 1000
Technologies supporting mass customization of apparel: A pilot project 600
Introduction to Strong Mixing Conditions Volumes 1-3 500
Tip60 complex regulates eggshell formation and oviposition in the white-backed planthopper, providing effective targets for pest control 400
A Field Guide to the Amphibians and Reptiles of Madagascar - Frank Glaw and Miguel Vences - 3rd Edition 400
China Gadabouts: New Frontiers of Humanitarian Nursing, 1941–51 400
The Healthy Socialist Life in Maoist China, 1949–1980 400
热门求助领域 (近24小时)
化学 材料科学 医学 生物 工程类 有机化学 物理 生物化学 纳米技术 计算机科学 化学工程 内科学 复合材料 物理化学 电极 遗传学 量子力学 基因 冶金 催化作用
热门帖子
关注 科研通微信公众号,转发送积分 3799862
求助须知:如何正确求助?哪些是违规求助? 3345153
关于积分的说明 10323869
捐赠科研通 3061736
什么是DOI,文献DOI怎么找? 1680492
邀请新用户注册赠送积分活动 807113
科研通“疑难数据库(出版商)”最低求助积分说明 763462