介观物理学
建筑
比例(比率)
计算机科学
计算机体系结构
人工智能
物理
地图学
地理
艺术
视觉艺术
量子力学
作者
Xuekang Zhu,Xiaochen Ma,Lei Su,Zhuohang Jiang,Bo Du,Xiwen Wang,Zeyu Lei,Wentao Feng,Chi‐Man Pun,Jizhe Zhou
标识
DOI:10.48550/arxiv.2412.13753
摘要
The mesoscopic level serves as a bridge between the macroscopic and microscopic worlds, addressing gaps overlooked by both. Image manipulation localization (IML), a crucial technique to pursue truth from fake images, has long relied on low-level (microscopic-level) traces. However, in practice, most tampering aims to deceive the audience by altering image semantics. As a result, manipulation commonly occurs at the object level (macroscopic level), which is equally important as microscopic traces. Therefore, integrating these two levels into the mesoscopic level presents a new perspective for IML research. Inspired by this, our paper explores how to simultaneously construct mesoscopic representations of micro and macro information for IML and introduces the Mesorch architecture to orchestrate both. Specifically, this architecture i) combines Transformers and CNNs in parallel, with Transformers extracting macro information and CNNs capturing micro details, and ii) explores across different scales, assessing micro and macro information seamlessly. Additionally, based on the Mesorch architecture, the paper introduces two baseline models aimed at solving IML tasks through mesoscopic representation. Extensive experiments across four datasets have demonstrated that our models surpass the current state-of-the-art in terms of performance, computational complexity, and robustness.
科研通智能强力驱动
Strongly Powered by AbleSci AI