| 标题 |
Adaptive Contribution Modulation For Multi-Modal Manipulation Media Detection and Grounding |
| 网址 | |
| DOI | |
| 其它 | In response to the security risks posed by the realistic propagation of manipulated media data, detecting and grounding multi-modal media manipulation has received attention as a challenging task. However, there is multi-modal contribution imbalance on current approach for cross-modal learning, which affects model performance optimisation. To this end, we propose an Adaptive Contribution Modulation (ACM) framework to solve the problem of multi-modal contribution imbalance. To balance the image and text embedding features before fusion, we propose adaptive weight decision to computes dynamic weights for fusion features, which enable more adaptive and robust decision-making. Meanwhile, we propose contribution modulation block, which dynamically governs the contributions of different modalities for optimization. |
| 求助人 | |
| 下载 |
PDF的下载单位、IP信息已删除
(2025-6-4)