计算机科学
任务(项目管理)
补偿(心理学)
人工智能
下游(制造业)
融合
块(置换群论)
编码(内存)
图像(数学)
图像融合
传输(电信)
质量(理念)
计算机视觉
融合机制
基础(线性代数)
编码(集合论)
数据挖掘
端到端原则
上游(联网)
语义学(计算机科学)
网络体系结构
语义网络
人工神经网络
作者
Zhijia Yang,Yu Liu,Juan Cheng,Zhiqin Zhu,Yafei Zhang,Huafeng Li
标识
DOI:10.48550/arxiv.2604.08924
摘要
Infrared-visible image fusion aims to integrate complementary information for robust visual understanding, but existing fusion methods struggle with simultaneously adapting to multiple downstream tasks. To address this issue, we propose a Closed-Loop Dynamic Network (CLDyN) that can adaptively respond to the semantic requirements of diverse downstream tasks for task-customized image fusion. Specifically, CLDyN introduces a closed-loop optimization mechanism that establishes a semantic transmission chain to achieve explicit feedback from downstream tasks to the fusion network through a Requirement-driven Semantic Compensation (RSC) module. The RSC module leverages a Basis Vector Bank (BVB) and an Architecture-Adaptive Semantic Injection (A2SI) block to customize the network architecture according to task requirements, thereby enabling task-specific semantic compensation and allowing the fusion network to actively adapt to diverse tasks without retraining. To promote semantic compensation, a reward-penalty strategy is introduced to reward or penalize the RSC module based on task performance variations. Experiments on the M3FD, FMB, and VT5000 datasets demonstrate that CLDyN not only maintains high fusion quality but also exhibits strong multi-task adaptability. The code is available at https://github.com/YR0211/CLDyN.
科研通智能强力驱动
Strongly Powered by AbleSci AI