多光谱图像
计算机科学
人工智能
计算机视觉
图像融合
目标检测
保险丝(电气)
融合
小波
传感器融合
光学(聚焦)
行人检测
卷积神经网络
对象(语法)
小波变换
钥匙(锁)
融合规则
模式识别(心理学)
卷积(计算机科学)
卫星
多光谱模式识别
索贝尔算子
前景检测
核(代数)
能见度
频道(广播)
视频跟踪
作者
Sijia Peng,Ruxiang Xue,Yunfei Tong,Zhe Wang,Hai Yang
标识
DOI:10.1109/jstars.2025.3648007
摘要
Multispectral object detection is essential for applications including autonomous driving, surveillance, security systems, and Earth observation using airborne or satellite platforms, where illumination conditions often vary dramatically. While significant progress has been made, existing approaches primarily focus on fusion strategies while neglecting in-depth exploration of modality-specific characteristics. To address these limitations, we propose a novel Edge-Enhanced and Frequency-Aware Fusion network (EFAF), an end-to-end framework that integrates visible and infrared modalities for robust multispectral object detection. Our framework leverages the strengths of edge-enhanced features, frequency-domain analysis, and multi-modal fusion to achieve superior performance. The key innovations of EFAF lie in its Edge Enhancement Module (EEM) and Frequency-Aware Fusion Module (FAFM). The EEM integrates Sobel and Laplacian operators with convolutional layers to enhance target contours and provide precise spatial guidance for fusion. Meanwhile, the FAFM employs the Discrete Wavelet Transform (DWT) to decompose features into multi-band frequency components and applies self-attention to refine global representations. It further incorporates dual cross-attention and channel attention to adaptively fuse complementary modality information. Extensive experiments on public datasets demonstrate that EFAF exhibits superior performance in visible-infrared multispectral object detection, representing a significant advancement for practical applications requiring reliable detection under varying conditions.
科研通智能强力驱动
Strongly Powered by AbleSci AI