保险丝(电气)
人工智能
计算机科学
模式识别(心理学)
特征(语言学)
模态(人机交互)
像素
合成孔径雷达
交叉口(航空)
光学(聚焦)
语义学(计算机科学)
计算机视觉
地理
地图学
工程类
哲学
物理
语言学
光学
程序设计语言
电气工程
作者
Wangbin Li,Kaimin Sun,Wenzhuo Li,Jinjiang Wei,Shunxia Miao,Song Gao,Qinhui Zhou
标识
DOI:10.1016/j.isprsjprs.2023.04.008
摘要
Optical and synthetic aperture radar (SAR) images, two standard Earth observation tools, can reflect the characteristics of the surface from different perspectives and provide complementary information for land use classification. However, because they belong to different modes and express land objects differently, it is challenging to effectively fuse and use them to perform a pixel-wise classification. Current methods only focus on the local receptive field to fuse deep features in a single dimension, which is too simple to fully exploit the correlation between different modes. Moreover, the appearance disparities between each modality may induce semantic misalignment and disrupt the conditions of features’ fusion. To overcome the above problems, we introduce a spatial-aware circular module to generate a cross-modality receptive field and globally enhance the interaction between each pixel in the spatial dimension. Additionally, we recalibrate the features in the channel dimension to selectively refine and retain the essential things during the process, which can further achieve feature refinement. To reduce the impact of modal appearance disparities, we transform their high-level features into a common latent space and align their distributions to correlate the complementary cues hidden in each modality. The experimental results for the WHU-OPT-SAR dataset show that our method performed better than other state-of-the-art methods, with a mean intersection over union (mIoU) of 58.5% and an overall accuracy (OA) of 84.2%. Furthermore, the method obtained competitive results in Ezhou and Panjin, China. The results demonstrate our method’s applicability.
科研通智能强力驱动
Strongly Powered by AbleSci AI