Infrared and visible image fusion via sparse representation and adaptive dual-channel PCNN model based on co-occurrence analysis shearlet transform

The principle of the image fusion is to integrate complementary information of the heterogeneous images to obtain a fused image that is more in line with the visual effect of the human eyes. However, most decomposition methods cannot distinguish the textures and edges in an image, which is easy to produce the halo artifacts around edges. In this paper, we proposed a novel image decomposition strategy (co-occurrence analysis shearlet transform, CAST) to preprocess the input images depending on the co-occurrence statistic information to generate the base layer and detail layer components. In order to improve the sparseness of the base layer, the classified sparse dictionary in the measurement domain is introduced to enhance the robustness of incorrect registration. As for the detail layers, the adaptive dual-channel PCNN model is adopted as the fusion rule, in which the neurons are activated by the improved spatial frequency operator (ISF), and the model uses the sum of the improved weighted Laplacian energies (IWSWL) as the adaptive linking strength. Finally, the fused image can be generated by the inverse CAST. Based on the combination of the sparseness of the classified dictionary and the visual characteristics of PCNN model, the more valuable information of the source images can be fused, so that the final fused images conform to the human visual system. Qualitative and quantitative experimental results demonstrate the superiority of the proposed method over other typical fusion techniques on the publicly available datasets.