Polarization Image Demosaicking via Nonlocal Sparse Tensor Factorization

Division-of-focal-plane (DoFP) polarimeter provides a way for snapshot acquisition, making it available to simultaneously record polarization measurements at different orientations. This polarization imaging system has gained more attention in the last few years and is promising to be used in the fields of computer vision and remote sensing. However, this system suffers from the degradation of spatial resolution. To reconstruct polarization information at full resolution, polarization image demosaicking is indispensable. To address polarization image demosaicking issue while preserving the essential structure of polarization data, a sparse tensor factorization-based model is proposed. For a target cube, its similar cubes are first grouped together as a tensor. Then, its compact dictionary and sparse core tensor are learned by factorizing the tensor using sparse coding. Moreover, the correlation among different polarization orientations and the nonlocal self-similarity are adopted to boost the performance. Experimental results on synthetic and real-world data demonstrate that our proposed model outperforms several state-of-the-art methods in terms of both quantitative measurements and visual quality.