Monochrome and Color Polarization Demosaicking Based on Intensity-Guided Residual Interpolation

A division-of-focal-plane or microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array (MPFA or CPFA), the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. In this study, we proposed a novel MPFA demosaicking method based on intensity-guided residual interpolation (IGRI) and extended it to CPFA demosaicking. The key of IGRI is generating an effective intensity guide image, for which we proposed two methods considering four-directional intensity and polarization edge information. We also constructed a new full color-polarization image dataset captured using a 3-CCD RGB camera and a rotating polarizer. By using the constructed dataset, we experimentally validated that our IGRI-based methods outperform existing methods in MPFA and CPFA demosaicking.