Universal Polarization Demosaicking Using Newton Polynomial and Residual Interpolation

The development of division-of-focal-plane (DoFP) technology has made it possible to acquire full polarization information in a single shot, but its spatially alternating arrangement of polarizers suffers from partial loss of information. Polarization demosaicking methods (PDMs) are essential for recovering high-quality polarization information. Most existing PDMs can be applied only to a few specific monochrome polarization filter arrays (MPFAs) and rely on correspondingly strict assumptions. In this article, we propose a universal PDM using the Newton polynomial and residual interpolation (RI) that can be applied to many different types of MPFAs. Our method first interpolates the intensity component${S}_{{0}}$of the Stokes vector via the Newton polynomial and reconstructs the polarization channels using RI guided by${S}_{{0}}$. Specifically,${S}_{{0}}$can be expressed as a linear combination of the polarization channels of any three angles, and our method selects the three angles in turn, derives the combination coefficients to obtain four weighted mosaic images, and then weighted averages them to obtain a universal weighted mosaic image, and uses Newton polynomial interpolation to derive the guide image${S}_{{0}}$. To validate our method, we extend the commonly used image quality metrics for measuring the accuracy of the recovered polarization information. Extensive experiments show that our method achieves competitive or better performance compared to other state-of-the-art methods on different types of MPFAs or color polarization filter arrays (CPFAs). The source code is available athttps://github.com/ymingsu/UNRI.