Compact snapshot multispectral-depth imaging system with shared-modal multi-bandpass lenslet array (SMLA)

This paper proposes a compact, flexible multispectral-depth imaging technique based on a sub-aperture array, multi-bandpass (MBP) filters, and an RGB-NIR sensor. The system simultaneously captures spectral and depth information and reconstructs multispectral images using a linear method. The MBP filters can be customized flexibly without requiring continuous spectral bands or pixel-level alignment, simplifying fabrication and reducing costs. A shared-modal MBP filter design in front of the sub-aperture array effectively resolves parallax between apertures, enabling efficient spectral-depth registration. The prototype system, consisting of four sub-apertures and four three-band MBP filters, covers the 400-900 nm spectral range with nine spectral channels, achieves a spatial resolution of 1296 × 1028 pixels and a spectral resolution of 7-15 nm, and supports simultaneous depth measurement.