高光谱成像
快照(计算机存储)
计算机视觉
计算机科学
适应(眼睛)
人工智能
心理学
神经科学
操作系统
作者
Chong Zhang,Wenjing Liu,Juntao Li,Siqi Li,Lizhi Wang,Hua Huang,Yuanjin Zheng,Yongtian Wang,Jinli Suo,Weitao Song
标识
DOI:10.1002/lpor.202401921
摘要
Abstract Snapshot hyperspectral imaging (SHI) is increasing demand for various applications in dynamic scenes. Current mainstream solutions rely on machine learning with open‐source datasets to acquire fixed compression encoder and reconstruction decoder, which limits their generalizability across diverse real‐world scenarios. Herein, these challenges are addressed by a tunable optimally‐coded SHI (TOSHI) system that allows dynamic optimization of optical encoding elements and software decoding strategies based on actual scene data. To improve scene adaptability, a domain‐aware adaptive mechanism is introduced that extracts spatial and spectral features from ground truth data to calibrate the system through transfer learning and parameter‐conserving fine‐tuning. Leveraging spatial division multiplexing technology, TOSHI is equipped with an auxiliary imaging structure to acquire ground truth, enabling more efficient scene adaptation. As a demonstration, a proof‐of‐concept prototype is developed with an image resolution of up to 5120 × 5120 pixels, an angular resolution of 0.05 degrees, a spectral resolution of 10 nm within the visible wavelength, and a spatial‐temporal resolution of up to 2048 × 2048 pixels @14.7fps, achieving a PSNR improvement of ≈3.54 dB over conventional SHI systems. Additionally, TOSHI has been verified for online industrial measurements, including active and passive lighting devices, through extensive experiments.
科研通智能强力驱动
Strongly Powered by AbleSci AI