光谱成像
计算机科学
迭代重建
编码器
高光谱成像
人工智能
快照(计算机存储)
卷积神经网络
图像质量
人工神经网络
反问题
深度学习
图像分辨率
光学
计算机视觉
全光谱成像
编码孔径
算法
Boosting(机器学习)
迭代和增量开发
点扩散函数
自编码
图像处理
限制
高保真
医学影像学
光谱带
微波成像
模式识别(心理学)
变压器
迭代法
压缩传感
数字成像
作者
Feng Huang,yizhong Wu,maijie Cao,Zhou Wu,Wen Tang,Jinping Li,Weijie Chang,Shengyao Xu
出处
期刊:Optics Express
[Optica Publishing Group]
日期:2026-01-07
卷期号:34 (1): 795-795
摘要
End-to-end computational spectral imaging based on metalens, which enables compact spectral imaging systems by co-optimization of optical encoder and computational decoder, has attracted extensive attention. However, traditional end-to-end spectral imaging systems typically employ pure data-driven convolutional neural networks (CNN) that ignore physical priors of the imaging process and long-range dependencies, limiting high-precision spectral reconstruction. In this paper, we propose and experimentally demonstrate an end-to-end snapshot metalens spectral imaging based on a physics-driven deep unfolding half-shuffle Transformer network. By unfolding the iterative process of traditional optimization algorithms into a cascaded network structure, we not only integrate the advantages of adaptive feature learning neural network and physical model, but also introduce the physical priors of optical-encoder into the network to allow physically-consistent reconstruction process. Besides, a multi-head self-attention mechanism half-shuffle Transformer network is utilized to extract both local and global information. In this way, we achieve stronger generalization and higher reconstruction quality compared with traditional CNN-based reconstruction methods. We designed and fabricated the metalens, achieving high-fidelity spectral image reconstruction across 25 channels (430-670 nm) at a spatial resolution of 512 × 512 with an average peak signal-to-noise ratio (PSNR) of 42.87 dB, while preserving rich spatial details compared with state-of-the-art (SOTA) methods. Our proposed framework facilitates full interaction between the encoder and the decoder, boosting the power of joint optimization in end-to-end design, and paves a way for the design of miniaturized spectral imaging metalenes.
科研通智能强力驱动
Strongly Powered by AbleSci AI