Reconstruction of 3D Retina from Multi-viewed Stereo Fundus Images via Dynamic Registration

The human retinal surface resembles to a sphere while it is captured by two-dimensional (2D) planar imaging to have a stereo sequence in clinical practice. Reconstructing its three-dimensional (3D) structure from the 2D planar retinal images is crucial for analyzing the relationship between the topological morphology and clinical implication. In this regard, we propose to reconstruct the 3D retina structure from 2D stereo fundus images via dynamic registration. The fundus images from different viewpoints are first co-registrated by using multi-scale deep convolutional feature and geometric structure feature by building their transformation function. The aligned images are then mosaicked together and a 3D reconstruction is obtained by a learned weighted smoothing project the registered images onto 3D coordinates. We compare the proposed registration method with five state-of-the-art methods. Extensive experimental results demonstrate that the proposed framework achieves superior performances, even with challenging scenarios in which the tested images are severely degraded by illness, large eyeball rotation and low resolutions.