Dynamic optically multiplexed imaging

Optically multiplexed imagers overcome the tradeoff between field of view and resolution by superimposing images from multiple fields of view onto a single focal plane. In this paper, we consider the implications of independently shifting each field of view at a rate exceeding the frame rate of the focal plane array and with a precision that can exceed the pixel pitch. A sequence of shifts enables the reconstruction of the underlying scene, with the number of frames required growing inversely with the number of multiplexed images. As a result, measurements from a sufficiently fast sampling sensor can be processed to yield a low distortion image with more pixels than the original focal plane array, a wider field of view than the original optical design, and an aspect ratio different than the original lens. This technique can also enable the collection of low-distortion, wide field of view videos. A sequence of sub-pixel spatial shifts extends this capability to allow the recovery of a wide field of view scene at sub-pixel resolution. To realize this sensor concept, a novel and compact divided aperture multiplexed sensor, capable of rapidly and precisely shifting its fields of view, was prototyped. Using this sensor, we recover twenty-four megapixel images from a four-megapixel focal plane and show the feasibility of simultaneous de-multiplexing and super-resolution.