The processing of nonstructural visual data requires not only computers to perform efficient calculations but also edge visual perception devices to access and process information effectively. Therefore, it is necessary to develop low-power neuromorphic optical sensors with integrated sensing, memory and processing functions. The neuromorphic optical sensors can be achieved by combining photoreceptors with general neuromorphic devices, or by developing neuromorphic photodetectors. In this review, we first introduce the working mechanism and basic parameters of the general neuromorphic devices. Then, the neuromorphic photodetectors are summarized, including their classifications, working mechanisms and applications. Neuromorphic devices have shown great potential in visual perception, but there are still some directions to be further explored, such as more microscopic explanation in mechanisms, more stable multifunctional devices, and more abundant application scenarios.