Artificial multisensory system with optical feedback for multimodal perceptual imaging

Artificial sensory systems require appropriate input–output modalities to enhance interaction efficiency and accuracy. It is crucial to mimic an organism to perceive and integrate multiple external stimuli and to construct systems with multiple sensory inputs. In addition, the application of optical output to the sensory system not only solves the problem of electrical signal transmission, but also enables direct imaging through optical output. Here, we propose an artificial multisensory system with optical feedback (AMSOF), which can simultaneously receive pressure and thermal stimuli and then generate neuromorphic optical responses along with feedback. Among them, the triboelectric nanogenerator (TENG) is responsible for receiving pressure stimuli, while the artificial light-emitting synaptic device utilizes the quantum dot thermal quenching mechanism to processes temperature signals and generate optical feedback. Additionally, if the AMOFS is applied to the fingerprint recognition system, it can enable fingerprint imaging through dual recognition of these two signals. In other words, it can enhance the security of biometric authentication by adding the capability to distinguish the live nature of objects on top of traditional fingerprint recognition. Therefore, this system aims to achieve more intelligent and efficient human–computer interaction and environmental perception capabilities, bringing forth a multitude of applications and innovations for smart systems.