Visual‐Audio Thermoelectric Detectors for Images and Sound Recognition

Abstract Inherent in humans is the capacity to perceive music and art, engaging both the visual and auditory senses, with profound effects on physiological and psychological states. Sound and light possess the remarkable ability to transform into thermal energy and, ultimately, electrical signals, playing a crucial role in human sensory perception. This research introduces a previously unmentioned synesthesia‐inspired image and sound recognition system, diverging from conventional image/sound acquisition techniques based on photo/mechanical‐electrical conversion. Leveraging the photo/acoustic‐thermal‐electric effects, the system utilizes micro‐/commercial thermoelectric devices as a conduit for energy conversion. It successfully discriminates monochromatic red, green, blue (RGB) and color coverage, showcasing its proficiency in distinguishing ten digital paintings. Additionally, by probing fiber responses to varied sound frequencies and loudness levels, the system achieves time‐domain identification of four classical music compositions. The device exhibits high sensitivity to detecting input energy and its inputting rate power, offering a novel approach to image and sound recognition through thermal signals. Potential applications span from bionic image sensors and time‐domain thermal monitoring of audio. With further exploration, this thermoelectric‐based system holds promise in quantifying emotional responses to images and sound.