Stretchable, Rechargeable, Multimodal Hybrid Electronics for Decoupled Sensing toward Emotion Detection

Despite the rapid development of stretchable electronic devices for various applications in biomedicine and healthcare, the coupling between multiple input signals remains an obstacle in multimodal sensing before use in practical environments. This work introduces a fully integrated stretchable, rechargeable, multimodal hybrid device that combines decoupled sensors with a flexible wireless powering and transmitting module for emotion recognition. Through optimized structural design and material selection, the sensors can provide continuous real-time decoupled monitoring of biaxial strain, temperature, humidity, heart rate, and SpO2 levels. With a stacked bilayer for both the sensors and the flexible circuit, the rechargeable system showcases a reduced device footprint and improved comfort. A neural network model is also demonstrated to allow for high-precision facial expression recognition. By transmitting the real-time measured data to mobile devices and the cloud, the system can allow healthcare professionals to evaluate psychological health and provide emotional support through telemedicine when needed.