Large-area magnetic skin for multi-point and multi-scale tactile sensing with super-resolution

Abstract The advancements in tactile sensor technology have found wide-ranging applications in robotic fields, resulting in remarkable achievements in object manipulation and overall human-machine interactions. However, the widespread availability of high-resolution tactile skins remains limited, due to the challenges of incorporating large-sized, robust sensing units and increased wiring complexity. One approach to achieve high-resolution and robust tactile skins is to integrate a limited number of sensor units (taxels) into a flexible surface material and leverage signal processing techniques to achieve super-resolution sensing. Here, we present a magnetic skin consisting of multi-direction magnetized flexible films and a contactless Hall sensor array. The key features of the proposed sensor include the specific magnetization arrangement, K-Nearest Neighbors (KNN) clustering algorithm and convolutional neural network (CNN) model for signal processing. Using only an array of 4*4 taxels, our magnetic skin is capable of achieving super-resolution perception over an area of 44100 mm2, with an average localization error of 1.2 mm. By employing neural network algorithms to decouple the multi-dimensional signals, the skin can achieve multi-point and multi-scale perception. We also demonstrate the promising potentials of the proposed sensor in intelligent control, by simultaneously controlling two vehicles with trajectory mapping on the magnetic skin.