Litcius/Paper detail

Multi-receptor skin with highly sensitive tele-perception somatosensory

Yan Du, Penghui Shen, Houfang Liu, Yuyang Zhang, Luyao Jia, Xiong Pu, Feiyao Yang, Tian‐Ling Ren, Daping Chu, Zhong Lin Wang, Di Wei

2024Science Advances79 citationsDOIOpen Access PDF

Abstract

The limitations and complexity of traditional noncontact sensors in terms of sensitivity and threshold settings pose great challenges to extend the traditional five human senses. Here, we propose tele-perception to enhance human perception and cognition beyond these conventional noncontact sensors. Our bionic multi-receptor skin employs structured doping of inorganic nanoparticles to enhance the local electric field, coupled with advanced deep learning algorithms, achieving a Δ V /Δ d sensitivity of 14.2, surpassing benchmarks. This enables precise remote control of surveillance systems and robotic manipulators. Our long short-term memory–based adaptive pulse identification achieves 99.56% accuracy in material identification with accelerated processing speeds. In addition, we demonstrate the feasibility of using a two-dimensional (2D) sensor matrix to integrate real object scan data into a convolutional neural network to accurately discriminate the shape and material of 3D objects. This promises transformative advances in human-computer interaction and neuromorphic computing.

Topics & Concepts

Computer scienceConvolutional neural networkNeuromorphic engineeringArtificial intelligenceSensitivity (control systems)PerceptionComputer visionIdentification (biology)Deep learningField (mathematics)Human–computer interactionArtificial neural networkElectronic engineeringEngineeringNeuroscienceMathematicsPure mathematicsBiologyBotanyAdvanced Sensor and Energy Harvesting MaterialsTactile and Sensory InteractionsAdvanced Memory and Neural Computing