Litcius/Paper detail

Multifunctional human visual pathway-replicated hardware based on 2D materials

Zhuiri Peng, Lei Tong, Wenhao Shi, Langlang Xu, Xinyu Huang, Zheng Li, Xiangxiang Yu, Xiaohan Meng, Xiao He, Shengjie Lv, Gaochen Yang, Hao Hao, Tian Jiang, Xiangshui Miao, Lei Ye

2024Nature Communications48 citationsDOIOpen Access PDF

Abstract

Abstract Artificial visual system empowered by 2D materials-based hardware simulates the functionalities of the human visual system, leading the forefront of artificial intelligence vision. However, retina-mimicked hardware that has not yet fully emulated the neural circuits of visual pathways is restricted from realizing more complex and special functions. In this work, we proposed a human visual pathway-replicated hardware that consists of crossbar arrays with split floating gate 2D tungsten diselenide (WSe 2 ) unit devices that simulate the retina and visual cortex, and related connective peripheral circuits that replicate connectomics between the retina and visual cortex. This hardware experimentally displays advanced multi-functions of red–green color-blindness processing, low-power shape recognition, and self-driven motion tracking, promoting the development of machine vision, driverless technology, brain–computer interfaces, and intelligent robotics.

Topics & Concepts

Computer scienceVisual cortexVisual processingRetinaEvolvable hardwareComputer hardwareArtificial intelligenceComputer visionNeuroscienceField-programmable gate arrayBiologyPerceptionAdvanced Memory and Neural ComputingCCD and CMOS Imaging SensorsPhotoreceptor and optogenetics research