IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-52982-3.html
   My bibliography  Save this article

Multifunctional human visual pathway-replicated hardware based on 2D materials

Author

Listed:
  • Zhuiri Peng

    (Huazhong University of Science and Technology)

  • Lei Tong

    (The Chinese University of Hong Kong)

  • Wenhao Shi

    (Huazhong University of Science and Technology)

  • Langlang Xu

    (Huazhong University of Science and Technology)

  • Xinyu Huang

    (Huazhong University of Science and Technology)

  • Zheng Li

    (Huazhong University of Science and Technology)

  • Xiangxiang Yu

    (Huazhong University of Science and Technology)

  • Xiaohan Meng

    (Huazhong University of Science and Technology)

  • Xiao He

    (Huazhong University of Science and Technology)

  • Shengjie Lv

    (Huazhong University of Science and Technology)

  • Gaochen Yang

    (Huazhong University of Science and Technology)

  • Hao Hao

    (National University of Defense Technology)

  • Tian Jiang

    (National University of Defense Technology)

  • Xiangshui Miao

    (Huazhong University of Science and Technology
    Hubei Yangtze Memory Laboratories)

  • Lei Ye

    (Huazhong University of Science and Technology
    Hubei Yangtze Memory Laboratories)

Abstract

Artificial visual system empowered by 2D materials-based hardware simulates the functionalities of the human visual system, leading the forefront of artificial intelligence vision. However, retina-mimicked hardware that has not yet fully emulated the neural circuits of visual pathways is restricted from realizing more complex and special functions. In this work, we proposed a human visual pathway-replicated hardware that consists of crossbar arrays with split floating gate 2D tungsten diselenide (WSe2) unit devices that simulate the retina and visual cortex, and related connective peripheral circuits that replicate connectomics between the retina and visual cortex. This hardware experimentally displays advanced multi-functions of red–green color-blindness processing, low-power shape recognition, and self-driven motion tracking, promoting the development of machine vision, driverless technology, brain–computer interfaces, and intelligent robotics.

Suggested Citation

  • Zhuiri Peng & Lei Tong & Wenhao Shi & Langlang Xu & Xinyu Huang & Zheng Li & Xiangxiang Yu & Xiaohan Meng & Xiao He & Shengjie Lv & Gaochen Yang & Hao Hao & Tian Jiang & Xiangshui Miao & Lei Ye, 2024. "Multifunctional human visual pathway-replicated hardware based on 2D materials," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52982-3
    DOI: 10.1038/s41467-024-52982-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-52982-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-52982-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xu Luo & Chen Chen & Zixi He & Min Wang & Keyuan Pan & Xuemei Dong & Zifan Li & Bin Liu & Zicheng Zhang & Yueyue Wu & Chaoyi Ban & Rong Chen & Dengfeng Zhang & Kaili Wang & Qiye Wang & Junyue Li & Gan, 2024. "A bionic self-driven retinomorphic eye with ionogel photosynaptic retina," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    2. Seokhyeong Lee & Ruoming Peng & Changming Wu & Mo Li, 2022. "Programmable black phosphorus image sensor for broadband optoelectronic edge computing," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    3. Changsoon Choi & Juyoung Leem & Minsung Kim & Amir Taqieddin & Chullhee Cho & Kyoung Won Cho & Gil Ju Lee & Hyojin Seung & Hyung Jong Bae & Young Min Song & Taeghwan Hyeon & Narayana R. Aluru & SungWo, 2020. "Curved neuromorphic image sensor array using a MoS2-organic heterostructure inspired by the human visual recognition system," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    4. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    5. Guilherme Migliato Marega & Yanfei Zhao & Ahmet Avsar & Zhenyu Wang & Mukesh Tripathi & Aleksandra Radenovic & Andras Kis, 2020. "Logic-in-memory based on an atomically thin semiconductor," Nature, Nature, vol. 587(7832), pages 72-77, November.
    6. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    7. Huayu Ding & Robert G. Smith & Alon Poleg-Polsky & Jeffrey S. Diamond & Kevin L. Briggman, 2016. "Species-specific wiring for direction selectivity in the mammalian retina," Nature, Nature, vol. 535(7610), pages 105-110, July.
    8. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    9. Anthony D. Lien & Massimo Scanziani, 2018. "Cortical direction selectivity emerges at convergence of thalamic synapses," Nature, Nature, vol. 558(7708), pages 80-86, June.
    10. Sarah Strauss & Maria M. Korympidou & Yanli Ran & Katrin Franke & Timm Schubert & Tom Baden & Philipp Berens & Thomas Euler & Anna L. Vlasits, 2022. "Center-surround interactions underlie bipolar cell motion sensitivity in the mouse retina," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    11. Fakun Wang & Fangchen Hu & Mingjin Dai & Song Zhu & Fangyuan Sun & Ruihuan Duan & Chongwu Wang & Jiayue Han & Wenjie Deng & Wenduo Chen & Ming Ye & Song Han & Bo Qiang & Yuhao Jin & Yunda Chua & Nan C, 2023. "A two-dimensional mid-infrared optoelectronic retina enabling simultaneous perception and encoding," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    12. Maximilian Joesch & Markus Meister, 2016. "A neuronal circuit for colour vision based on rod–cone opponency," Nature, Nature, vol. 532(7598), pages 236-239, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuyan Zhu & Yang Wang & Xingchen Pang & Yongbo Jiang & Xiaoxian Liu & Qing Li & Zhen Wang & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile 2D MoS2/black phosphorus heterojunction photodiodes in the near- to mid-infrared region," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    2. Ming Deng & Ziqing Li & Shiyuan Liu & Xiaosheng Fang & Limin Wu, 2024. "Wafer-scale integration of two-dimensional perovskite oxides towards motion recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    3. Guangdong Zhou & Jie Li & Qunliang Song & Lidan Wang & Zhijun Ren & Bai Sun & Xiaofang Hu & Wenhua Wang & Gaobo Xu & Xiaodie Chen & Lan Cheng & Feichi Zhou & Shukai Duan, 2023. "Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    4. John A. Gaynes & Samuel A. Budoff & Michael J. Grybko & Joshua B. Hunt & Alon Poleg-Polsky, 2022. "Classical center-surround receptive fields facilitate novel object detection in retinal bipolar cells," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    5. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    6. Ling Li & Shasha Li & Wenhai Wang & Jielian Zhang & Yiming Sun & Qunrui Deng & Tao Zheng & Jianting Lu & Wei Gao & Mengmeng Yang & Hanyu Wang & Yuan Pan & Xueting Liu & Yani Yang & Jingbo Li & Nengjie, 2024. "Adaptative machine vision with microsecond-level accurate perception beyond human retina," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    7. Rong Bao & Shuiyuan Wang & Xiaoxian Liu & Kejun Tu & Jingquan Liu & Xiaohe Huang & Chunsen Liu & Peng Zhou & Shen Liu, 2024. "Neuromorphic electro-stimulation based on atomically thin semiconductor for damage-free inflammation inhibition," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    8. Xinyu Chen & Yufeng Xie & Yaochen Sheng & Hongwei Tang & Zeming Wang & Yu Wang & Yin Wang & Fuyou Liao & Jingyi Ma & Xiaojiao Guo & Ling Tong & Hanqi Liu & Hao Liu & Tianxiang Wu & Jiaxin Cao & Sitong, 2021. "Wafer-scale functional circuits based on two dimensional semiconductors with fabrication optimized by machine learning," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    9. David Swygart & Wan-Qing Yu & Shunsuke Takeuchi & Rachel O. L. Wong & Gregory W. Schwartz, 2024. "A presynaptic source drives differing levels of surround suppression in two mouse retinal ganglion cell types," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    10. Héctor Acarón Ledesma & Jennifer Ding & Swen Oosterboer & Xiaolin Huang & Qiang Chen & Sui Wang & Michael Z. Lin & Wei Wei, 2024. "Dendritic mGluR2 and perisomatic Kv3 signaling regulate dendritic computation of mouse starburst amacrine cells," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    11. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    12. Hao Jiang & Yinzhu Chen & Wenyu Guo & Yan Zhang & Rigui Zhou & Mile Gu & Fan Zhong & Zhenhua Ni & Junpeng Lu & Cheng-Wei Qiu & Weibo Gao, 2024. "Metasurface-enabled broadband multidimensional photodetectors," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    13. Dohyun Kwak & Dmitry K. Polyushkin & Thomas Mueller, 2023. "In-sensor computing using a MoS2 photodetector with programmable spectral responsivity," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    14. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    15. Changsoon Choi & Henry Hinton & Hyojin Seung & Sehui Chang & Ji Su Kim & Woosang You & Min Sung Kim & Jung Pyo Hong & Jung Ah Lim & Do Kyung Hwang & Gil Ju Lee & Houk Jang & Young Min Song & Dae-Hyeon, 2024. "Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    16. Tao Guo & Shasha Li & Y. Norman Zhou & Wei D. Lu & Yong Yan & Yimin A. Wu, 2024. "Interspecies-chimera machine vision with polarimetry for real-time navigation and anti-glare pattern recognition," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    17. Zhenghao Long & Xiao Qiu & Chak Lam Jonathan Chan & Zhibo Sun & Zhengnan Yuan & Swapnadeep Poddar & Yuting Zhang & Yucheng Ding & Leilei Gu & Yu Zhou & Wenying Tang & Abhishek Kumar Srivastava & Cunji, 2023. "A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    18. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    19. Jen-Chun Hsiang & Ning Shen & Florentina Soto & Daniel Kerschensteiner, 2024. "Distributed feature representations of natural stimuli across parallel retinal pathways," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    20. Lu Li & Qinqin Wang & Fanfan Wu & Qiaoling Xu & Jinpeng Tian & Zhiheng Huang & Qinghe Wang & Xuan Zhao & Qinghua Zhang & Qinkai Fan & Xiuzhen Li & Yalin Peng & Yangkun Zhang & Kunshan Ji & Aomiao Zhi , 2024. "Epitaxy of wafer-scale single-crystal MoS2 monolayer via buffer layer control," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52982-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.