IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-54845-3.html
   My bibliography  Save this article

Ultraweak light-modulated heterostructure with bidirectional photoresponse for static and dynamic image perception

Author

Listed:
  • Xun Han

    (The Hong Kong Polytechnic University)

  • Juan Tao

    (Jiashan Fudan Institute
    Chinese Academy of Sciences)

  • Yegang Liang

    (Chinese Academy of Sciences)

  • Feng Guo

    (The Hong Kong Polytechnic University
    The Hong Kong Polytechnic University Shenzhen Research Institute)

  • Zhangsheng Xu

    (Chinese Academy of Sciences)

  • Wenqiang Wu

    (Chinese Academy of Sciences)

  • Jiahui Tong

    (Jiashan Fudan Institute)

  • Mengxiao Chen

    (Zhejiang University)

  • Caofeng Pan

    (Beihang University)

  • Jianhua Hao

    (The Hong Kong Polytechnic University
    The Hong Kong Polytechnic University Shenzhen Research Institute)

Abstract

The human visual system’s adaptability to varying brightness levels has inspired the development of optoelectronic neuromorphic devices. However, achieving bidirectional photoresponse, essential for mimicking these functions, often requires high operation voltages or high light intensities. Here, we propose a bidirectional ZnO/CsPbBr3 heterostructure based neuromorphic image sensor array (10 × 10 pixels) capable of ultraweak light stimulation. The device demonstrates positive and negative photoconductivity through the ionization and deionization of oxygen vacancies in the ZnO channel, extendable to other ZnO/perovskites and IGZO/perovskites heterostructures. Operating at a reduced bias voltage of 2.0 V, the array achieves synaptic weight updates under green (525 nm) and UV (365 nm) light with light intensities ranging from as low as 45 nW/cm² to 15.69 mW/cm², mimicking basic synaptic functions and visual adaptation. It performs multiple image pre-processing tasks, including background denoising and encoding spatiotemporal motion, achieving 92% accuracy in pattern recognition and 100% accuracy in motion clustering. This straightforward strategy highlights a potential for intelligent visual systems capable of real-time image processing under low voltage and dark conditions.

Suggested Citation

  • Xun Han & Juan Tao & Yegang Liang & Feng Guo & Zhangsheng Xu & Wenqiang Wu & Jiahui Tong & Mengxiao Chen & Caofeng Pan & Jianhua Hao, 2024. "Ultraweak light-modulated heterostructure with bidirectional photoresponse for static and dynamic image perception," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54845-3
    DOI: 10.1038/s41467-024-54845-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-54845-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-54845-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    2. Xingchen Pang & Yang Wang & Yuyan Zhu & Zhenhan Zhang & Du Xiang & Xun Ge & Haoqi Wu & Yongbo Jiang & Zizheng Liu & Xiaoxian Liu & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile rippled-assisted optoelectronic array for all-day motion detection and recognition," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    3. Yang Chai, 2020. "In-sensor computing for machine vision," Nature, Nature, vol. 579(7797), pages 32-33, March.
    4. Leilei Gu & Swapnadeep Poddar & Yuanjing Lin & Zhenghao Long & Daquan Zhang & Qianpeng Zhang & Lei Shu & Xiao Qiu & Matthew Kam & Ali Javey & Zhiyong Fan, 2020. "A biomimetic eye with a hemispherical perovskite nanowire array retina," Nature, Nature, vol. 581(7808), pages 278-282, May.
    5. Guangdong Zhou & Jie Li & Qunliang Song & Lidan Wang & Zhijun Ren & Bai Sun & Xiaofang Hu & Wenhua Wang & Gaobo Xu & Xiaodie Chen & Lan Cheng & Feichi Zhou & Shukai Duan, 2023. "Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tao Guo & Shasha Li & Y. Norman Zhou & Wei D. Lu & Yong Yan & Yimin A. Wu, 2024. "Interspecies-chimera machine vision with polarimetry for real-time navigation and anti-glare pattern recognition," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    2. Pengshan Xie & Yunchao Xu & Jingwen Wang & Dengji Li & Yuxuan Zhang & Zixin Zeng & Boxiang Gao & Quan Quan & Bowen Li & You Meng & Weijun Wang & Yezhan Li & Yan Yan & Yi Shen & Jia Sun & Johnny C. Ho, 2024. "Birdlike broadband neuromorphic visual sensor arrays for fusion imaging," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Xiaopeng Feng & Chenglong Li & Jinmei Song & Yuhong He & Wei Qu & Weijun Li & Keke Guo & Lulu Liu & Bai Yang & Haotong Wei, 2024. "Differential perovskite hemispherical photodetector for intelligent imaging and location tracking," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    4. Guangdong Zhou & Jie Li & Qunliang Song & Lidan Wang & Zhijun Ren & Bai Sun & Xiaofang Hu & Wenhua Wang & Gaobo Xu & Xiaodie Chen & Lan Cheng & Feichi Zhou & Shukai Duan, 2023. "Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    5. Boyuan Cui & Zhen Fan & Wenjie Li & Yihong Chen & Shuai Dong & Zhengwei Tan & Shengliang Cheng & Bobo Tian & Ruiqiang Tao & Guo Tian & Deyang Chen & Zhipeng Hou & Minghui Qin & Min Zeng & Xubing Lu & , 2022. "Ferroelectric photosensor network: an advanced hardware solution to real-time machine vision," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    6. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    7. Changsoon Choi & Henry Hinton & Hyojin Seung & Sehui Chang & Ji Su Kim & Woosang You & Min Sung Kim & Jung Pyo Hong & Jung Ah Lim & Do Kyung Hwang & Gil Ju Lee & Houk Jang & Young Min Song & Dae-Hyeon, 2024. "Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    8. Seok Daniel Namgung & Ryeong Myeong Kim & Yae-Chan Lim & Jong Woo Lee & Nam Heon Cho & Hyeohn Kim & Jin-Suk Huh & Hanju Rhee & Sanghee Nah & Min-Kyu Song & Jang-Yeon Kwon & Ki Tae Nam, 2022. "Circularly polarized light-sensitive, hot electron transistor with chiral plasmonic nanoparticles," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    9. Yuyan Zhu & Yang Wang & Xingchen Pang & Yongbo Jiang & Xiaoxian Liu & Qing Li & Zhen Wang & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile 2D MoS2/black phosphorus heterojunction photodiodes in the near- to mid-infrared region," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    10. Bo Dai & Liang Zhang & Chenglong Zhao & Hunter Bachman & Ryan Becker & John Mai & Ziao Jiao & Wei Li & Lulu Zheng & Xinjun Wan & Tony Jun Huang & Songlin Zhuang & Dawei Zhang, 2021. "Biomimetic apposition compound eye fabricated using microfluidic-assisted 3D printing," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    11. Zhenghao Long & Xiao Qiu & Chak Lam Jonathan Chan & Zhibo Sun & Zhengnan Yuan & Swapnadeep Poddar & Yuting Zhang & Yucheng Ding & Leilei Gu & Yu Zhou & Wenying Tang & Abhishek Kumar Srivastava & Cunji, 2023. "A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    12. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    13. Rui Xu & Zhiqiang Zeng & Yong Lei, 2022. "Well-defined nanostructuring with designable anodic aluminum oxide template," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    14. Yao Ni & Jiaqi Liu & Hong Han & Qianbo Yu & Lu Yang & Zhipeng Xu & Chengpeng Jiang & Lu Liu & Wentao Xu, 2024. "Visualized in-sensor computing," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    15. Lei Tong & Yali Bi & Yilun Wang & Kai Peng & Xinyu Huang & Wei Ju & Zhuiri Peng & Zheng Li & Langlang Xu & Runfeng Lin & Xiangxiang Yu & Wenhao Shi & Hui Yu & Huajun Sun & Kanhao Xue & Qiang He & Ming, 2024. "Programmable nonlinear optical neuromorphic computing with bare 2D material MoS2," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    16. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    17. Ming Deng & Ziqing Li & Shiyuan Liu & Xiaosheng Fang & Limin Wu, 2024. "Wafer-scale integration of two-dimensional perovskite oxides towards motion recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    18. You Meng & Xiaocui Li & Xiaolin Kang & Wanpeng Li & Wei Wang & Zhengxun Lai & Weijun Wang & Quan Quan & Xiuming Bu & SenPo Yip & Pengshan Xie & Dong Chen & Dengji Li & Fei Wang & Chi-Fung Yeung & Chan, 2023. "Van der Waals nanomesh electronics on arbitrary surfaces," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    19. Junxiong Guo & Shuyi Gu & Lin Lin & Yu Liu & Ji Cai & Hongyi Cai & Yu Tian & Yuelin Zhang & Qinghua Zhang & Ze Liu & Yafei Zhang & Xiaosheng Zhang & Yuan Lin & Wen Huang & Lin Gu & Jinxing Zhang, 2024. "Type-printable photodetector arrays for multichannel meta-infrared imaging," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    20. Ling Li & Shasha Li & Wenhai Wang & Jielian Zhang & Yiming Sun & Qunrui Deng & Tao Zheng & Jianting Lu & Wei Gao & Mengmeng Yang & Hanyu Wang & Yuan Pan & Xueting Liu & Yani Yang & Jingbo Li & Nengjie, 2024. "Adaptative machine vision with microsecond-level accurate perception beyond human retina," Nature Communications, Nature, vol. 15(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54845-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.