IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46387-5.html
   My bibliography  Save this article

Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array

Author

Listed:
  • Dehui Zhang

    (University of California)

  • Dong Xu

    (University of California)

  • Yuhang Li

    (University of California)

  • Yi Luo

    (University of California)

  • Jingtian Hu

    (University of California)

  • Jingxuan Zhou

    (University of California)

  • Yucheng Zhang

    (University of California)

  • Boxuan Zhou

    (University of California)

  • Peiqi Wang

    (University of California)

  • Xurong Li

    (University of California)

  • Bijie Bai

    (University of California)

  • Huaying Ren

    (University of California)

  • Laiyuan Wang

    (University of California)

  • Ao Zhang

    (University of California)

  • Mona Jarrahi

    (University of California
    University of California)

  • Yu Huang

    (University of California
    University of California)

  • Aydogan Ozcan

    (University of California
    University of California)

  • Xiangfeng Duan

    (University of California
    University of California)

Abstract

Nonlinear optical processing of ambient natural light is highly desired for computational imaging and sensing. Strong optical nonlinear response under weak broadband incoherent light is essential for this purpose. By merging 2D transparent phototransistors (TPTs) with liquid crystal (LC) modulators, we create an optoelectronic neuron array that allows self-amplitude modulation of spatially incoherent light, achieving a large nonlinear contrast over a broad spectrum at orders-of-magnitude lower intensity than achievable in most optical nonlinear materials. We fabricated a 10,000-pixel array of optoelectronic neurons, and experimentally demonstrated an intelligent imaging system that instantly attenuates intense glares while retaining the weaker-intensity objects captured by a cellphone camera. This intelligent glare-reduction is important for various imaging applications, including autonomous driving, machine vision, and security cameras. The rapid nonlinear processing of incoherent broadband light might also find applications in optical computing, where nonlinear activation functions for ambient light conditions are highly sought.

Suggested Citation

  • Dehui Zhang & Dong Xu & Yuhang Li & Yi Luo & Jingtian Hu & Jingxuan Zhou & Yucheng Zhang & Boxuan Zhou & Peiqi Wang & Xurong Li & Bijie Bai & Huaying Ren & Laiyuan Wang & Ao Zhang & Mona Jarrahi & Yu , 2024. "Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5
    DOI: 10.1038/s41467-024-46387-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46387-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46387-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhaoyang Lin & Yuan Liu & Udayabagya Halim & Mengning Ding & Yuanyue Liu & Yiliu Wang & Chuancheng Jia & Peng Chen & Xidong Duan & Chen Wang & Frank Song & Mufan Li & Chengzhang Wan & Yu Huang & Xiang, 2018. "Solution-processable 2D semiconductors for high-performance large-area electronics," Nature, Nature, vol. 562(7726), pages 254-258, October.
    2. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    3. Dehui Zhang & Zhen Xu & Zhengyu Huang & Audrey Rose Gutierrez & Cameron J. Blocker & Che-Hung Liu & Miao-Bin Lien & Gong Cheng & Zhe Liu & Il Yong Chun & Jeffrey A. Fessler & Zhaohui Zhong & Theodore , 2021. "Neural network based 3D tracking with a graphene transparent focal stack imaging system," Nature Communications, Nature, vol. 12(1), pages 1-7, December.
    4. Zhuochao Wang & Guangwei Hu & Xinwei Wang & Xumin Ding & Kuang Zhang & Haoyu Li & Shah Nawaz Burokur & Qun Wu & Jian Liu & Jiubin Tan & Cheng-Wei Qiu, 2022. "Single-layer spatial analog meta-processor for imaging processing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuyan Zhu & Yang Wang & Xingchen Pang & Yongbo Jiang & Xiaoxian Liu & Qing Li & Zhen Wang & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile 2D MoS2/black phosphorus heterojunction photodiodes in the near- to mid-infrared region," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    2. Ao Liu & Huihui Zhu & Taoyu Zou & Youjin Reo & Gi-Seong Ryu & Yong-Young Noh, 2022. "Evaporated nanometer chalcogenide films for scalable high-performance complementary electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    3. Dehui Zhang & Zhen Xu & Gong Cheng & Zhe Liu & Audrey Rose Gutierrez & Wenzhe Zang & Theodore B. Norris & Zhaohui Zhong, 2022. "Strongly enhanced THz generation enabled by a graphene hot-carrier fast lane," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    4. Yongxi Ou & Wilson Yanez & Run Xiao & Max Stanley & Supriya Ghosh & Boyang Zheng & Wei Jiang & Yu-Sheng Huang & Timothy Pillsbury & Anthony Richardella & Chaoxing Liu & Tony Low & Vincent H. Crespi & , 2022. "ZrTe2/CrTe2: an epitaxial van der Waals platform for spintronics," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    5. Yurou Jia & Suying Zhang & Xuan Zhang & Houyou Long & Caibin Xu & Yechao Bai & Ying Cheng & Dajian Wu & Mingxi Deng & Cheng-Wei Qiu & Xiaojun Liu, 2024. "Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    6. Xinyu Chen & Yufeng Xie & Yaochen Sheng & Hongwei Tang & Zeming Wang & Yu Wang & Yin Wang & Fuyou Liao & Jingyi Ma & Xiaojiao Guo & Ling Tong & Hanqi Liu & Hao Liu & Tianxiang Wu & Jiaxin Cao & Sitong, 2021. "Wafer-scale functional circuits based on two dimensional semiconductors with fabrication optimized by machine learning," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    7. Xingchen Pang & Yang Wang & Yuyan Zhu & Zhenhan Zhang & Du Xiang & Xun Ge & Haoqi Wu & Yongbo Jiang & Zizheng Liu & Xiaoxian Liu & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile rippled-assisted optoelectronic array for all-day motion detection and recognition," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    8. Haihui Lan & Luyang Wang & Runze He & Shuyi Huang & Jinqiu Yu & Jinming Guo & Jingrui Luo & Yiling Li & Jinyang Zhang & Jiaxin Lin & Shunping Zhang & Mengqi Zeng & Lei Fu, 2023. "2D quasi-layered material with domino structure," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    9. Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    10. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    11. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    12. Changsoon Choi & Henry Hinton & Hyojin Seung & Sehui Chang & Ji Su Kim & Woosang You & Min Sung Kim & Jung Pyo Hong & Jung Ah Lim & Do Kyung Hwang & Gil Ju Lee & Houk Jang & Young Min Song & Dae-Hyeon, 2024. "Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    13. Cian Gabbett & Adam G. Kelly & Emmet Coleman & Luke Doolan & Tian Carey & Kevin Synnatschke & Shixin Liu & Anthony Dawson & Domhnall O’Suilleabhain & Jose Munuera & Eoin Caffrey & John B. Boland & Zde, 2024. "Understanding how junction resistances impact the conduction mechanism in nano-networks," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    14. Robert Tseng & Sung-Tsun Wang & Tanveer Ahmed & Yi-Yu Pan & Shih-Chieh Chen & Che-Chi Shih & Wu-Wei Tsai & Hai-Ching Chen & Chi-Chung Kei & Tsung-Te Chou & Wen-Ching Hung & Jyh-Chen Chen & Yi-Hou Kuo , 2023. "Wide-range and area-selective threshold voltage tunability in ultrathin indium oxide transistors," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    15. Tao Guo & Shasha Li & Y. Norman Zhou & Wei D. Lu & Yong Yan & Yimin A. Wu, 2024. "Interspecies-chimera machine vision with polarimetry for real-time navigation and anti-glare pattern recognition," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    16. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    17. Cian Gabbett & Luke Doolan & Kevin Synnatschke & Laura Gambini & Emmet Coleman & Adam G. Kelly & Shixin Liu & Eoin Caffrey & Jose Munuera & Catriona Murphy & Stefano Sanvito & Lewys Jones & Jonathan N, 2024. "Quantitative analysis of printed nanostructured networks using high-resolution 3D FIB-SEM nanotomography," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    18. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    19. Shengqi Wang & Wenjie Li & Junying Xue & Jifeng Ge & Jing He & Junyang Hou & Yu Xie & Yuan Li & Hao Zhang & Zdeněk Sofer & Zhaoyang Lin, 2024. "A library of 2D electronic material inks synthesized by liquid-metal-assisted intercalation of crystal powders," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    20. Junxiong Guo & Shuyi Gu & Lin Lin & Yu Liu & Ji Cai & Hongyi Cai & Yu Tian & Yuelin Zhang & Qinghua Zhang & Ze Liu & Yafei Zhang & Xiaosheng Zhang & Yuan Lin & Wen Huang & Lin Gu & Jinxing Zhang, 2024. "Type-printable photodetector arrays for multichannel meta-infrared imaging," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.