IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46387-5.html
   My bibliography  Save this article

Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array

Author

Listed:
  • Dehui Zhang

    (University of California)

  • Dong Xu

    (University of California)

  • Yuhang Li

    (University of California)

  • Yi Luo

    (University of California)

  • Jingtian Hu

    (University of California)

  • Jingxuan Zhou

    (University of California)

  • Yucheng Zhang

    (University of California)

  • Boxuan Zhou

    (University of California)

  • Peiqi Wang

    (University of California)

  • Xurong Li

    (University of California)

  • Bijie Bai

    (University of California)

  • Huaying Ren

    (University of California)

  • Laiyuan Wang

    (University of California)

  • Ao Zhang

    (University of California)

  • Mona Jarrahi

    (University of California
    University of California)

  • Yu Huang

    (University of California
    University of California)

  • Aydogan Ozcan

    (University of California
    University of California)

  • Xiangfeng Duan

    (University of California
    University of California)

Abstract

Nonlinear optical processing of ambient natural light is highly desired for computational imaging and sensing. Strong optical nonlinear response under weak broadband incoherent light is essential for this purpose. By merging 2D transparent phototransistors (TPTs) with liquid crystal (LC) modulators, we create an optoelectronic neuron array that allows self-amplitude modulation of spatially incoherent light, achieving a large nonlinear contrast over a broad spectrum at orders-of-magnitude lower intensity than achievable in most optical nonlinear materials. We fabricated a 10,000-pixel array of optoelectronic neurons, and experimentally demonstrated an intelligent imaging system that instantly attenuates intense glares while retaining the weaker-intensity objects captured by a cellphone camera. This intelligent glare-reduction is important for various imaging applications, including autonomous driving, machine vision, and security cameras. The rapid nonlinear processing of incoherent broadband light might also find applications in optical computing, where nonlinear activation functions for ambient light conditions are highly sought.

Suggested Citation

  • Dehui Zhang & Dong Xu & Yuhang Li & Yi Luo & Jingtian Hu & Jingxuan Zhou & Yucheng Zhang & Boxuan Zhou & Peiqi Wang & Xurong Li & Bijie Bai & Huaying Ren & Laiyuan Wang & Ao Zhang & Mona Jarrahi & Yu , 2024. "Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5
    DOI: 10.1038/s41467-024-46387-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46387-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46387-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhaoyang Lin & Yuan Liu & Udayabagya Halim & Mengning Ding & Yuanyue Liu & Yiliu Wang & Chuancheng Jia & Peng Chen & Xidong Duan & Chen Wang & Frank Song & Mufan Li & Chengzhang Wan & Yu Huang & Xiang, 2018. "Solution-processable 2D semiconductors for high-performance large-area electronics," Nature, Nature, vol. 562(7726), pages 254-258, October.
    2. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    3. Dehui Zhang & Zhen Xu & Zhengyu Huang & Audrey Rose Gutierrez & Cameron J. Blocker & Che-Hung Liu & Miao-Bin Lien & Gong Cheng & Zhe Liu & Il Yong Chun & Jeffrey A. Fessler & Zhaohui Zhong & Theodore , 2021. "Neural network based 3D tracking with a graphene transparent focal stack imaging system," Nature Communications, Nature, vol. 12(1), pages 1-7, December.
    4. Zhuochao Wang & Guangwei Hu & Xinwei Wang & Xumin Ding & Kuang Zhang & Haoyu Li & Shah Nawaz Burokur & Qun Wu & Jian Liu & Jiubin Tan & Cheng-Wei Qiu, 2022. "Single-layer spatial analog meta-processor for imaging processing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuyan Zhu & Yang Wang & Xingchen Pang & Yongbo Jiang & Xiaoxian Liu & Qing Li & Zhen Wang & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile 2D MoS2/black phosphorus heterojunction photodiodes in the near- to mid-infrared region," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    2. Ao Liu & Huihui Zhu & Taoyu Zou & Youjin Reo & Gi-Seong Ryu & Yong-Young Noh, 2022. "Evaporated nanometer chalcogenide films for scalable high-performance complementary electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    3. Xun Han & Juan Tao & Yegang Liang & Feng Guo & Zhangsheng Xu & Wenqiang Wu & Jiahui Tong & Mengxiao Chen & Caofeng Pan & Jianhua Hao, 2024. "Ultraweak light-modulated heterostructure with bidirectional photoresponse for static and dynamic image perception," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    4. Dehui Zhang & Zhen Xu & Gong Cheng & Zhe Liu & Audrey Rose Gutierrez & Wenzhe Zang & Theodore B. Norris & Zhaohui Zhong, 2022. "Strongly enhanced THz generation enabled by a graphene hot-carrier fast lane," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    5. Zhixin Yao & Huifeng Tian & U. Sasaki & Huacong Sun & Jingyi Hu & Guodong Xue & Ye Seul Jung & Ruijie Li & Zhenjiang Li & PeiChi Liao & Yihan Wang & Lina Yang Zhang & Ge Yin & Xuanyu Zhang & Yijie Luo, 2025. "Transferrable, wet-chemistry-derived high-k amorphous metal oxide dielectrics for two-dimensional electronic devices," Nature Communications, Nature, vol. 16(1), pages 1-11, December.
    6. Yongxi Ou & Wilson Yanez & Run Xiao & Max Stanley & Supriya Ghosh & Boyang Zheng & Wei Jiang & Yu-Sheng Huang & Timothy Pillsbury & Anthony Richardella & Chaoxing Liu & Tony Low & Vincent H. Crespi & , 2022. "ZrTe2/CrTe2: an epitaxial van der Waals platform for spintronics," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    7. Yurou Jia & Suying Zhang & Xuan Zhang & Houyou Long & Caibin Xu & Yechao Bai & Ying Cheng & Dajian Wu & Mingxi Deng & Cheng-Wei Qiu & Xiaojun Liu, 2024. "Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    8. Lei Tong & Yali Bi & Yilun Wang & Kai Peng & Xinyu Huang & Wei Ju & Zhuiri Peng & Zheng Li & Langlang Xu & Runfeng Lin & Xiangxiang Yu & Wenhao Shi & Hui Yu & Huajun Sun & Kanhao Xue & Qiang He & Ming, 2024. "Programmable nonlinear optical neuromorphic computing with bare 2D material MoS2," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    9. Ge Li & Donggang Xie & Qinghua Zhang & Mingzhen Zhang & Zhuohui Liu & Zheng Wang & Jiahui Xie & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2025. "Interface-engineered non-volatile visible-blind photodetector for in-sensor computing," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    10. Xinyu Chen & Yufeng Xie & Yaochen Sheng & Hongwei Tang & Zeming Wang & Yu Wang & Yin Wang & Fuyou Liao & Jingyi Ma & Xiaojiao Guo & Ling Tong & Hanqi Liu & Hao Liu & Tianxiang Wu & Jiaxin Cao & Sitong, 2021. "Wafer-scale functional circuits based on two dimensional semiconductors with fabrication optimized by machine learning," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    11. Xingchen Pang & Yang Wang & Yuyan Zhu & Zhenhan Zhang & Du Xiang & Xun Ge & Haoqi Wu & Yongbo Jiang & Zizheng Liu & Xiaoxian Liu & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile rippled-assisted optoelectronic array for all-day motion detection and recognition," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    12. Bo Tong & Jiajun Xu & Jinhong Du & Peitao Liu & Tianming Du & Qiang Wang & Langjun Li & Yuning Wei & Jiangxu Li & Jinhua Liang & Chi Liu & Zhibo Liu & Chen Li & Lai-Peng Ma & Yang Chai & Wencai Ren, 2025. "2D (NH4)BiI3 enables non-volatile optoelectronic memories for machine learning," Nature Communications, Nature, vol. 16(1), pages 1-11, December.
    13. Haihui Lan & Luyang Wang & Runze He & Shuyi Huang & Jinqiu Yu & Jinming Guo & Jingrui Luo & Yiling Li & Jinyang Zhang & Jiaxin Lin & Shunping Zhang & Mengqi Zeng & Lei Fu, 2023. "2D quasi-layered material with domino structure," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    14. Yalin Peng & Chenyang Cui & Lu Li & Yuchen Wang & Qinqin Wang & Jinpeng Tian & Zhiheng Huang & Biying Huang & Yangkun Zhang & Xiuzhen Li & Jian Tang & Yanbang Chu & Wei Yang & Dongxia Shi & Luojun Du , 2024. "Medium-scale flexible integrated circuits based on 2D semiconductors," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    15. Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    16. Yue Gong & Ruihuan Duan & Yi Hu & Yao Wu & Song Zhu & Xingli Wang & Qijie Wang & Shu Ping Lau & Zheng Liu & Beng Kang Tay, 2025. "Reconfigurable and nonvolatile ferroelectric bulk photovoltaics based on 3R-WS2 for machine vision," Nature Communications, Nature, vol. 16(1), pages 1-12, December.
    17. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    18. Hao Jiang & Yinzhu Chen & Wenyu Guo & Yan Zhang & Rigui Zhou & Mile Gu & Fan Zhong & Zhenhua Ni & Junpeng Lu & Cheng-Wei Qiu & Weibo Gao, 2024. "Metasurface-enabled broadband multidimensional photodetectors," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    19. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    20. Changsoon Choi & Henry Hinton & Hyojin Seung & Sehui Chang & Ji Su Kim & Woosang You & Min Sung Kim & Jung Pyo Hong & Jung Ah Lim & Do Kyung Hwang & Gil Ju Lee & Houk Jang & Young Min Song & Dae-Hyeon, 2024. "Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.