IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-55139-4.html
   My bibliography  Save this article

Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

Author

Listed:
  • Alexander Song

    (Max Planck Institute for Medical Research
    Universität Heidelberg)

  • Sai Nikhilesh Murty Kottapalli

    (Max Planck Institute for Medical Research
    Universität Heidelberg)

  • Rahul Goyal

    (Max Planck Institute for Medical Research
    Universität Heidelberg)

  • Bernhard Schölkopf

    (Max Planck Institute for Intelligent Systems
    ELLIS Institute Tübingen)

  • Peer Fischer

    (Max Planck Institute for Medical Research
    Universität Heidelberg
    Institute for Basic Science (IBS)
    Yonsei University)

Abstract

Optical approaches have made great strides towards the goal of high-speed, energy-efficient computing necessary for modern deep learning and AI applications. Read-in and read-out of data, however, limit the overall performance of existing approaches. This study introduces a multilayer optoelectronic computing framework that alternates between optical and optoelectronic layers to implement matrix-vector multiplications and rectified linear functions, respectively. Our framework is designed for real-time, parallelized operations, leveraging 2D arrays of LEDs and photodetectors connected via independent analog electronics. We experimentally demonstrate this approach using a system with a three-layer network with two hidden layers and operate it to recognize images from the MNIST database with a recognition accuracy of 92% and classify classes from a nonlinear spiral data with 86% accuracy. By implementing multiple layers of a deep neural network simultaneously, our approach significantly reduces the number of read-ins and read-outs required and paves the way for scalable optical accelerators requiring ultra low energy.

Suggested Citation

  • Alexander Song & Sai Nikhilesh Murty Kottapalli & Rahul Goyal & Bernhard Schölkopf & Peer Fischer, 2024. "Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-55139-4
    DOI: 10.1038/s41467-024-55139-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-55139-4
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-55139-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Siddharth Buddhiraju & Avik Dutt & Momchil Minkov & Ian A. D. Williamson & Shanhui Fan, 2021. "Arbitrary linear transformations for photons in the frequency synthetic dimension," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    2. J. Feldmann & N. Youngblood & M. Karpov & H. Gehring & X. Li & M. Stappers & M. Gallo & X. Fu & A. Lukashchuk & A. S. Raja & J. Liu & C. D. Wright & A. Sebastian & T. J. Kippenberg & W. H. P. Pernice , 2021. "Publisher Correction: Parallel convolutional processing using an integrated photonic tensor core," Nature, Nature, vol. 591(7849), pages 13-13, March.
    3. Wim Bogaerts & Daniel Pérez & José Capmany & David A. B. Miller & Joyce Poon & Dirk Englund & Francesco Morichetti & Andrea Melloni, 2020. "Programmable photonic circuits," Nature, Nature, vol. 586(7828), pages 207-216, October.
    4. H. Zhang & M. Gu & X. D. Jiang & J. Thompson & H. Cai & S. Paesani & R. Santagati & A. Laing & Y. Zhang & M. H. Yung & Y. Z. Shi & F. K. Muhammad & G. Q. Lo & X. S. Luo & B. Dong & D. L. Kwong & L. C., 2021. "An optical neural chip for implementing complex-valued neural network," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    5. Xingyuan Xu & Mengxi Tan & Bill Corcoran & Jiayang Wu & Andreas Boes & Thach G. Nguyen & Sai T. Chu & Brent E. Little & Damien G. Hicks & Roberto Morandotti & Arnan Mitchell & David J. Moss, 2021. "11 TOPS photonic convolutional accelerator for optical neural networks," Nature, Nature, vol. 589(7840), pages 44-51, January.
    6. Tianyu Wang & Shi-Yuan Ma & Logan G. Wright & Tatsuhiro Onodera & Brian C. Richard & Peter L. McMahon, 2022. "An optical neural network using less than 1 photon per multiplication," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    7. J. Feldmann & N. Youngblood & M. Karpov & H. Gehring & X. Li & M. Stappers & M. Gallo & X. Fu & A. Lukashchuk & A. S. Raja & J. Liu & C. D. Wright & A. Sebastian & T. J. Kippenberg & W. H. P. Pernice , 2021. "Parallel convolutional processing using an integrated photonic tensor core," Nature, Nature, vol. 589(7840), pages 52-58, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han Zhao & Bingzhao Li & Huan Li & Mo Li, 2022. "Enabling scalable optical computing in synthetic frequency dimension using integrated cavity acousto-optics," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    2. Yunping Bai & Yifu Xu & Shifan Chen & Xiaotian Zhu & Shuai Wang & Sirui Huang & Yuhang Song & Yixuan Zheng & Zhihui Liu & Sim Tan & Roberto Morandotti & Sai T. Chu & Brent E. Little & David J. Moss & , 2025. "TOPS-speed complex-valued convolutional accelerator for feature extraction and inference," Nature Communications, Nature, vol. 16(1), pages 1-13, December.
    3. Steven Becker & Dirk Englund & Birgit Stiller, 2024. "An optoacoustic field-programmable perceptron for recurrent neural networks," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    4. Shi-Yuan Ma & Tianyu Wang & Jérémie Laydevant & Logan G. Wright & Peter L. McMahon, 2025. "Quantum-limited stochastic optical neural networks operating at a few quanta per activation," Nature Communications, Nature, vol. 16(1), pages 1-12, December.
    5. Wen Zhou & Bowei Dong & Nikolaos Farmakidis & Xuan Li & Nathan Youngblood & Kairan Huang & Yuhan He & C. David Wright & Wolfram H. P. Pernice & Harish Bhaskaran, 2023. "In-memory photonic dot-product engine with electrically programmable weight banks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    6. H. H. Zhu & J. Zou & H. Zhang & Y. Z. Shi & S. B. Luo & N. Wang & H. Cai & L. X. Wan & B. Wang & X. D. Jiang & J. Thompson & X. S. Luo & X. H. Zhou & L. M. Xiao & W. Huang & L. Patrick & M. Gu & L. C., 2022. "Space-efficient optical computing with an integrated chip diffractive neural network," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    7. Junwei Cheng & Chaoran Huang & Jialong Zhang & Bo Wu & Wenkai Zhang & Xinyu Liu & Jiahui Zhang & Yiyi Tang & Hailong Zhou & Qiming Zhang & Min Gu & Jianji Dong & Xinliang Zhang, 2024. "Multimodal deep learning using on-chip diffractive optics with in situ training capability," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    8. Bowen Bai & Qipeng Yang & Haowen Shu & Lin Chang & Fenghe Yang & Bitao Shen & Zihan Tao & Jing Wang & Shaofu Xu & Weiqiang Xie & Weiwen Zou & Weiwei Hu & John E. Bowers & Xingjun Wang, 2023. "Microcomb-based integrated photonic processing unit," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    9. Xiangyan Meng & Guojie Zhang & Nuannuan Shi & Guangyi Li & José Azaña & José Capmany & Jianping Yao & Yichen Shen & Wei Li & Ninghua Zhu & Ming Li, 2023. "Compact optical convolution processing unit based on multimode interference," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    10. Mitsumasa Nakajima & Katsuma Inoue & Kenji Tanaka & Yasuo Kuniyoshi & Toshikazu Hashimoto & Kohei Nakajima, 2022. "Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    11. Miltiadis Moralis-Pegios & George Giamougiannis & Apostolos Tsakyridis & David Lazovsky & Nikos Pleros, 2024. "Perfect linear optics using silicon photonics," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    12. Guangwei Cong & Noritsugu Yamamoto & Takashi Inoue & Yuriko Maegami & Morifumi Ohno & Shota Kita & Shu Namiki & Koji Yamada, 2022. "On-chip bacterial foraging training in silicon photonic circuits for projection-enabled nonlinear classification," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    13. Zhongjin Lin & Bhavin J. Shastri & Shangxuan Yu & Jingxiang Song & Yuntao Zhu & Arman Safarnejadian & Wangning Cai & Yanmei Lin & Wei Ke & Mustafa Hammood & Tianye Wang & Mengyue Xu & Zibo Zheng & Moh, 2024. "120 GOPS Photonic tensor core in thin-film lithium niobate for inference and in situ training," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    14. Ziyu Zhan & Hao Wang & Qiang Liu & Xing Fu, 2024. "Photonic diffractive generators through sampling noises from scattering media," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    15. G. Mourgias-Alexandris & M. Moralis-Pegios & A. Tsakyridis & S. Simos & G. Dabos & A. Totovic & N. Passalis & M. Kirtas & T. Rutirawut & F. Y. Gardes & A. Tefas & N. Pleros, 2022. "Noise-resilient and high-speed deep learning with coherent silicon photonics," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    16. Shihan Hong & Jiachen Wu & Yiwei Xie & Xiyuan Ke & Huan Li & Linyan Lyv & Yingying Peng & Qingrui Yao & Yaocheng Shi & Ke Wang & Leimeng Zhuang & Pan Wang & Daoxin Dai, 2025. "Versatile parallel signal processing with a scalable silicon photonic chip," Nature Communications, Nature, vol. 16(1), pages 1-13, December.
    17. Ali Najjar Amiri & Aycan Deniz Vit & Kazim Gorgulu & Emir Salih Magden, 2024. "Deep photonic network platform enabling arbitrary and broadband optical functionality," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    18. Chen-Guang Wang & Wuyue Xu & Chong Li & Lili Shi & Junliang Jiang & Tingting Guo & Wen-Cheng Yue & Tianyu Li & Ping Zhang & Yang-Yang Lyu & Jiazheng Pan & Xiuhao Deng & Ying Dong & Xuecou Tu & Sining , 2024. "Integrated and DC-powered superconducting microcomb," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    19. Wenting Wang & Ping-Keng Lu & Abhinav Kumar Vinod & Deniz Turan & James F. McMillan & Hao Liu & Mingbin Yu & Dim-Lee Kwong & Mona Jarrahi & Chee Wei Wong, 2022. "Coherent terahertz radiation with 2.8-octave tunability through chip-scale photomixed microresonator optical parametric oscillation," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    20. Dongliang Wang & Yikun Nie & Gaolei Hu & Hon Ki Tsang & Chaoran Huang, 2024. "Ultrafast silicon photonic reservoir computing engine delivering over 200 TOPS," Nature Communications, Nature, vol. 15(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-55139-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.