IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-47053-6.html
   My bibliography  Save this article

An optoacoustic field-programmable perceptron for recurrent neural networks

Author

Listed:
  • Steven Becker

    (Max Planck Institute for the Science of Light
    Friedrich-Alexander-Universität Erlangen-Nürnberg)

  • Dirk Englund

    (Massachusetts Institute of Technology)

  • Birgit Stiller

    (Max Planck Institute for the Science of Light
    Friedrich-Alexander-Universität Erlangen-Nürnberg)

Abstract

Recurrent neural networks (RNNs) can process contextual information such as time series signals and language. But their tracking of internal states is a limiting factor, motivating research on analog implementations in photonics. While photonic unidirectional feedforward neural networks (NNs) have demonstrated big leaps, bi-directional optical RNNs present a challenge: the need for a short-term memory that (i) programmable and coherently computes optical inputs, (ii) minimizes added noise, and (iii) allows scalability. Here, we experimentally demonstrate an optoacoustic recurrent operator (OREO) which meets (i, ii, iii). OREO contextualizes the information of an optical pulse sequence via acoustic waves. The acoustic waves link different optical pulses, capturing their information and using it to manipulate subsequent operations. OREO’s all-optical control on a pulse-by-pulse basis offers simple reconfigurability and is used to implement a recurrent drop-out and pattern recognition of 27 optical pulse patterns. Finally, we introduce OREO as bi-directional perceptron for new classes of optical NNs.

Suggested Citation

  • Steven Becker & Dirk Englund & Birgit Stiller, 2024. "An optoacoustic field-programmable perceptron for recurrent neural networks," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47053-6
    DOI: 10.1038/s41467-024-47053-6
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-47053-6
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-47053-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Moritz Merklein & Birgit Stiller & Khu Vu & Stephen J. Madden & Benjamin J. Eggleton, 2017. "A chip-integrated coherent photonic-phononic memory," Nature Communications, Nature, vol. 8(1), pages 1-7, December.
    2. J. Feldmann & N. Youngblood & C. D. Wright & H. Bhaskaran & W. H. P. Pernice, 2019. "All-optical spiking neurosynaptic networks with self-learning capabilities," Nature, Nature, vol. 569(7755), pages 208-214, May.
    3. Wim Bogaerts & Daniel Pérez & José Capmany & David A. B. Miller & Joyce Poon & Dirk Englund & Francesco Morichetti & Andrea Melloni, 2020. "Programmable photonic circuits," Nature, Nature, vol. 586(7828), pages 207-216, October.
    4. H. Zhang & M. Gu & X. D. Jiang & J. Thompson & H. Cai & S. Paesani & R. Santagati & A. Laing & Y. Zhang & M. H. Yung & Y. Z. Shi & F. K. Muhammad & G. Q. Lo & X. S. Luo & B. Dong & D. L. Kwong & L. C., 2021. "An optical neural chip for implementing complex-valued neural network," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    5. J. Feldmann & N. Youngblood & M. Karpov & H. Gehring & X. Li & M. Stappers & M. Gallo & X. Fu & A. Lukashchuk & A. S. Raja & J. Liu & C. D. Wright & A. Sebastian & T. J. Kippenberg & W. H. P. Pernice , 2021. "Parallel convolutional processing using an integrated photonic tensor core," Nature, Nature, vol. 589(7840), pages 52-58, January.
    6. Siddharth Buddhiraju & Avik Dutt & Momchil Minkov & Ian A. D. Williamson & Shanhui Fan, 2021. "Arbitrary linear transformations for photons in the frequency synthetic dimension," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    7. J. Feldmann & N. Youngblood & M. Karpov & H. Gehring & X. Li & M. Stappers & M. Gallo & X. Fu & A. Lukashchuk & A. S. Raja & J. Liu & C. D. Wright & A. Sebastian & T. J. Kippenberg & W. H. P. Pernice , 2021. "Publisher Correction: Parallel convolutional processing using an integrated photonic tensor core," Nature, Nature, vol. 591(7849), pages 13-13, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han Zhao & Bingzhao Li & Huan Li & Mo Li, 2022. "Enabling scalable optical computing in synthetic frequency dimension using integrated cavity acousto-optics," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    2. Wen Zhou & Bowei Dong & Nikolaos Farmakidis & Xuan Li & Nathan Youngblood & Kairan Huang & Yuhan He & C. David Wright & Wolfram H. P. Pernice & Harish Bhaskaran, 2023. "In-memory photonic dot-product engine with electrically programmable weight banks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. H. H. Zhu & J. Zou & H. Zhang & Y. Z. Shi & S. B. Luo & N. Wang & H. Cai & L. X. Wan & B. Wang & X. D. Jiang & J. Thompson & X. S. Luo & X. H. Zhou & L. M. Xiao & W. Huang & L. Patrick & M. Gu & L. C., 2022. "Space-efficient optical computing with an integrated chip diffractive neural network," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    4. Xiangyan Meng & Guojie Zhang & Nuannuan Shi & Guangyi Li & José Azaña & José Capmany & Jianping Yao & Yichen Shen & Wei Li & Ninghua Zhu & Ming Li, 2023. "Compact optical convolution processing unit based on multimode interference," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    5. Bowen Bai & Qipeng Yang & Haowen Shu & Lin Chang & Fenghe Yang & Bitao Shen & Zihan Tao & Jing Wang & Shaofu Xu & Weiqiang Xie & Weiwen Zou & Weiwei Hu & John E. Bowers & Xingjun Wang, 2023. "Microcomb-based integrated photonic processing unit," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    6. Guangwei Cong & Noritsugu Yamamoto & Takashi Inoue & Yuriko Maegami & Morifumi Ohno & Shota Kita & Shu Namiki & Koji Yamada, 2022. "On-chip bacterial foraging training in silicon photonic circuits for projection-enabled nonlinear classification," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    7. Maoliang Wei & Kai Xu & Bo Tang & Junying Li & Yiting Yun & Peng Zhang & Yingchun Wu & Kangjian Bao & Kunhao Lei & Zequn Chen & Hui Ma & Chunlei Sun & Ruonan Liu & Ming Li & Lan Li & Hongtao Lin, 2024. "Monolithic back-end-of-line integration of phase change materials into foundry-manufactured silicon photonics," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    8. Liuting Shan & Qizhen Chen & Rengjian Yu & Changsong Gao & Lujian Liu & Tailiang Guo & Huipeng Chen, 2023. "A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    9. G. Mourgias-Alexandris & M. Moralis-Pegios & A. Tsakyridis & S. Simos & G. Dabos & A. Totovic & N. Passalis & M. Kirtas & T. Rutirawut & F. Y. Gardes & A. Tefas & N. Pleros, 2022. "Noise-resilient and high-speed deep learning with coherent silicon photonics," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    10. Ali Najjar Amiri & Aycan Deniz Vit & Kazim Gorgulu & Emir Salih Magden, 2024. "Deep photonic network platform enabling arbitrary and broadband optical functionality," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Xiaopeng Feng & Yuhong He & Wei Qu & Jinmei Song & Wanting Pan & Mingrui Tan & Bai Yang & Haotong Wei, 2022. "Spray-coated perovskite hemispherical photodetector featuring narrow-band and wide-angle imaging," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    12. Wenting Wang & Ping-Keng Lu & Abhinav Kumar Vinod & Deniz Turan & James F. McMillan & Hao Liu & Mingbin Yu & Dim-Lee Kwong & Mona Jarrahi & Chee Wei Wong, 2022. "Coherent terahertz radiation with 2.8-octave tunability through chip-scale photomixed microresonator optical parametric oscillation," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    13. Kaihang Lu & Zengqi Chen & Hao Chen & Wu Zhou & Zunyue Zhang & Hon Ki Tsang & Yeyu Tong, 2024. "Empowering high-dimensional optical fiber communications with integrated photonic processors," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    14. Yang Shi & Junyu Ren & Guanyu Chen & Wei Liu & Chuqi Jin & Xiangyu Guo & Yu Yu & Xinliang Zhang, 2022. "Nonlinear germanium-silicon photodiode for activation and monitoring in photonic neuromorphic networks," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    15. Chen-Guang Wang & Wuyue Xu & Chong Li & Lili Shi & Junliang Jiang & Tingting Guo & Wen-Cheng Yue & Tianyu Li & Ping Zhang & Yang-Yang Lyu & Jiazheng Pan & Xiuhao Deng & Ying Dong & Xuecou Tu & Sining , 2024. "Integrated and DC-powered superconducting microcomb," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    16. Bitao Shen & Haowen Shu & Weiqiang Xie & Ruixuan Chen & Zhi Liu & Zhangfeng Ge & Xuguang Zhang & Yimeng Wang & Yunhao Zhang & Buwen Cheng & Shaohua Yu & Lin Chang & Xingjun Wang, 2023. "Harnessing microcomb-based parallel chaos for random number generation and optical decision making," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    17. Xuan-Kun Li & Jian-Xu Ma & Xiang-Yu Li & Jun-Jie Hu & Chuan-Yang Ding & Feng-Kai Han & Xiao-Min Guo & Xi Tan & Xian-Min Jin, 2024. "High-efficiency reinforcement learning with hybrid architecture photonic integrated circuit," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    18. Ryan Hamerly & Saumil Bandyopadhyay & Dirk Englund, 2022. "Asymptotically fault-tolerant programmable photonics," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    19. Yiwei Li & Ning An & Zheyi Lu & Yuchen Wang & Bing Chang & Teng Tan & Xuhan Guo & Xizhen Xu & Jun He & Handing Xia & Zhaohui Wu & Yikai Su & Yuan Liu & Yunjiang Rao & Giancarlo Soavi & Baicheng Yao, 2022. "Nonlinear co-generation of graphene plasmons for optoelectronic logic operations," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    20. Kiumars Aryana & Yifei Zhang & John A. Tomko & Md Shafkat Bin Hoque & Eric R. Hoglund & David H. Olson & Joyeeta Nag & John C. Read & Carlos Ríos & Juejun Hu & Patrick E. Hopkins, 2021. "Suppressed electronic contribution in thermal conductivity of Ge2Sb2Se4Te," Nature Communications, Nature, vol. 12(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47053-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.