IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-48881-2.html
   My bibliography  Save this article

Bio-inspired multimodal learning with organic neuromorphic electronics for behavioral conditioning in robotics

Author

Listed:
  • Imke Krauhausen

    (Eindhoven University of Technology
    Eindhoven University of Technology
    Max Planck Institute for Polymer Research)

  • Sophie Griggs

    (University of Oxford)

  • Iain McCulloch

    (University of Oxford)

  • Jaap M. J. Toonder

    (Eindhoven University of Technology
    Eindhoven University of Technology)

  • Paschalis Gkoupidenis

    (Max Planck Institute for Polymer Research)

  • Yoeri Burgt

    (Eindhoven University of Technology
    Eindhoven University of Technology)

Abstract

Biological systems interact directly with the environment and learn by receiving multimodal feedback via sensory stimuli that shape the formation of internal neuronal representations. Drawing inspiration from biological concepts such as exploration and sensory processing that eventually lead to behavioral conditioning, we present a robotic system handling objects through multimodal learning. A small-scale organic neuromorphic circuit locally integrates and adaptively processes multimodal sensory stimuli, enabling the robot to interact intelligently with its surroundings. The real-time handling of sensory stimuli via low-voltage organic neuromorphic devices with synaptic functionality forms multimodal associative connections that lead to behavioral conditioning, and thus the robot learns to avoid potentially dangerous objects. This work demonstrates that adaptive neuro-inspired circuitry with multifunctional organic materials, can accommodate locally efficient bio-inspired learning for advancing intelligent robotics.

Suggested Citation

  • Imke Krauhausen & Sophie Griggs & Iain McCulloch & Jaap M. J. Toonder & Paschalis Gkoupidenis & Yoeri Burgt, 2024. "Bio-inspired multimodal learning with organic neuromorphic electronics for behavioral conditioning in robotics," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48881-2
    DOI: 10.1038/s41467-024-48881-2
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-48881-2
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-48881-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chiara Bartolozzi & Giacomo Indiveri & Elisa Donati, 2022. "Embodied neuromorphic intelligence," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    2. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    3. Paschalis Gkoupidenis & Dimitrios A. Koutsouras & George G. Malliaras, 2017. "Neuromorphic device architectures with global connectivity through electrolyte gating," Nature Communications, Nature, vol. 8(1), pages 1-8, August.
    4. Chiara Bartolozzi & Giacomo Indiveri & Elisa Donati, 2022. "Author Correction: Embodied neuromorphic intelligence," Nature Communications, Nature, vol. 13(1), pages 1-1, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simone D’Agostino & Filippo Moro & Tristan Torchet & Yiğit Demirağ & Laurent Grenouillet & Niccolò Castellani & Giacomo Indiveri & Elisa Vianello & Melika Payvand, 2024. "DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. Man Yao & Ole Richter & Guangshe Zhao & Ning Qiao & Yannan Xing & Dingheng Wang & Tianxiang Hu & Wei Fang & Tugba Demirci & Michele Marchi & Lei Deng & Tianyi Yan & Carsten Nielsen & Sadique Sheik & C, 2024. "Spike-based dynamic computing with asynchronous sensing-computing neuromorphic chip," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    3. Ningning Bai & Yiheng Xue & Shuiqing Chen & Lin Shi & Junli Shi & Yuan Zhang & Xingyu Hou & Yu Cheng & Kaixi Huang & Weidong Wang & Jin Zhang & Yuan Liu & Chuan Fei Guo, 2023. "A robotic sensory system with high spatiotemporal resolution for texture recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    4. Romain Beaubois & Jérémy Cheslet & Tomoya Duenki & Giuseppe De Venuto & Marta Carè & Farad Khoyratee & Michela Chiappalone & Pascal Branchereau & Yoshiho Ikeuchi & Timothée Levi, 2024. "BiœmuS: A new tool for neurological disorders studies through real-time emulation and hybridization using biomimetic Spiking Neural Network," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    5. Elisa Donati & Giacomo Valle, 2024. "Neuromorphic hardware for somatosensory neuroprostheses," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    6. Shengbo Wang & Shuo Gao & Chenyu Tang & Edoardo Occhipinti & Cong Li & Shurui Wang & Jiaqi Wang & Hubin Zhao & Guohua Hu & Arokia Nathan & Ravinder Dahiya & Luigi Giuseppe Occhipinti, 2024. "Memristor-based adaptive neuromorphic perception in unstructured environments," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    7. Yue Yang & Fangduo Zhu & Xumeng Zhang & Pei Chen & Yongzhou Wang & Jiaxue Zhu & Yanting Ding & Lingli Cheng & Chao Li & Hao Jiang & Zhongrui Wang & Peng Lin & Tuo Shi & Ming Wang & Qi Liu & Ningsheng , 2024. "Firing feature-driven neural circuits with scalable memristive neurons for robotic obstacle avoidance," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    8. Giovanni Maria Matrone & Eveline R. W. Doremaele & Abhijith Surendran & Zachary Laswick & Sophie Griggs & Gang Ye & Iain McCulloch & Francesca Santoro & Jonathan Rivnay & Yoeri Burgt, 2024. "A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    9. Dong Gue Roe & Dong Hae Ho & Yoon Young Choi & Young Jin Choi & Seongchan Kim & Sae Byeok Jo & Moon Sung Kang & Jong-Hyun Ahn & Jeong Ho Cho, 2023. "Humanlike spontaneous motion coordination of robotic fingers through spatial multi-input spike signal multiplexing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    10. Sophie Griggs & Adam Marks & Dilara Meli & Gonzague Rebetez & Olivier Bardagot & Bryan D. Paulsen & Hu Chen & Karrie Weaver & Mohamad I. Nugraha & Emily A. Schafer & Joshua Tropp & Catherine M. Aitchi, 2022. "The effect of residual palladium on the performance of organic electrochemical transistors," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    11. Tiefeng Liu & Johanna Heimonen & Qilun Zhang & Chi-Yuan Yang & Jun-Da Huang & Han-Yan Wu & Marc-Antoine Stoeckel & Tom P. A. Pol & Yuxuan Li & Sang Young Jeong & Adam Marks & Xin-Yi Wang & Yuttapoom P, 2023. "Ground-state electron transfer in all-polymer donor:acceptor blends enables aqueous processing of water-insoluble conjugated polymers," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    12. Xiaosong Wu & Shaocong Wang & Wei Huang & Yu Dong & Zhongrui Wang & Weiguo Huang, 2023. "Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    13. Yuanyuan Yang & Yajing Shen, 2024. "A liquid metal-based module emulating the intelligent preying logic of flytrap," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    14. Pietro Belleri & Judith Pons i Tarrés & Iain McCulloch & Paul W. M. Blom & Zsolt M. Kovács-Vajna & Paschalis Gkoupidenis & Fabrizio Torricelli, 2024. "Unravelling the operation of organic artificial neurons for neuromorphic bioelectronics," Nature Communications, Nature, vol. 15(1), pages 1-16, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48881-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.