IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-36205-9.html
   My bibliography  Save this article

Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning

Author

Listed:
  • Xiaosong Wu

    (Chinese Academy of Sciences)

  • Shaocong Wang

    (University of Hong Kong)

  • Wei Huang

    (Chinese Academy of Sciences)

  • Yu Dong

    (Chinese Academy of Sciences)

  • Zhongrui Wang

    (University of Hong Kong)

  • Weiguo Huang

    (Chinese Academy of Sciences
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China
    University of Chinese Academy of Sciences)

Abstract

In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems.

Suggested Citation

  • Xiaosong Wu & Shaocong Wang & Wei Huang & Yu Dong & Zhongrui Wang & Weiguo Huang, 2023. "Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36205-9
    DOI: 10.1038/s41467-023-36205-9
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-36205-9
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-36205-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    2. Chao Du & Fuxi Cai & Mohammed A. Zidan & Wen Ma & Seung Hwan Lee & Wei D. Lu, 2017. "Reservoir computing using dynamic memristors for temporal information processing," Nature Communications, Nature, vol. 8(1), pages 1-10, December.
    3. Xudong Ji & Bryan D. Paulsen & Gary K. K. Chik & Ruiheng Wu & Yuyang Yin & Paddy K. L. Chan & Jonathan Rivnay, 2021. "Mimicking associative learning using an ion-trapping non-volatile synaptic organic electrochemical transistor," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    4. Zhongrui Wang & Mingyi Rao & Jin-Woo Han & Jiaming Zhang & Peng Lin & Yunning Li & Can Li & Wenhao Song & Shiva Asapu & Rivu Midya & Ye Zhuo & Hao Jiang & Jung Ho Yoon & Navnidhi Kumar Upadhyay & Saum, 2018. "Capacitive neural network with neuro-transistors," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    5. Ming-Yang Li & Sheng-Kai Su & H.-S. Philip Wong & Lain-Jong Li, 2019. "How 2D semiconductors could extend Moore’s law," Nature, Nature, vol. 567(7747), pages 169-170, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Pengshan Xie & Yunchao Xu & Jingwen Wang & Dengji Li & Yuxuan Zhang & Zixin Zeng & Boxiang Gao & Quan Quan & Bowen Li & You Meng & Weijun Wang & Yezhan Li & Yan Yan & Yi Shen & Jia Sun & Johnny C. Ho, 2024. "Birdlike broadband neuromorphic visual sensor arrays for fusion imaging," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Xin Liu & Danhao Wang & Wei Chen & Yang Kang & Shi Fang & Yuanmin Luo & Dongyang Luo & Huabin Yu & Haochen Zhang & Kun Liang & Lan Fu & Boon S. Ooi & Sheng Liu & Haiding Sun, 2024. "Optoelectronic synapses with chemical-electric behaviors in gallium nitride semiconductors for biorealistic neuromorphic functionality," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    4. Changsong Gao & Di Liu & Chenhui Xu & Weidong Xie & Xianghong Zhang & Junhua Bai & Zhixian Lin & Cheng Zhang & Yuanyuan Hu & Tailiang Guo & Huipeng Chen, 2024. "Toward grouped-reservoir computing: organic neuromorphic vertical transistor with distributed reservoir states for efficient recognition and prediction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Zachary Laswick & Xihu Wu & Abhijith Surendran & Zhongliang Zhou & Xudong Ji & Giovanni Maria Matrone & Wei Lin Leong & Jonathan Rivnay, 2024. "Tunable anti-ambipolar vertical bilayer organic electrochemical transistor enable neuromorphic retinal pathway," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    3. Shuai Chen & Zhongliang Zhou & Kunqi Hou & Xihu Wu & Qiang He & Cindy G. Tang & Ting Li & Xiujuan Zhang & Jiansheng Jie & Zhiyi Gao & Nripan Mathews & Wei Lin Leong, 2024. "Artificial organic afferent nerves enable closed-loop tactile feedback for intelligent robot," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    4. Junzhu Li & Abdus Samad & Yue Yuan & Qingxiao Wang & Mohamed Nejib Hedhili & Mario Lanza & Udo Schwingenschlögl & Iwnetim Abate & Deji Akinwande & Zheng Liu & Bo Tian & Xixiang Zhang, 2024. "Single-crystal hBN Monolayers from Aligned Hexagonal Islands," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    5. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Rohit Abraham John & Yiğit Demirağ & Yevhen Shynkarenko & Yuliia Berezovska & Natacha Ohannessian & Melika Payvand & Peng Zeng & Maryna I. Bodnarchuk & Frank Krumeich & Gökhan Kara & Ivan Shorubalko &, 2022. "Reconfigurable halide perovskite nanocrystal memristors for neuromorphic computing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    7. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    8. Hongwei Tan & Sebastiaan van Dijken, 2023. "Dynamic machine vision with retinomorphic photomemristor-reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    9. Jongmin Lee & Bum Ho Jeong & Eswaran Kamaraj & Dohyung Kim & Hakjun Kim & Sanghyuk Park & Hui Joon Park, 2023. "Light-enhanced molecular polarity enabling multispectral color-cognitive memristor for neuromorphic visual system," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    10. Ui Yeon Won & Quoc An Vu & Sung Bum Park & Mi Hyang Park & Van Dam Do & Hyun Jun Park & Heejun Yang & Young Hee Lee & Woo Jong Yu, 2023. "Multi-neuron connection using multi-terminal floating–gate memristor for unsupervised learning," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    11. Yanfei Zhao & Mukesh Tripathi & Kristiāns Čerņevičs & Ahmet Avsar & Hyun Goo Ji & Juan Francisco Gonzalez Marin & Cheol-Yeon Cheon & Zhenyu Wang & Oleg V. Yazyev & Andras Kis, 2023. "Electrical spectroscopy of defect states and their hybridization in monolayer MoS2," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    12. Lu Li & Qinqin Wang & Fanfan Wu & Qiaoling Xu & Jinpeng Tian & Zhiheng Huang & Qinghe Wang & Xuan Zhao & Qinghua Zhang & Qinkai Fan & Xiuzhen Li & Yalin Peng & Yangkun Zhang & Kunshan Ji & Aomiao Zhi , 2024. "Epitaxy of wafer-scale single-crystal MoS2 monolayer via buffer layer control," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    13. Yang, J. & Primo, E. & Aleja, D. & Criado, R. & Boccaletti, S. & Alfaro-Bittner, K., 2022. "Implementing and morphing Boolean gates with adaptive synchronization: The case of spiking neurons," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    14. Giovanni Maria Matrone & Eveline R. W. Doremaele & Abhijith Surendran & Zachary Laswick & Sophie Griggs & Gang Ye & Iain McCulloch & Francesca Santoro & Jonathan Rivnay & Yoeri Burgt, 2024. "A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    15. Yan Wang & Yue Gong & Shenming Huang & Xuechao Xing & Ziyu Lv & Junjie Wang & Jia-Qin Yang & Guohua Zhang & Ye Zhou & Su-Ting Han, 2021. "Memristor-based biomimetic compound eye for real-time collision detection," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    16. Pengshan Xie & Yunchao Xu & Jingwen Wang & Dengji Li & Yuxuan Zhang & Zixin Zeng & Boxiang Gao & Quan Quan & Bowen Li & You Meng & Weijun Wang & Yezhan Li & Yan Yan & Yi Shen & Jia Sun & Johnny C. Ho, 2024. "Birdlike broadband neuromorphic visual sensor arrays for fusion imaging," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    17. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    18. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    19. Zhuohui Liu & Qinghua Zhang & Donggang Xie & Mingzhen Zhang & Xinyan Li & Hai Zhong & Ge Li & Meng He & Dashan Shang & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2023. "Interface-type tunable oxygen ion dynamics for physical reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    20. Ruomin Zhu & Sam Lilak & Alon Loeffler & Joseph Lizier & Adam Stieg & James Gimzewski & Zdenka Kuncic, 2023. "Online dynamical learning and sequence memory with neuromorphic nanowire networks," Nature Communications, Nature, vol. 14(1), pages 1-12, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36205-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.