IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-47630-9.html
   My bibliography  Save this article

Visualized in-sensor computing

Author

Listed:
  • Yao Ni

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Jiaqi Liu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Hong Han

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Qianbo Yu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Lu Yang

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Zhipeng Xu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Chengpeng Jiang

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Lu Liu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Wentao Xu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

Abstract

In artificial nervous systems, conductivity changes indicate synaptic weight updates, but they provide limited information compared to living organisms. We present the pioneering design and production of an electrochromic neuromorphic transistor employing color updates to represent synaptic weight for in-sensor computing. Here, we engineer a specialized mechanism for adaptively regulating ion doping through an ion-exchange membrane, enabling precise control over color-coded synaptic weight, an unprecedented achievement. The electrochromic neuromorphic transistor not only enhances electrochromatic capabilities for hardware coding but also establishes a visualized pattern-recognition network. Integrating the electrochromic neuromorphic transistor with an artificial whisker, we simulate a bionic reflex system inspired by the longicorn beetle, achieving real-time visualization of signal flow within the reflex arc in response to environmental stimuli. This research holds promise in extending the biomimetic coding paradigm and advancing the development of bio-hybrid interfaces, particularly in incorporating color-based expressions.

Suggested Citation

  • Yao Ni & Jiaqi Liu & Hong Han & Qianbo Yu & Lu Yang & Zhipeng Xu & Chengpeng Jiang & Lu Liu & Wentao Xu, 2024. "Visualized in-sensor computing," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47630-9
    DOI: 10.1038/s41467-024-47630-9
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-47630-9
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-47630-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Takao Someya & Zhenan Bao & George G. Malliaras, 2016. "The rise of plastic bioelectronics," Nature, Nature, vol. 540(7633), pages 379-385, December.
    2. Mohammad Karbalaei Akbari & Serge Zhuiykov, 2019. "A bioinspired optoelectronically engineered artificial neurorobotics device with sensorimotor functionalities," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    3. Feng-Shou Yang & Mengjiao Li & Mu-Pai Lee & I-Ying Ho & Jiann-Yeu Chen & Haifeng Ling & Yuanzhe Li & Jen-Kuei Chang & Shih-Hsien Yang & Yuan-Ming Chang & Ko-Chun Lee & Yi-Chia Chou & Ching-Hwa Ho & We, 2020. "Oxidation-boosted charge trapping in ultra-sensitive van der Waals materials for artificial synaptic features," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    4. Yongsuk Choi & Seyong Oh & Chuan Qian & Jin-Hong Park & Jeong Ho Cho, 2020. "Vertical organic synapse expandable to 3D crossbar array," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    5. Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    6. Yang Chai, 2020. "In-sensor computing for machine vision," Nature, Nature, vol. 579(7797), pages 32-33, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tao Guo & Shasha Li & Y. Norman Zhou & Wei D. Lu & Yong Yan & Yimin A. Wu, 2024. "Interspecies-chimera machine vision with polarimetry for real-time navigation and anti-glare pattern recognition," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    2. Jun Li & Corey Carlos & Hao Zhou & Jiajie Sui & Yikai Wang & Zulmari Silva-Pedraza & Fan Yang & Yutao Dong & Ziyi Zhang & Timothy A. Hacker & Bo Liu & Yanchao Mao & Xudong Wang, 2023. "Stretchable piezoelectric biocrystal thin films," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    3. Liang Zou & Huihui Tian & Shouliang Guan & Jianfei Ding & Lei Gao & Jinfen Wang & Ying Fang, 2021. "Self-assembled multifunctional neural probes for precise integration of optogenetics and electrophysiology," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    4. Dong Gue Roe & Dong Hae Ho & Yoon Young Choi & Young Jin Choi & Seongchan Kim & Sae Byeok Jo & Moon Sung Kang & Jong-Hyun Ahn & Jeong Ho Cho, 2023. "Humanlike spontaneous motion coordination of robotic fingers through spatial multi-input spike signal multiplexing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    5. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Muhtasim Ul Karim Sadaf & Najam U Sakib & Andrew Pannone & Harikrishnan Ravichandran & Saptarshi Das, 2023. "A bio-inspired visuotactile neuron for multisensory integration," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    7. Guang Yao & Xiaoyi Mo & Shanshan Liu & Qian Wang & Maowen Xie & Wenhao Lou & Shiyan Chen & Taisong Pan & Ke Chen & Dezhong Yao & Yuan Lin, 2023. "Snowflake-inspired and blink-driven flexible piezoelectric contact lenses for effective corneal injury repair," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    8. Xiao Liu & Jingping Wu & Keke Qiao & Guohan Liu & Zhengjin Wang & Tongqing Lu & Zhigang Suo & Jian Hu, 2022. "Topoarchitected polymer networks expand the space of material properties," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    9. Han Xu & Dashan Shang & Qing Luo & Junjie An & Yue Li & Shuyu Wu & Zhihong Yao & Woyu Zhang & Xiaoxin Xu & Chunmeng Dou & Hao Jiang & Liyang Pan & Xumeng Zhang & Ming Wang & Zhongrui Wang & Jianshi Ta, 2023. "A low-power vertical dual-gate neurotransistor with short-term memory for high energy-efficient neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    10. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Ge Li & Donggang Xie & Hai Zhong & Ziye Zhang & Xingke Fu & Qingli Zhou & Qiang Li & Hao Ni & Jiaou Wang & Er-jia Guo & Meng He & Can Wang & Guozhen Yang & Kuijuan Jin & Chen Ge, 2022. "Photo-induced non-volatile VO2 phase transition for neuromorphic ultraviolet sensors," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    12. Seokho Seo & Beomjin Kim & Donghoon Kim & Seungwoo Park & Tae Ryong Kim & Junkyu Park & Hakcheon Jeong & See-On Park & Taehoon Park & Hyeok Shin & Myung-Su Kim & Yang-Kyu Choi & Shinhyun Choi, 2022. "The gate injection-based field-effect synapse transistor with linear conductance update for online training," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    13. Donghwan Ji & Jae Min Park & Myeong Seon Oh & Thanh Loc Nguyen & Hyunsu Shin & Jae Seong Kim & Dukjoon Kim & Ho Seok Park & Jaeyun Kim, 2022. "Superstrong, superstiff, and conductive alginate hydrogels," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    14. Yuzhong Hu & Kaushik Parida & Hao Zhang & Xin Wang & Yongxin Li & Xinran Zhou & Samuel Alexander Morris & Weng Heng Liew & Haomin Wang & Tao Li & Feng Jiang & Mingmin Yang & Marin Alexe & Zehui Du & C, 2022. "Bond engineering of molecular ferroelectrics renders soft and high-performance piezoelectric energy harvesting materials," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    15. Sakeena Saifi & Xiao Xiao & Simin Cheng & Haotian Guo & Jinsheng Zhang & Peter Müller-Buschbaum & Guangmin Zhou & Xiaomin Xu & Hui-Ming Cheng, 2024. "An ultraflexible energy harvesting-storage system for wearable applications," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    16. Peng Tan & Haifei Wang & Furui Xiao & Xi Lu & Wenhui Shang & Xiaobo Deng & Huafeng Song & Ziyao Xu & Junfeng Cao & Tiansheng Gan & Ben Wang & Xuechang Zhou, 2022. "Solution-processable, soft, self-adhesive, and conductive polymer composites for soft electronics," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    17. Guangdong Zhou & Jie Li & Qunliang Song & Lidan Wang & Zhijun Ren & Bai Sun & Xiaofang Hu & Wenhua Wang & Gaobo Xu & Xiaodie Chen & Lan Cheng & Feichi Zhou & Shukai Duan, 2023. "Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Junhee Hong & Youngjin Seol & Seunghyun Lee & Janghyeok Yoon & Jiho Lee & Ki-Su Park & Ji-Wan Ha, 2024. "Prediction of Cognitive Impairment Using Sleep Lifelog Data and LSTM Model," Mathematics, MDPI, vol. 12(20), pages 1-18, October.
    19. Boyuan Cui & Zhen Fan & Wenjie Li & Yihong Chen & Shuai Dong & Zhengwei Tan & Shengliang Cheng & Bobo Tian & Ruiqiang Tao & Guo Tian & Deyang Chen & Zhipeng Hou & Minghui Qin & Min Zeng & Xubing Lu & , 2022. "Ferroelectric photosensor network: an advanced hardware solution to real-time machine vision," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    20. He-Shan Zhang & Xue-Mei Dong & Zi-Cheng Zhang & Ze-Pu Zhang & Chao-Yi Ban & Zhe Zhou & Cheng Song & Shi-Qi Yan & Qian Xin & Ju-Qing Liu & Yin-Xiang Li & Wei Huang, 2022. "Co-assembled perylene/graphene oxide photosensitive heterobilayer for efficient neuromorphics," Nature Communications, Nature, vol. 13(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47630-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.