IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-33699-7.html
   My bibliography  Save this article

Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks

Author

Listed:
  • Amritanand Sebastian

    (Penn State University)

  • Rahul Pendurthi

    (Penn State University)

  • Azimkhan Kozhakhmetov

    (Penn State University)

  • Nicholas Trainor

    (Penn State University
    Penn State University)

  • Joshua A. Robinson

    (Penn State University
    Penn State University
    Penn State University)

  • Joan M. Redwing

    (Penn State University
    Penn State University
    Penn State University)

  • Saptarshi Das

    (Penn State University
    Penn State University
    Penn State University)

Abstract

Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task.

Suggested Citation

  • Amritanand Sebastian & Rahul Pendurthi & Azimkhan Kozhakhmetov & Nicholas Trainor & Joshua A. Robinson & Joan M. Redwing & Saptarshi Das, 2022. "Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33699-7
    DOI: 10.1038/s41467-022-33699-7
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-33699-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-33699-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Amritanand Sebastian & Andrew Pannone & Shiva Subbulakshmi Radhakrishnan & Saptarshi Das, 2019. "Gaussian synapses for probabilistic neural networks," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    2. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    3. Sarbashis Das & Akhil Dodda & Saptarshi Das, 2019. "A biomimetic 2D transistor for audiomorphic computing," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    4. Kwon, Yongchan & Won, Joong-Ho & Kim, Beom Joon & Paik, Myunghee Cho, 2020. "Uncertainty quantification using Bayesian neural networks in classification: Application to biomedical image segmentation," Computational Statistics & Data Analysis, Elsevier, vol. 142(C).
    5. Akhil Dodda & Aaryan Oberoi & Amritanand Sebastian & Tanushree H. Choudhury & Joan M. Redwing & Saptarshi Das, 2020. "Stochastic resonance in MoS2 photodetector," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    6. Shiva Subbulakshmi Radhakrishnan & Amritanand Sebastian & Aaryan Oberoi & Sarbashis Das & Saptarshi Das, 2021. "A biomimetic neural encoder for spiking neural network," Nature Communications, Nature, vol. 12(1), pages 1-10, December.
    7. Yikai Zheng & Harikrishnan Ravichandran & Thomas F. Schranghamer & Nicholas Trainor & Joan M. Redwing & Saptarshi Das, 2022. "Hardware implementation of Bayesian network based on two-dimensional memtransistors," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Akhil Dodda & Nicholas Trainor & Joan. M. Redwing & Saptarshi Das, 2022. "All-in-one, bio-inspired, and low-power crypto engines for near-sensor security based on two-dimensional memtransistors," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    2. Subir Ghosh & Andrew Pannone & Dipanjan Sen & Akshay Wali & Harikrishnan Ravichandran & Saptarshi Das, 2023. "An all 2D bio-inspired gustatory circuit for mimicking physiology and psychology of feeding behavior," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Muhtasim Ul Karim Sadaf & Najam U Sakib & Andrew Pannone & Harikrishnan Ravichandran & Saptarshi Das, 2023. "A bio-inspired visuotactile neuron for multisensory integration," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Yikai Zheng & Harikrishnan Ravichandran & Thomas F. Schranghamer & Nicholas Trainor & Joan M. Redwing & Saptarshi Das, 2022. "Hardware implementation of Bayesian network based on two-dimensional memtransistors," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    5. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    6. Fanfan Li & Dingwei Li & Chuanqing Wang & Guolei Liu & Rui Wang & Huihui Ren & Yingjie Tang & Yan Wang & Yitong Chen & Kun Liang & Qi Huang & Mohamad Sawan & Min Qiu & Hong Wang & Bowen Zhu, 2024. "An artificial visual neuron with multiplexed rate and time-to-first-spike coding," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    7. Zeng, Runtian & Song, Qiankun, 2024. "Mean-square exponential input-to-state stability for stochastic neutral-type quaternion-valued neural networks via Itô’s formula of quaternion version," Chaos, Solitons & Fractals, Elsevier, vol. 178(C).
    8. Helin Yang & Kwok-Yan Lam & Liang Xiao & Zehui Xiong & Hao Hu & Dusit Niyato & H. Vincent Poor, 2022. "Lead federated neuromorphic learning for wireless edge artificial intelligence," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    9. Xinyu Chen & Yufeng Xie & Yaochen Sheng & Hongwei Tang & Zeming Wang & Yu Wang & Yin Wang & Fuyou Liao & Jingyi Ma & Xiaojiao Guo & Ling Tong & Hanqi Liu & Hao Liu & Tianxiang Wu & Jiaxin Cao & Sitong, 2021. "Wafer-scale functional circuits based on two dimensional semiconductors with fabrication optimized by machine learning," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    10. Xingchen Pang & Yang Wang & Yuyan Zhu & Zhenhan Zhang & Du Xiang & Xun Ge & Haoqi Wu & Yongbo Jiang & Zizheng Liu & Xiaoxian Liu & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile rippled-assisted optoelectronic array for all-day motion detection and recognition," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    11. Haihui Lan & Luyang Wang & Runze He & Shuyi Huang & Jinqiu Yu & Jinming Guo & Jingrui Luo & Yiling Li & Jinyang Zhang & Jiaxin Lin & Shunping Zhang & Mengqi Zeng & Lei Fu, 2023. "2D quasi-layered material with domino structure," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    12. Tianyu Wang & Jialin Meng & Xufeng Zhou & Yue Liu & Zhenyu He & Qi Han & Qingxuan Li & Jiajie Yu & Zhenhai Li & Yongkai Liu & Hao Zhu & Qingqing Sun & David Wei Zhang & Peining Chen & Huisheng Peng & , 2022. "Reconfigurable neuromorphic memristor network for ultralow-power smart textile electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    13. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    14. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    15. Dehui Zhang & Dong Xu & Yuhang Li & Yi Luo & Jingtian Hu & Jingxuan Zhou & Yucheng Zhang & Boxuan Zhou & Peiqi Wang & Xurong Li & Bijie Bai & Huaying Ren & Laiyuan Wang & Ao Zhang & Mona Jarrahi & Yu , 2024. "Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    16. Robert Tseng & Sung-Tsun Wang & Tanveer Ahmed & Yi-Yu Pan & Shih-Chieh Chen & Che-Chi Shih & Wu-Wei Tsai & Hai-Ching Chen & Chi-Chung Kei & Tsung-Te Chou & Wen-Ching Hung & Jyh-Chen Chen & Yi-Hou Kuo , 2023. "Wide-range and area-selective threshold voltage tunability in ultrathin indium oxide transistors," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    17. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    18. Francesco De Pretis & Jürgen Landes, 2021. "EA3: A softmax algorithm for evidence appraisal aggregation," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-23, June.
    19. Lihuan Guo & Wei Wang & Yenchun Jim Wu, 2023. "What Do Scholars Propose for Future COVID-19 Research in Academic Publications? A Topic Analysis Based on Autoencoder," SAGE Open, , vol. 13(2), pages 21582440231, June.
    20. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33699-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.