IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-45670-9.html
   My bibliography  Save this article

Hardware implementation of memristor-based artificial neural networks

Author

Listed:
  • Fernando Aguirre

    (King Abdullah University of Science and Technology (KAUST)
    Universitat Autònoma de Barcelona (UAB))

  • Abu Sebastian

    (IBM Research – Zurich)

  • Manuel Gallo

    (IBM Research – Zurich)

  • Wenhao Song

    (University of Southern California (USC))

  • Tong Wang

    (University of Southern California (USC))

  • J. Joshua Yang

    (University of Southern California (USC))

  • Wei Lu

    (University of Michigan)

  • Meng-Fan Chang

    (National Tsing Hua University)

  • Daniele Ielmini

    (Politecnico di Milano and IUNET)

  • Yuchao Yang

    (Peking University)

  • Adnan Mehonic

    (University College London (UCL), Torrington Place)

  • Anthony Kenyon

    (University College London (UCL), Torrington Place)

  • Marco A. Villena

    (King Abdullah University of Science and Technology (KAUST))

  • Juan B. Roldán

    (Facultad de Ciencias, Universidad de Granada, Avenida Fuentenueva s/n)

  • Yuting Wu

    (University of Michigan)

  • Hung-Hsi Hsu

    (National Tsing Hua University)

  • Nagarajan Raghavan

    (Singapore University of Technology & Design)

  • Jordi Suñé

    (Universitat Autònoma de Barcelona (UAB))

  • Enrique Miranda

    (Universitat Autònoma de Barcelona (UAB))

  • Ahmed Eltawil

    (King Abdullah University of Science and Technology (KAUST))

  • Gianluca Setti

    (King Abdullah University of Science and Technology (KAUST))

  • Kamilya Smagulova

    (King Abdullah University of Science and Technology (KAUST))

  • Khaled N. Salama

    (King Abdullah University of Science and Technology (KAUST))

  • Olga Krestinskaya

    (King Abdullah University of Science and Technology (KAUST))

  • Xiaobing Yan

    (Hebei University)

  • Kah-Wee Ang

    (National University of Singapore (NUS))

  • Samarth Jain

    (National University of Singapore (NUS))

  • Sifan Li

    (National University of Singapore (NUS))

  • Osamah Alharbi

    (King Abdullah University of Science and Technology (KAUST))

  • Sebastian Pazos

    (King Abdullah University of Science and Technology (KAUST))

  • Mario Lanza

    (King Abdullah University of Science and Technology (KAUST))

Abstract

Artificial Intelligence (AI) is currently experiencing a bloom driven by deep learning (DL) techniques, which rely on networks of connected simple computing units operating in parallel. The low communication bandwidth between memory and processing units in conventional von Neumann machines does not support the requirements of emerging applications that rely extensively on large sets of data. More recent computing paradigms, such as high parallelization and near-memory computing, help alleviate the data communication bottleneck to some extent, but paradigm- shifting concepts are required. Memristors, a novel beyond-complementary metal-oxide-semiconductor (CMOS) technology, are a promising choice for memory devices due to their unique intrinsic device-level properties, enabling both storing and computing with a small, massively-parallel footprint at low power. Theoretically, this directly translates to a major boost in energy efficiency and computational throughput, but various practical challenges remain. In this work we review the latest efforts for achieving hardware-based memristive artificial neural networks (ANNs), describing with detail the working principia of each block and the different design alternatives with their own advantages and disadvantages, as well as the tools required for accurate estimation of performance metrics. Ultimately, we aim to provide a comprehensive protocol of the materials and methods involved in memristive neural networks to those aiming to start working in this field and the experts looking for a holistic approach.

Suggested Citation

  • Fernando Aguirre & Abu Sebastian & Manuel Gallo & Wenhao Song & Tong Wang & J. Joshua Yang & Wei Lu & Meng-Fan Chang & Daniele Ielmini & Yuchao Yang & Adnan Mehonic & Anthony Kenyon & Marco A. Villena, 2024. "Hardware implementation of memristor-based artificial neural networks," Nature Communications, Nature, vol. 15(1), pages 1-40, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45670-9
    DOI: 10.1038/s41467-024-45670-9
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-45670-9
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-45670-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Weier Wan & Rajkumar Kubendran & Clemens Schaefer & Sukru Burc Eryilmaz & Wenqiang Zhang & Dabin Wu & Stephen Deiss & Priyanka Raina & He Qian & Bin Gao & Siddharth Joshi & Huaqiang Wu & H.-S. Philip , 2022. "A compute-in-memory chip based on resistive random-access memory," Nature, Nature, vol. 608(7923), pages 504-512, August.
    2. Can Li & Lili Han & Hao Jiang & Moon-Hyung Jang & Peng Lin & Qing Wu & Mark Barnell & J. Joshua Yang & Huolin L. Xin & Qiangfei Xia, 2017. "Three-dimensional crossbar arrays of self-rectifying Si/SiO2/Si memristors," Nature Communications, Nature, vol. 8(1), pages 1-9, August.
    3. M. Prezioso & F. Merrikh-Bayat & B. D. Hoskins & G. C. Adam & K. K. Likharev & D. B. Strukov, 2015. "Training and operation of an integrated neuromorphic network based on metal-oxide memristors," Nature, Nature, vol. 521(7550), pages 61-64, May.
    4. Max M. Shulaker & Gage Hills & Rebecca S. Park & Roger T. Howe & Krishna Saraswat & H.-S. Philip Wong & Subhasish Mitra, 2017. "Three-dimensional integration of nanotechnologies for computing and data storage on a single chip," Nature, Nature, vol. 547(7661), pages 74-78, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yijun Li & Jianshi Tang & Bin Gao & Jian Yao & Anjunyi Fan & Bonan Yan & Yuchao Yang & Yue Xi & Yuankun Li & Jiaming Li & Wen Sun & Yiwei Du & Zhengwu Liu & Qingtian Zhang & Song Qiu & Qingwen Li & He, 2023. "Monolithic three-dimensional integration of RRAM-based hybrid memory architecture for one-shot learning," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    2. Peng Chen & Fenghao Liu & Peng Lin & Peihong Li & Yu Xiao & Bihua Zhang & Gang Pan, 2023. "Open-loop analog programmable electrochemical memory array," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    3. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    4. Fadi Jebali & Atreya Majumdar & Clément Turck & Kamel-Eddine Harabi & Mathieu-Coumba Faye & Eloi Muhr & Jean-Pierre Walder & Oleksandr Bilousov & Amadéo Michaud & Elisa Vianello & Tifenn Hirtzlin & Fr, 2024. "Powering AI at the edge: A robust, memristor-based binarized neural network with near-memory computing and miniaturized solar cell," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Thomas Dalgaty & Filippo Moro & Yiğit Demirağ & Alessio Pra & Giacomo Indiveri & Elisa Vianello & Melika Payvand, 2024. "Mosaic: in-memory computing and routing for small-world spike-based neuromorphic systems," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. Simone D’Agostino & Filippo Moro & Tristan Torchet & Yiğit Demirağ & Laurent Grenouillet & Niccolò Castellani & Giacomo Indiveri & Elisa Vianello & Melika Payvand, 2024. "DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    7. Xu, Ying & Jia, Ya & Ma, Jun & Alsaedi, Ahmed & Ahmad, Bashir, 2017. "Synchronization between neurons coupled by memristor," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 435-442.
    8. Long Liu & Di Wang & Dandan Wang & Yan Sun & Huai Lin & Xiliang Gong & Yifan Zhang & Ruifeng Tang & Zhihong Mai & Zhipeng Hou & Yumeng Yang & Peng Li & Lan Wang & Qing Luo & Ling Li & Guozhong Xing & , 2024. "Domain wall magnetic tunnel junction-based artificial synapses and neurons for all-spin neuromorphic hardware," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    9. Yongxiang Li & Shiqing Wang & Ke Yang & Yuchao Yang & Zhong Sun, 2024. "An emergent attractor network in a passive resistive switching circuit," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    10. Ushakov, Yury & Balanov, Alexander & Savel’ev, Sergey, 2021. "Role of noise in spiking dynamics of diffusive memristor driven by heating-cooling cycles," Chaos, Solitons & Fractals, Elsevier, vol. 145(C).
    11. Jens E. Pedersen & Steven Abreu & Matthias Jobst & Gregor Lenz & Vittorio Fra & Felix Christian Bauer & Dylan Richard Muir & Peng Zhou & Bernhard Vogginger & Kade Heckel & Gianvito Urgese & Sadasivan , 2024. "Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    12. Ui Yeon Won & Quoc An Vu & Sung Bum Park & Mi Hyang Park & Van Dam Do & Hyun Jun Park & Heejun Yang & Young Hee Lee & Woo Jong Yu, 2023. "Multi-neuron connection using multi-terminal floating–gate memristor for unsupervised learning," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    13. Zhou, Wei & Jin, Peipei & Dong, Yujiao & Liang, Yan & Wang, Guangyi, 2023. "Memristor neurons and their coupling networks based on Edge of Chaos Kernel," Chaos, Solitons & Fractals, Elsevier, vol. 177(C).
    14. Xiangjin Wu & Asir Intisar Khan & Hengyuan Lee & Chen-Feng Hsu & Huairuo Zhang & Heshan Yu & Neel Roy & Albert V. Davydov & Ichiro Takeuchi & Xinyu Bao & H.-S. Philip Wong & Eric Pop, 2024. "Novel nanocomposite-superlattices for low energy and high stability nanoscale phase-change memory," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    15. Ruibin Mao & Bo Wen & Arman Kazemi & Yahui Zhao & Ann Franchesca Laguna & Rui Lin & Ngai Wong & Michael Niemier & X. Sharon Hu & Xia Sheng & Catherine E. Graves & John Paul Strachan & Can Li, 2022. "Experimentally validated memristive memory augmented neural network with efficient hashing and similarity search," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    16. Arnab Pal & Zichun Chai & Junkai Jiang & Wei Cao & Mike Davies & Vivek De & Kaustav Banerjee, 2024. "An ultra energy-efficient hardware platform for neuromorphic computing enabled by 2D-TMD tunnel-FETs," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    17. Parshina, Liubov & Novodvorsky, Oleg & Khramova, Olga & Gusev, Dmitriy & Polyakov, Alexander & Mikhalevsky, Vladimir & Cherebilo, Elena, 2021. "Laser synthesis of non-volatile memristor structures based on tantalum oxide thin films," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    18. Bin Gao & Ying Zhou & Qingtian Zhang & Shuanglin Zhang & Peng Yao & Yue Xi & Qi Liu & Meiran Zhao & Wenqiang Zhang & Zhengwu Liu & Xinyi Li & Jianshi Tang & He Qian & Huaqiang Wu, 2022. "Memristor-based analogue computing for brain-inspired sound localization with in situ training," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    19. Melika Payvand & Filippo Moro & Kumiko Nomura & Thomas Dalgaty & Elisa Vianello & Yoshifumi Nishi & Giacomo Indiveri, 2022. "Self-organization of an inhomogeneous memristive hardware for sequence learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    20. Yuxuan Zhang & You Meng & Liqiang Wang & Changyong Lan & Quan Quan & Wei Wang & Zhengxun Lai & Weijun Wang & Yezhan Li & Di Yin & Dengji Li & Pengshan Xie & Dong Chen & Zhe Yang & SenPo Yip & Yang Lu , 2024. "Pulse irradiation synthesis of metal chalcogenides on flexible substrates for enhanced photothermoelectric performance," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45670-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.