IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46879-4.html
   My bibliography  Save this article

Training an Ising machine with equilibrium propagation

Author

Listed:
  • Jérémie Laydevant

    (Université Paris-Saclay)

  • Danijela Marković

    (Université Paris-Saclay)

  • Julie Grollier

    (Université Paris-Saclay)

Abstract

Ising machines, which are hardware implementations of the Ising model of coupled spins, have been influential in the development of unsupervised learning algorithms at the origins of Artificial Intelligence (AI). However, their application to AI has been limited due to the complexities in matching supervised training methods with Ising machine physics, even though these methods are essential for achieving high accuracy. In this study, we demonstrate an efficient approach to train Ising machines in a supervised way through the Equilibrium Propagation algorithm, achieving comparable results to software-based implementations. We employ the quantum annealing procedure of the D-Wave Ising machine to train a fully-connected neural network on the MNIST dataset. Furthermore, we demonstrate that the machine’s connectivity supports convolution operations, enabling the training of a compact convolutional network with minimal spins per neuron. Our findings establish Ising machines as a promising trainable hardware platform for AI, with the potential to enhance machine learning applications.

Suggested Citation

  • Jérémie Laydevant & Danijela Marković & Julie Grollier, 2024. "Training an Ising machine with equilibrium propagation," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46879-4
    DOI: 10.1038/s41467-024-46879-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46879-4
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46879-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Logan G. Wright & Tatsuhiro Onodera & Martin M. Stein & Tianyu Wang & Darren T. Schachter & Zoey Hu & Peter L. McMahon, 2022. "Deep physical neural networks trained with backpropagation," Nature, Nature, vol. 601(7894), pages 549-555, January.
    2. Daniel J. Gauthier & Erik Bollt & Aaron Griffith & Wendson A. S. Barbosa, 2021. "Next generation reservoir computing," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    3. William A. Borders & Ahmed Z. Pervaiz & Shunsuke Fukami & Kerem Y. Camsari & Hideo Ohno & Supriyo Datta, 2019. "Integer factorization using stochastic magnetic tunnel junctions," Nature, Nature, vol. 573(7774), pages 390-393, September.
    4. Jacob Torrejon & Mathieu Riou & Flavio Abreu Araujo & Sumito Tsunegi & Guru Khalsa & Damien Querlioz & Paolo Bortolotti & Vincent Cros & Kay Yakushiji & Akio Fukushima & Hitoshi Kubota & Shinji Yuasa , 2017. "Neuromorphic computing with nanoscale spintronic oscillators," Nature, Nature, vol. 547(7664), pages 428-431, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kilian D. Stenning & Jack C. Gartside & Luca Manneschi & Christopher T. S. Cheung & Tony Chen & Alex Vanstone & Jake Love & Holly Holder & Francesco Caravelli & Hidekazu Kurebayashi & Karin Everschor-, 2024. "Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    2. Ruomin Zhu & Sam Lilak & Alon Loeffler & Joseph Lizier & Adam Stieg & James Gimzewski & Zdenka Kuncic, 2023. "Online dynamical learning and sequence memory with neuromorphic nanowire networks," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    3. Xing Chen & Flavio Abreu Araujo & Mathieu Riou & Jacob Torrejon & Dafiné Ravelosona & Wang Kang & Weisheng Zhao & Julie Grollier & Damien Querlioz, 2022. "Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    4. ZhuangEn Fu & Piumi I. Samarawickrama & John Ackerman & Yanglin Zhu & Zhiqiang Mao & Kenji Watanabe & Takashi Taniguchi & Wenyong Wang & Yuri Dahnovsky & Mingzhong Wu & TeYu Chien & Jinke Tang & Allan, 2024. "Tunneling current-controlled spin states in few-layer van der Waals magnets," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    5. Mitsumasa Nakajima & Katsuma Inoue & Kenji Tanaka & Yasuo Kuniyoshi & Toshikazu Hashimoto & Kohei Nakajima, 2022. "Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    6. Nihal Sanjay Singh & Keito Kobayashi & Qixuan Cao & Kemal Selcuk & Tianrui Hu & Shaila Niazi & Navid Anjum Aadit & Shun Kanai & Hideo Ohno & Shunsuke Fukami & Kerem Y. Camsari, 2024. "CMOS plus stochastic nanomagnets enabling heterogeneous computers for probabilistic inference and learning," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    7. Gianluca Fabiani & Nikolaos Evangelou & Tianqi Cui & Juan M. Bello-Rivas & Cristina P. Martin-Linares & Constantinos Siettos & Ioannis G. Kevrekidis, 2024. "Task-oriented machine learning surrogates for tipping points of agent-based models," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    8. Zequn Lin & Zhaofan Lu & Zengru Di & Ying Tang, 2024. "Learning noise-induced transitions by multi-scaling reservoir computing," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    9. Fan Cai & Yuesong Jiang & Wanqing Song & Kai-Hung Lu & Tongbo Zhu, 2024. "Short-Term Wind Turbine Blade Icing Wind Power Prediction Based on PCA-fLsm," Energies, MDPI, vol. 17(6), pages 1-15, March.
    10. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    11. John Daniel & Zheng Sun & Xuejian Zhang & Yuanqiu Tan & Neil Dilley & Zhihong Chen & Joerg Appenzeller, 2024. "Experimental demonstration of an on-chip p-bit core based on stochastic magnetic tunnel junctions and 2D MoS2 transistors," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    12. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    13. Abbas, Khizar & Han, Mengyao & Xu, Deyi & Butt, Khalid Manzoor & Baz, Khan & Cheng, Jinhua & Zhu, Yongguang & Hussain, Sanwal, 2024. "Exploring synergistic and individual causal effects of rare earth elements and renewable energy on multidimensional economic complexity for sustainable economic development," Applied Energy, Elsevier, vol. 364(C).
    14. Klaus Raab & Maarten A. Brems & Grischa Beneke & Takaaki Dohi & Jan Rothörl & Fabian Kammerbauer & Johan H. Mentink & Mathias Kläui, 2022. "Brownian reservoir computing realized using geometrically confined skyrmion dynamics," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    15. Seou Choi & Yannick Salamin & Charles Roques-Carmes & Rumen Dangovski & Di Luo & Zhuo Chen & Michael Horodynski & Jamison Sloan & Shiekh Zia Uddin & Marin Soljačić, 2024. "Photonic probabilistic machine learning using quantum vacuum noise," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    16. Lina Jaurigue & Kathy Lüdge, 2022. "Connecting reservoir computing with statistical forecasting and deep neural networks," Nature Communications, Nature, vol. 13(1), pages 1-3, December.
    17. Martina Ahlberg & Sunjae Chung & Sheng Jiang & Andreas Frisk & Maha Khademi & Roman Khymyn & Ahmad A. Awad & Q. Tuan Le & Hamid Mazraati & Majid Mohseni & Markus Weigand & Iuliia Bykova & Felix Groß &, 2022. "Freezing and thawing magnetic droplet solitons," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    18. Keck, Felix & Jütte, Silke & Lenzen, Manfred & Li, Mengyu, 2022. "Assessment of two optimisation methods for renewable energy capacity expansion planning," Applied Energy, Elsevier, vol. 306(PA).
    19. Yang, J. & Primo, E. & Aleja, D. & Criado, R. & Boccaletti, S. & Alfaro-Bittner, K., 2022. "Implementing and morphing Boolean gates with adaptive synchronization: The case of spiking neurons," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    20. Robert M. Kent & Wendson A. S. Barbosa & Daniel J. Gauthier, 2024. "Controlling chaos using edge computing hardware," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46879-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.