IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46879-4.html
   My bibliography  Save this article

Training an Ising machine with equilibrium propagation

Author

Listed:
  • Jérémie Laydevant

    (Université Paris-Saclay)

  • Danijela Marković

    (Université Paris-Saclay)

  • Julie Grollier

    (Université Paris-Saclay)

Abstract

Ising machines, which are hardware implementations of the Ising model of coupled spins, have been influential in the development of unsupervised learning algorithms at the origins of Artificial Intelligence (AI). However, their application to AI has been limited due to the complexities in matching supervised training methods with Ising machine physics, even though these methods are essential for achieving high accuracy. In this study, we demonstrate an efficient approach to train Ising machines in a supervised way through the Equilibrium Propagation algorithm, achieving comparable results to software-based implementations. We employ the quantum annealing procedure of the D-Wave Ising machine to train a fully-connected neural network on the MNIST dataset. Furthermore, we demonstrate that the machine’s connectivity supports convolution operations, enabling the training of a compact convolutional network with minimal spins per neuron. Our findings establish Ising machines as a promising trainable hardware platform for AI, with the potential to enhance machine learning applications.

Suggested Citation

  • Jérémie Laydevant & Danijela Marković & Julie Grollier, 2024. "Training an Ising machine with equilibrium propagation," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46879-4
    DOI: 10.1038/s41467-024-46879-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46879-4
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46879-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jacob Torrejon & Mathieu Riou & Flavio Abreu Araujo & Sumito Tsunegi & Guru Khalsa & Damien Querlioz & Paolo Bortolotti & Vincent Cros & Kay Yakushiji & Akio Fukushima & Hitoshi Kubota & Shinji Yuasa , 2017. "Neuromorphic computing with nanoscale spintronic oscillators," Nature, Nature, vol. 547(7664), pages 428-431, July.
    2. Daniel J. Gauthier & Erik Bollt & Aaron Griffith & Wendson A. S. Barbosa, 2021. "Next generation reservoir computing," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    3. Logan G. Wright & Tatsuhiro Onodera & Martin M. Stein & Tianyu Wang & Darren T. Schachter & Zoey Hu & Peter L. McMahon, 2022. "Deep physical neural networks trained with backpropagation," Nature, Nature, vol. 601(7894), pages 549-555, January.
    4. William A. Borders & Ahmed Z. Pervaiz & Shunsuke Fukami & Kerem Y. Camsari & Hideo Ohno & Supriyo Datta, 2019. "Integer factorization using stochastic magnetic tunnel junctions," Nature, Nature, vol. 573(7774), pages 390-393, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xing Chen & Flavio Abreu Araujo & Mathieu Riou & Jacob Torrejon & Dafiné Ravelosona & Wang Kang & Weisheng Zhao & Julie Grollier & Damien Querlioz, 2022. "Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    2. ZhuangEn Fu & Piumi I. Samarawickrama & John Ackerman & Yanglin Zhu & Zhiqiang Mao & Kenji Watanabe & Takashi Taniguchi & Wenyong Wang & Yuri Dahnovsky & Mingzhong Wu & TeYu Chien & Jinke Tang & Allan, 2024. "Tunneling current-controlled spin states in few-layer van der Waals magnets," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    3. Ruomin Zhu & Sam Lilak & Alon Loeffler & Joseph Lizier & Adam Stieg & James Gimzewski & Zdenka Kuncic, 2023. "Online dynamical learning and sequence memory with neuromorphic nanowire networks," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Mitsumasa Nakajima & Katsuma Inoue & Kenji Tanaka & Yasuo Kuniyoshi & Toshikazu Hashimoto & Kohei Nakajima, 2022. "Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    5. Nihal Sanjay Singh & Keito Kobayashi & Qixuan Cao & Kemal Selcuk & Tianrui Hu & Shaila Niazi & Navid Anjum Aadit & Shun Kanai & Hideo Ohno & Shunsuke Fukami & Kerem Y. Camsari, 2024. "CMOS plus stochastic nanomagnets enabling heterogeneous computers for probabilistic inference and learning," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    6. Fan Cai & Yuesong Jiang & Wanqing Song & Kai-Hung Lu & Tongbo Zhu, 2024. "Short-Term Wind Turbine Blade Icing Wind Power Prediction Based on PCA-fLsm," Energies, MDPI, vol. 17(6), pages 1-15, March.
    7. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    8. John Daniel & Zheng Sun & Xuejian Zhang & Yuanqiu Tan & Neil Dilley & Zhihong Chen & Joerg Appenzeller, 2024. "Experimental demonstration of an on-chip p-bit core based on stochastic magnetic tunnel junctions and 2D MoS2 transistors," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    9. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    10. Klaus Raab & Maarten A. Brems & Grischa Beneke & Takaaki Dohi & Jan Rothörl & Fabian Kammerbauer & Johan H. Mentink & Mathias Kläui, 2022. "Brownian reservoir computing realized using geometrically confined skyrmion dynamics," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    11. Keck, Felix & Jütte, Silke & Lenzen, Manfred & Li, Mengyu, 2022. "Assessment of two optimisation methods for renewable energy capacity expansion planning," Applied Energy, Elsevier, vol. 306(PA).
    12. Yang, J. & Primo, E. & Aleja, D. & Criado, R. & Boccaletti, S. & Alfaro-Bittner, K., 2022. "Implementing and morphing Boolean gates with adaptive synchronization: The case of spiking neurons," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    13. Jia Si & Shuhan Yang & Yunuo Cen & Jiaer Chen & Yingna Huang & Zhaoyang Yao & Dong-Jun Kim & Kaiming Cai & Jerald Yoo & Xuanyao Fong & Hyunsoo Yang, 2024. "Energy-efficient superparamagnetic Ising machine and its application to traveling salesman problems," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    14. Zhuohui Liu & Qinghua Zhang & Donggang Xie & Mingzhen Zhang & Xinyan Li & Hai Zhong & Ge Li & Meng He & Dashan Shang & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2023. "Interface-type tunable oxygen ion dynamics for physical reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    15. Graciela Schiliuk & Iader Giraldo, 2021. "Regional responses to the Covid-19 crisis: a comparative study from economic, policy, and institutional perspectives," Documentos de Discusión FLAR 19734, Fondo Latino Americano de Reservas - FLAR.
    16. Liao, Zhiqiang & Ma, Kaijie & Tang, Siyi & Sarker, Md Shamim & Yamahara, Hiroyasu & Tabata, Hitoshi, 2021. "Phase locking of ultra-low power consumption stochastic magnetic bits induced by colored noise," Chaos, Solitons & Fractals, Elsevier, vol. 151(C).
    17. Hakseung Rhee & Gwangmin Kim & Hanchan Song & Woojoon Park & Do Hoon Kim & Jae Hyun In & Younghyun Lee & Kyung Min Kim, 2023. "Probabilistic computing with NbOx metal-insulator transition-based self-oscillatory pbit," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    18. Kyung Seok Woo & Jaehyun Kim & Janguk Han & Woohyun Kim & Yoon Ho Jang & Cheol Seong Hwang, 2022. "Probabilistic computing using Cu0.1Te0.9/HfO2/Pt diffusive memristors," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    19. Yiming Sun & Tao Lin & Na Lei & Xing Chen & Wang Kang & Zhiyuan Zhao & Dahai Wei & Chao Chen & Simin Pang & Linglong Hu & Liu Yang & Enxuan Dong & Li Zhao & Lei Liu & Zhe Yuan & Aladin Ullrich & Chris, 2023. "Experimental demonstration of a skyrmion-enhanced strain-mediated physical reservoir computing system," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    20. Tianyu Wang & Jialin Meng & Xufeng Zhou & Yue Liu & Zhenyu He & Qi Han & Qingxuan Li & Jiajie Yu & Zhenhai Li & Yongkai Liu & Hao Zhu & Qingqing Sun & David Wei Zhang & Peining Chen & Huisheng Peng & , 2022. "Reconfigurable neuromorphic memristor network for ultralow-power smart textile electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46879-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.