IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-28571-7.html
   My bibliography  Save this article

Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations

Author

Listed:
  • Xing Chen

    (Beihang University
    Centre de Nanosciences et de Nanotechnologies)

  • Flavio Abreu Araujo

    (Université catholique de Louvain
    Université Paris-Saclay)

  • Mathieu Riou

    (Université Paris-Saclay)

  • Jacob Torrejon

    (Université Paris-Saclay)

  • Dafiné Ravelosona

    (Centre de Nanosciences et de Nanotechnologies)

  • Wang Kang

    (Beihang University)

  • Weisheng Zhao

    (Beihang University)

  • Julie Grollier

    (Université Paris-Saclay)

  • Damien Querlioz

    (Centre de Nanosciences et de Nanotechnologies)

Abstract

Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation of an experimental physical system. Here we show that a dynamical neural network, trained on a minimal amount of data, can predict the behavior of spintronic devices with high accuracy and an extremely efficient simulation time, compared to the micromagnetic simulations that are usually employed to model them. For this purpose, we re-frame the formalism of Neural Ordinary Differential Equations to the constraints of spintronics: few measured outputs, multiple inputs and internal parameters. We demonstrate with Neural Ordinary Differential Equations an acceleration factor over 200 compared to micromagnetic simulations for a complex problem – the simulation of a reservoir computer made of magnetic skyrmions (20 minutes compared to three days). In a second realization, we show that we can predict the noisy response of experimental spintronic nano-oscillators to varying inputs after training Neural Ordinary Differential Equations on five milliseconds of their measured response to a different set of inputs. Neural Ordinary Differential Equations can therefore constitute a disruptive tool for developing spintronic applications in complement to micromagnetic simulations, which are time-consuming and cannot fit experiments when noise or imperfections are present. Our approach can also be generalized to other electronic devices involving dynamics.

Suggested Citation

  • Xing Chen & Flavio Abreu Araujo & Mathieu Riou & Jacob Torrejon & Dafiné Ravelosona & Wang Kang & Weisheng Zhao & Julie Grollier & Damien Querlioz, 2022. "Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-28571-7
    DOI: 10.1038/s41467-022-28571-7
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-28571-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-28571-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sun-Ting Tsai & En-Jui Kuo & Pratyush Tiwary, 2020. "Learning molecular dynamics with simple language model built upon long short-term memory neural network," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    2. Kristof T. Schütt & Farhad Arbabzadah & Stefan Chmiela & Klaus R. Müller & Alexandre Tkatchenko, 2017. "Quantum-chemical insights from deep tensor neural networks," Nature Communications, Nature, vol. 8(1), pages 1-8, April.
    3. Claas Abert, 2019. "Micromagnetics and spintronics: models and numerical methods," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 92(6), pages 1-45, June.
    4. Miguel Romera & Philippe Talatchian & Sumito Tsunegi & Flavio Abreu Araujo & Vincent Cros & Paolo Bortolotti & Juan Trastoy & Kay Yakushiji & Akio Fukushima & Hitoshi Kubota & Shinji Yuasa & Maxence E, 2018. "Vowel recognition with four coupled spin-torque nano-oscillators," Nature, Nature, vol. 563(7730), pages 230-234, November.
    5. William A. Borders & Ahmed Z. Pervaiz & Shunsuke Fukami & Kerem Y. Camsari & Hideo Ohno & Supriyo Datta, 2019. "Integer factorization using stochastic magnetic tunnel junctions," Nature, Nature, vol. 573(7774), pages 390-393, September.
    6. Ádám Papp & Wolfgang Porod & Gyorgy Csaba, 2021. "Nanoscale neural network using non-linear spin-wave interference," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    7. Jacob Torrejon & Mathieu Riou & Flavio Abreu Araujo & Sumito Tsunegi & Guru Khalsa & Damien Querlioz & Paolo Bortolotti & Vincent Cros & Kay Yakushiji & Akio Fukushima & Hitoshi Kubota & Shinji Yuasa , 2017. "Neuromorphic computing with nanoscale spintronic oscillators," Nature, Nature, vol. 547(7664), pages 428-431, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yiming Sun & Tao Lin & Na Lei & Xing Chen & Wang Kang & Zhiyuan Zhao & Dahai Wei & Chao Chen & Simin Pang & Linglong Hu & Liu Yang & Enxuan Dong & Li Zhao & Lei Liu & Zhe Yuan & Aladin Ullrich & Chris, 2023. "Experimental demonstration of a skyrmion-enhanced strain-mediated physical reservoir computing system," Nature Communications, Nature, vol. 14(1), pages 1-10, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kilian D. Stenning & Jack C. Gartside & Luca Manneschi & Christopher T. S. Cheung & Tony Chen & Alex Vanstone & Jake Love & Holly Holder & Francesco Caravelli & Hidekazu Kurebayashi & Karin Everschor-, 2024. "Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    2. Klaus Raab & Maarten A. Brems & Grischa Beneke & Takaaki Dohi & Jan Rothörl & Fabian Kammerbauer & Johan H. Mentink & Mathias Kläui, 2022. "Brownian reservoir computing realized using geometrically confined skyrmion dynamics," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    3. Martina Ahlberg & Sunjae Chung & Sheng Jiang & Andreas Frisk & Maha Khademi & Roman Khymyn & Ahmad A. Awad & Q. Tuan Le & Hamid Mazraati & Majid Mohseni & Markus Weigand & Iuliia Bykova & Felix Groß &, 2022. "Freezing and thawing magnetic droplet solitons," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    4. Jérémie Laydevant & Danijela Marković & Julie Grollier, 2024. "Training an Ising machine with equilibrium propagation," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    5. Ke Yang & Yanghao Wang & Pek Jun Tiw & Chaoming Wang & Xiaolong Zou & Rui Yuan & Chang Liu & Ge Li & Chen Ge & Si Wu & Teng Zhang & Ru Huang & Yuchao Yang, 2024. "High-order sensory processing nanocircuit based on coupled VO2 oscillators," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. ZhuangEn Fu & Piumi I. Samarawickrama & John Ackerman & Yanglin Zhu & Zhiqiang Mao & Kenji Watanabe & Takashi Taniguchi & Wenyong Wang & Yuri Dahnovsky & Mingzhong Wu & TeYu Chien & Jinke Tang & Allan, 2024. "Tunneling current-controlled spin states in few-layer van der Waals magnets," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    7. Mitsumasa Nakajima & Katsuma Inoue & Kenji Tanaka & Yasuo Kuniyoshi & Toshikazu Hashimoto & Kohei Nakajima, 2022. "Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    8. Steffen Wittrock & Salvatore Perna & Romain Lebrun & Katia Ho & Roberta Dutra & Ricardo Ferreira & Paolo Bortolotti & Claudio Serpico & Vincent Cros, 2024. "Non-hermiticity in spintronics: oscillation death in coupled spintronic nano-oscillators through emerging exceptional points," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    9. Kang Wang & Yiou Zhang & Vineetha Bheemarasetty & Shiyu Zhou & See-Chen Ying & Gang Xiao, 2022. "Single skyrmion true random number generator using local dynamics and interaction between skyrmions," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    10. Jong-Guk Choi & Jaehyeon Park & Min-Gu Kang & Doyoon Kim & Jae-Sung Rieh & Kyung-Jin Lee & Kab-Jin Kim & Byong-Guk Park, 2022. "Voltage-driven gigahertz frequency tuning of spin Hall nano-oscillators," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    11. Miguel Romera & Philippe Talatchian & Sumito Tsunegi & Kay Yakushiji & Akio Fukushima & Hitoshi Kubota & Shinji Yuasa & Vincent Cros & Paolo Bortolotti & Maxence Ernoult & Damien Querlioz & Julie Grol, 2022. "Binding events through the mutual synchronization of spintronic nano-neurons," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    12. Chao Yun & Zhongyu Liang & Aleš Hrabec & Zhentao Liu & Mantao Huang & Leran Wang & Yifei Xiao & Yikun Fang & Wei Li & Wenyun Yang & Yanglong Hou & Jinbo Yang & Laura J. Heyderman & Pietro Gambardella , 2023. "Electrically programmable magnetic coupling in an Ising network exploiting solid-state ionic gating," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    13. Lukas Körber & Christopher Heins & Tobias Hula & Joo-Von Kim & Sonia Thlang & Helmut Schultheiss & Jürgen Fassbender & Katrin Schultheiss, 2023. "Pattern recognition in reciprocal space with a magnon-scattering reservoir," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    14. Nihal Sanjay Singh & Keito Kobayashi & Qixuan Cao & Kemal Selcuk & Tianrui Hu & Shaila Niazi & Navid Anjum Aadit & Shun Kanai & Hideo Ohno & Shunsuke Fukami & Kerem Y. Camsari, 2024. "CMOS plus stochastic nanomagnets enabling heterogeneous computers for probabilistic inference and learning," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    15. Oleksii M. Volkov & Oleksandr V. Pylypovskyi & Fabrizio Porrati & Florian Kronast & Jose A. Fernandez-Roldan & Attila Kákay & Alexander Kuprava & Sven Barth & Filipp N. Rybakov & Olle Eriksson & Sebas, 2024. "Three-dimensional magnetic nanotextures with high-order vorticity in soft magnetic wireframes," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    16. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    17. John Daniel & Zheng Sun & Xuejian Zhang & Yuanqiu Tan & Neil Dilley & Zhihong Chen & Joerg Appenzeller, 2024. "Experimental demonstration of an on-chip p-bit core based on stochastic magnetic tunnel junctions and 2D MoS2 transistors," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    18. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    19. Davide Girardi & Simone Finizio & Claire Donnelly & Guglielmo Rubini & Sina Mayr & Valerio Levati & Simone Cuccurullo & Federico Maspero & Jörg Raabe & Daniela Petti & Edoardo Albisetti, 2024. "Three-dimensional spin-wave dynamics, localization and interference in a synthetic antiferromagnet," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    20. Long Liu & Di Wang & Dandan Wang & Yan Sun & Huai Lin & Xiliang Gong & Yifan Zhang & Ruifeng Tang & Zhihong Mai & Zhipeng Hou & Yumeng Yang & Peng Li & Lan Wang & Qing Luo & Ling Li & Guozhong Xing & , 2024. "Domain wall magnetic tunnel junction-based artificial synapses and neurons for all-spin neuromorphic hardware," Nature Communications, Nature, vol. 15(1), pages 1-12, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-28571-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.