IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-41379-3.html
   My bibliography  Save this article

Model-free tracking control of complex dynamical trajectories with machine learning

Author

Listed:
  • Zheng-Meng Zhai

    (Arizona State University)

  • Mohammadamin Moradi

    (Arizona State University)

  • Ling-Wei Kong

    (Arizona State University)

  • Bryan Glaz

    (DEVCOM Army Research Laboratory)

  • Mulugeta Haile

    (DEVCOM Army Research Laboratory)

  • Ying-Cheng Lai

    (Arizona State University
    Arizona State University)

Abstract

Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially observed states, where the controller is realized by reservoir computing. Stochastic input is exploited for training, which consists of the observed partial state vector as the first and its immediate future as the second component so that the neural machine regards the latter as the future state of the former. In the testing (deployment) phase, the immediate-future component is replaced by the desired observational vector from the reference trajectory. We demonstrate the effectiveness of the control framework using a variety of periodic and chaotic signals, and establish its robustness against measurement noise, disturbances, and uncertainties.

Suggested Citation

  • Zheng-Meng Zhai & Mohammadamin Moradi & Ling-Wei Kong & Bryan Glaz & Mulugeta Haile & Ying-Cheng Lai, 2023. "Model-free tracking control of complex dynamical trajectories with machine learning," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41379-3
    DOI: 10.1038/s41467-023-41379-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-41379-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-41379-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Junjie Jiang & Ying-Cheng Lai, 2019. "Irrelevance of linear controllability to nonlinear dynamical networks," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    2. L. Appeltant & M.C. Soriano & G. Van der Sande & J. Danckaert & S. Massar & J. Dambre & B. Schrauwen & C.R. Mirasso & I. Fischer, 2011. "Information processing using a single dynamical node as complex system," Nature Communications, Nature, vol. 2(1), pages 1-6, September.
    3. Daniel J. Gauthier & Erik Bollt & Aaron Griffith & Wendson A. S. Barbosa, 2021. "Next generation reservoir computing," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert M. Kent & Wendson A. S. Barbosa & Daniel J. Gauthier, 2024. "Controlling chaos using edge computing hardware," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    2. Ling-Wei Kong & Gene A. Brewer & Ying-Cheng Lai, 2024. "Reservoir-computing based associative memory and itinerancy for complex dynamical attractors," Nature Communications, Nature, vol. 15(1), pages 1-14, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhiyuan Li & Zhongshao Li & Wei Tang & Jiaping Yao & Zhipeng Dou & Junjie Gong & Yongfei Li & Beining Zhang & Yunxiao Dong & Jian Xia & Lin Sun & Peng Jiang & Xun Cao & Rui Yang & Xiangshui Miao & Ron, 2024. "Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Lina Jaurigue & Kathy Lüdge, 2022. "Connecting reservoir computing with statistical forecasting and deep neural networks," Nature Communications, Nature, vol. 13(1), pages 1-3, December.
    3. Ling-Wei Kong & Gene A. Brewer & Ying-Cheng Lai, 2024. "Reservoir-computing based associative memory and itinerancy for complex dynamical attractors," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    4. Min Yan & Can Huang & Peter Bienstman & Peter Tino & Wei Lin & Jie Sun, 2024. "Emerging opportunities and challenges for the future of reservoir computing," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    5. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    7. Suresh, R. & Senthilkumar, D.V. & Lakshmanan, M. & Kurths, J., 2016. "Emergence of a common generalized synchronization manifold in network motifs of structurally different time-delay systems," Chaos, Solitons & Fractals, Elsevier, vol. 93(C), pages 235-245.
    8. Keck, Felix & Jütte, Silke & Lenzen, Manfred & Li, Mengyu, 2022. "Assessment of two optimisation methods for renewable energy capacity expansion planning," Applied Energy, Elsevier, vol. 306(PA).
    9. Yang, J. & Primo, E. & Aleja, D. & Criado, R. & Boccaletti, S. & Alfaro-Bittner, K., 2022. "Implementing and morphing Boolean gates with adaptive synchronization: The case of spiking neurons," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    10. Hu, Wancheng & Zhang, Yibin & Ma, Rencai & Dai, Qionglin & Yang, Junzhong, 2022. "Synchronization between two linearly coupled reservoir computers," Chaos, Solitons & Fractals, Elsevier, vol. 157(C).
    11. Zhongfang Zhang & Xiaolong Zhao & Xumeng Zhang & Xiaohu Hou & Xiaolan Ma & Shuangzhu Tang & Ying Zhang & Guangwei Xu & Qi Liu & Shibing Long, 2022. "In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    12. Graciela Schiliuk & Iader Giraldo, 2021. "Regional responses to the Covid-19 crisis: a comparative study from economic, policy, and institutional perspectives," Documentos de Discusión FLAR 19734, Fondo Latino Americano de Reservas - FLAR.
    13. Alen Senanian & Sridhar Prabhu & Vladimir Kremenetski & Saswata Roy & Yingkang Cao & Jeremy Kline & Tatsuhiro Onodera & Logan G. Wright & Xiaodi Wu & Valla Fatemi & Peter L. McMahon, 2024. "Microwave signal processing using an analog quantum reservoir computer," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    14. Laura E. Suárez & Agoston Mihalik & Filip Milisav & Kenji Marshall & Mingze Li & Petra E. Vértes & Guillaume Lajoie & Bratislav Misic, 2024. "Connectome-based reservoir computing with the conn2res toolbox," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    15. Minati, Ludovico & Bartels, Jim & Li, Chao & Frasca, Mattia & Ito, Hiroyuki, 2022. "Synchronization phenomena in dual-transistor spiking oscillators realized experimentally towards physical reservoirs," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    16. Tao Wu & Xiangyun Gao & Feng An & Xiaotian Sun & Haizhong An & Zhen Su & Shraddha Gupta & Jianxi Gao & Jürgen Kurths, 2024. "Predicting multiple observations in complex systems through low-dimensional embeddings," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    17. Lukas Körber & Christopher Heins & Tobias Hula & Joo-Von Kim & Sonia Thlang & Helmut Schultheiss & Jürgen Fassbender & Katrin Schultheiss, 2023. "Pattern recognition in reciprocal space with a magnon-scattering reservoir," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    18. Wang, Tao & Zhou, Hanxu & Fang, Qing & Han, Yanan & Guo, Xingxing & Zhang, Yahui & Qian, Chao & Chen, Hongsheng & Barland, Stéphane & Xiang, Shuiying & Lippi, Gian Luca, 2024. "Reservoir computing-based advance warning of extreme events," Chaos, Solitons & Fractals, Elsevier, vol. 181(C).
    19. Gianluca Fabiani & Nikolaos Evangelou & Tianqi Cui & Juan M. Bello-Rivas & Cristina P. Martin-Linares & Constantinos Siettos & Ioannis G. Kevrekidis, 2024. "Task-oriented machine learning surrogates for tipping points of agent-based models," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    20. Zequn Lin & Zhaofan Lu & Zengru Di & Ying Tang, 2024. "Learning noise-induced transitions by multi-scaling reservoir computing," Nature Communications, Nature, vol. 15(1), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41379-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.