IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v479y2024ics0096300324003011.html
   My bibliography  Save this article

Reinforcement learning-based secure synchronization for two-time-scale complex dynamical networks with malicious attacks

Author

Listed:
  • Huang, He
  • Xu, Jiawei
  • Wang, Jing
  • Chen, Xiangyong

Abstract

This paper studies the secure synchronization problem for two-time-scale complex dynamical networks with unknown dynamics information and malicious attacks. The challenge is that under complex dynamic networks with unknown dynamic information, all system matrices are unknown. To ameliorate this conundrum, we design a reinforcement learning algorithm, conjoined with a full-order processing of singularly perturbed parameters, with the express objective of securing the stability of the synchronization error system within a context devoid of adversarial intrusions. Second, in order to reduce the impact of malicious attacks, a switching function is developed based on feedback gain. Besides, it is proved that the proposed distributed controllers can still guarantee the convergence of the synchronization error system under malicious attacks. Finally, two numerical examples are given to illustrate the applicability and effectiveness of the proposed algorithm.

Suggested Citation

  • Huang, He & Xu, Jiawei & Wang, Jing & Chen, Xiangyong, 2024. "Reinforcement learning-based secure synchronization for two-time-scale complex dynamical networks with malicious attacks," Applied Mathematics and Computation, Elsevier, vol. 479(C).
    • Handle: RePEc:eee:apmaco:v:479:y:2024:i:c:s0096300324003011
    DOI: 10.1016/j.amc.2024.128840
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300324003011
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.amc.2024.128840?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cui, Qian & Li, Lulu & Lu, Jianquan & Alofi, Abdulaziz, 2022. "Finite-time synchronization of complex dynamical networks under delayed impulsive effects," Applied Mathematics and Computation, Elsevier, vol. 430(C).
    2. Jun Hu & Chaoqing Jia & Hongjian Liu & Xiaojian Yi & Yurong Liu, 2021. "A survey on state estimation of complex dynamical networks," International Journal of Systems Science, Taylor & Francis Journals, vol. 52(16), pages 3351-3367, December.
    3. Wu, Zhenyu & Chen, Jiawei & Zhang, Xuexi & Xiao, Zehui & Tao, Jie & Wang, Xiaofeng, 2022. "Dynamic event-triggered synchronization of complex networks with switching topologies: Asynchronous observer-based case," Applied Mathematics and Computation, Elsevier, vol. 435(C).
    4. Tian, Meng & Dong, Zhengcheng & Wang, Xianpei, 2021. "Reinforcement learning approach for robustness analysis of complex networks with incomplete information," Chaos, Solitons & Fractals, Elsevier, vol. 144(C).
    5. Zhao, Younan & Gu, Peng & Zhu, Fanglai & Liu, Tianyi & Shen, Runjie, 2023. "Security control scheme for cyber-physical system with a complex network in physical layer against false data injection attacks," Applied Mathematics and Computation, Elsevier, vol. 447(C).
    6. Sivaranjani, K. & Rakkiyappan, R. & Cao, Jinde & Alsaedi, Ahmed, 2017. "Synchronization of nonlinear singularly perturbed complex networks with uncertain inner coupling via event triggered control," Applied Mathematics and Computation, Elsevier, vol. 311(C), pages 283-299.
    7. Ding, Dong & Tang, Ze & Wang, Yan & Ji, Zhicheng, 2021. "Secure synchronization of complex networks under deception attacks against vulnerable nodes," Applied Mathematics and Computation, Elsevier, vol. 399(C).
    8. Dong, Lewei & Xu, Huiling & Zhang, Liming & Li, Zhengcai & Chen, Yuqing, 2023. "Adjustable proportional-integral multivariable observer-based FDI attack dynamic reconstitution and secure control for cyber-physical systems," Applied Mathematics and Computation, Elsevier, vol. 443(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Xin & Lei, Anzhi & Zhu, Liangkuan & Ban, Mingfei, 2024. "Improving Kalman filter for cyber physical systems subject to replay attacks: An attack-detection-based compensation strategy," Applied Mathematics and Computation, Elsevier, vol. 466(C).
    2. Chen, Tianrui & Fan, Zezhou & Wang, Wenhua & Li, Wenxue, 2024. "Practical stabilization of multi-links highly nonlinear Takagi-Sugeno fuzzy complex networks with Lévy noise based on aperiodically intermittent discrete-time observation control," Applied Mathematics and Computation, Elsevier, vol. 476(C).
    3. Li, Chengren & Lü, Ling & Li, Gang & Zhao, Guannan & Gao, Liyu & Ge, Lianjun & Han, Changhui, 2019. "Cluster synchronization in uncertain network with nonidentical nodes based on adaptive pinning control," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 742-749.
    4. Luo, Mengzhuo & Cheng, Jun & Liu, Xinzhi & Zhong, Shouming, 2019. "An extended synchronization analysis for memristor-based coupled neural networks via aperiodically intermittent control," Applied Mathematics and Computation, Elsevier, vol. 344, pages 163-182.
    5. Luo, Mengzhuo & Liu, Xinzhi & Zhong, Shouming & Cheng, Jun, 2018. "Synchronization of multi-stochastic-link complex networks via aperiodically intermittent control with two different switched periods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 509(C), pages 20-38.
    6. Liang, Kun & Dai, Mingcheng & Shen, Hao & Wang, Jing & Wang, Zhen & Chen, Bo, 2018. "L2−L∞ synchronization for singularly perturbed complex networks with semi-Markov jump topology," Applied Mathematics and Computation, Elsevier, vol. 321(C), pages 450-462.
    7. Guo, Beibei & Wu, Yinhu & Xiao, Yu & Zhang, Chiping, 2018. "Graph-theoretic approach to synchronizing stochastic coupled systems with time-varying delays on networks via periodically intermittent control," Applied Mathematics and Computation, Elsevier, vol. 331(C), pages 341-357.
    8. Xian Xi & Xiangyun Gao & Xiaotian Sun & Huiling Zheng & Congcong Wu, 2024. "Dynamic analysis and application of network structure control in risk conduction in the industrial chain," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    9. Yin, Rongrong & Wang, Yumeng & Li, Linhui & Zhang, Le & Hao, Zhenyang & Lang, Chun, 2024. "A mobile node path optimization approach based on Q-learning to defend against cascading failures on static-mobile networks," Chaos, Solitons & Fractals, Elsevier, vol. 182(C).
    10. Tu, Haicheng & Gu, Fengqiang & Zhang, Xi & Xia, Yongxiang, 2023. "Robustness analysis of power system under sequential attacks with incomplete information," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    11. Lü, Ling & Li, Chengren & Bai, Suyuan & Li, Gang & Yan, Zhe & Rong, Tingting & Gao, Yan, 2018. "Synchronization between uncertain time-delayed networks with multi-link and different topologies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 506(C), pages 635-643.
    12. Zhang, Shuai & Yang, Yongqing & Sui, Xin & Xu, Xianyu, 2019. "Finite-time synchronization of memristive neural networks with parameter uncertainties via aperiodically intermittent adjustment," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    13. Li, Qiaoping & Liu, Sanyang & Chen, Yonggang, 2018. "Combination event-triggered adaptive networked synchronization communication for nonlinear uncertain fractional-order chaotic systems," Applied Mathematics and Computation, Elsevier, vol. 333(C), pages 521-535.
    14. Mazare, Mahmood, 2024. "Adaptive optimal secure wind power generation control for variable speed wind turbine systems via reinforcement learning," Applied Energy, Elsevier, vol. 353(PA).
    15. Zheng, Xiaoyuan & Kang, Yu & Li, Hongyi & Li, Jitao, 2023. "Multiple description encoding-decoding-based resilient filtering for complex networks under the round-Robin protocol," Applied Mathematics and Computation, Elsevier, vol. 458(C).
    16. Li, Jiaxing & Hu, Jun & Cheng, Jun & Wei, Yunliang & Yu, Hui, 2022. "Distributed filtering for time-varying state-saturated systems with packet disorders: An event-triggered case," Applied Mathematics and Computation, Elsevier, vol. 434(C).
    17. Yang, Huilan & Wang, Xin & Zhong, Shouming & Shu, Lan, 2018. "Synchronization of nonlinear complex dynamical systems via delayed impulsive distributed control," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 75-85.
    18. Zhuang, Jiawei & Peng, Shiguo & Wang, Yonghua, 2022. "Exponential consensus of stochastic discrete multi-agent systems under DoS attacks via periodically intermittent control: An impulsive framework," Applied Mathematics and Computation, Elsevier, vol. 433(C).
    19. Fang, Qi & Wang, Mingzhu & Li, Xiaodi, 2023. "Event-triggered distributed delayed impulsive control for nonlinear systems with applications to complex networks," Chaos, Solitons & Fractals, Elsevier, vol. 175(P1).
    20. Zhao, Yanwei & Wang, Huanqing & Xu, Ning & Zong, Guangdeng & Zhao, Xudong, 2023. "Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:479:y:2024:i:c:s0096300324003011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.