IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v216y2021ics0951832021004774.html
   My bibliography  Save this article

Dynamic game-based defensive primary frequency control system considering intelligent attackers

Author

Listed:
  • Ding, Zhetong
  • Chen, Chunyu
  • Cui, Mingjian
  • Bi, Wenjun
  • Chen, Yang
  • Li, Fangxing

Abstract

Due to cyber security vulnerabilities of electrical cyber physical systems, cyber attacks against frequency-active power controllers become an emerging problem. Cyber attack-tolerant frequency control strategies are thus presented to reduce abnormal frequency excursions. These strategies mainly treat attackers as ‘dumb’ agents. However, attackers in some situations are more like ‘intelligent’ agents with initiative, who can actively and purposefully respond by considering actions of defenders. In this paper, this actively confrontational interaction is modeled by a dynamic game. We propose two types of game scenarios in the primary frequency control system. Improved Nash equilibrium-based defending strategies are studied using reinforcement learning algorithms. By testing the proposed dynamic game-based strategies on the benchmark system, the validity is verified. The proposed analytical procedure concerning dynamic games can also be extended to the study of other industrial control applications.

Suggested Citation

  • Ding, Zhetong & Chen, Chunyu & Cui, Mingjian & Bi, Wenjun & Chen, Yang & Li, Fangxing, 2021. "Dynamic game-based defensive primary frequency control system considering intelligent attackers," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    • Handle: RePEc:eee:reensy:v:216:y:2021:i:c:s0951832021004774
    DOI: 10.1016/j.ress.2021.107966
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021004774
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2021.107966?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lalropuia, K.C. & Gupta, Vandana, 2019. "Modeling cyber-physical attacks based on stochastic game and Markov processes," Reliability Engineering and System Safety, Elsevier, vol. 181(C), pages 28-37.
    2. Rezazadeh, Amirali & Talarico, Luca & Reniers, Genserik & Cozzani, Valerio & Zhang, Laobing, 2019. "Applying game theory for securing oil and gas pipelines against terrorism," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    3. Dai, Xuemei & Li, Yaping & Zhang, Kaifeng & Feng, Wei, 2020. "A robust offering strategy for wind producers considering uncertainties of demand response and wind power," Applied Energy, Elsevier, vol. 279(C).
    4. Shan, Xiaojun Gene & Zhuang, Jun, 2020. "A game-theoretic approach to modeling attacks and defenses of smart grids at three levels," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    5. Zang, Tianlei & Gao, Shibin & Liu, Baoxu & Huang, Tao & Wang, Tao & Wei, Xiaoguang, 2019. "Integrated fault propagation model based vulnerability assessment of the electrical cyber-physical system under cyber attacks," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 232-241.
    6. Zhao, Yunfei & Huang, Linan & Smidts, Carol & Zhu, Quanyan, 2020. "Finite-horizon semi-Markov game for time-sensitive attack response and probabilistic risk assessment in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    7. Chen, Chunyu & Cui, Mingjian & Fang, Xin & Ren, Bixing & Chen, Yang, 2020. "Load altering attack-tolerant defense strategy for load frequency control system," Applied Energy, Elsevier, vol. 280(C).
    8. Woodard, Mark & Marashi, Koosha & Sedigh Sarvestani, Sahra & Hurson, Ali R., 2021. "Survivability evaluation and importance analysis for cyber–physical smart grids," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    9. Fan, Shuai & Liu, Jiang & Wu, Qing & Cui, Mingjian & Zhou, Huan & He, Guangyu, 2020. "Optimal coordination of virtual power plant with photovoltaics and electric vehicles: A temporally coupled distributed online algorithm," Applied Energy, Elsevier, vol. 277(C).
    10. Lai, Kexing & Illindala, Mahesh & Subramaniam, Karthikeyan, 2019. "A tri-level optimization model to mitigate coordinated attacks on electric power systems in a cyber-physical environment," Applied Energy, Elsevier, vol. 235(C), pages 204-218.
    11. Shan, Xiaojun & Zhuang, Jun, 2018. "Modeling cumulative defensive resource allocation against a strategic attacker in a multi-period multi-target sequential game," Reliability Engineering and System Safety, Elsevier, vol. 179(C), pages 12-26.
    12. Ding, Weiyong & Xu, Maochao & Huang, Yu & Zhao, Peng & Song, Fengyi, 2021. "Cyber attacks on PMU placement in a smart grid: Characterization and optimization," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Badrsimaei, Hamed & Hooshmand, Rahmat-Allah & Nobakhtian, Soghra, 2023. "Observable placement of phasor measurement units for defense against data integrity attacks in real time power markets," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    2. Berghout, Tarek & Benbouzid, Mohamed, 2022. "EL-NAHL: Exploring labels autoencoding in augmented hidden layers of feedforward neural networks for cybersecurity in smart grids," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Liu, Xuan & Meng, Huixing & An, Xu & Xing, Jinduo, 2024. "Integration of functional resonance analysis method and reinforcement learning for updating and optimizing emergency procedures in variable environments," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Diao, Xiaoxu & Zhao, Yunfei & Smidts, Carol & Vaddi, Pavan Kumar & Li, Ruixuan & Lei, Hangtian & Chakhchoukh, Yacine & Johnson, Brian & Blanc, Katya Le, 2024. "Dynamic probabilistic risk assessment for electric grid cybersecurity," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Zhang, Xi & Liu, Dong & Tu, Haicheng & Tse, Chi Kong, 2022. "An integrated modeling framework for cascading failure study and robustness assessment of cyber-coupled power grids," Reliability Engineering and System Safety, Elsevier, vol. 226(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Shimeng & Jiang, Yuchen & Luo, Hao & Zhang, Jiusi & Yin, Shen & Kaynak, Okyay, 2022. "An integrated data-driven scheme for the defense of typical cyber–physical attacks," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    2. Hunt, Kyle & Zhuang, Jun, 2024. "A review of attacker-defender games: Current state and paths forward," European Journal of Operational Research, Elsevier, vol. 313(2), pages 401-417.
    3. Lin, Chen & Xiao, Hui & Kou, Gang & Peng, Rui, 2020. "Defending a series system with individual protection, overarching protection, and disinformation," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    4. Diao, Xiaoxu & Zhao, Yunfei & Smidts, Carol & Vaddi, Pavan Kumar & Li, Ruixuan & Lei, Hangtian & Chakhchoukh, Yacine & Johnson, Brian & Blanc, Katya Le, 2024. "Dynamic probabilistic risk assessment for electric grid cybersecurity," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Wang, Wei & Cova, Gregorio & Zio, Enrico, 2022. "A clustering-based framework for searching vulnerabilities in the operation dynamics of Cyber-Physical Energy Systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    6. Berghout, Tarek & Benbouzid, Mohamed, 2022. "EL-NAHL: Exploring labels autoencoding in augmented hidden layers of feedforward neural networks for cybersecurity in smart grids," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    7. Dong, Zhengcheng & Tian, Meng & Li, Xin & Lai, Jingang & Tang, Ruoli, 2022. "Mitigating cascading failures of spatially embedded cyber–physical power systems by adding additional information links," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    8. Wu, Yipeng & Chen, Zhilong & Dang, Junhu & Chen, Yicun & Zhao, Xudong & Zha, Lvying, 2022. "Allocation of defensive and restorative resources in electric power system against consecutive multi-target attacks," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    9. Hausken, Kjell, 2024. "Fifty Years of Operations Research in Defense," European Journal of Operational Research, Elsevier, vol. 318(2), pages 355-368.
    10. Zhang, Jing & Wang, Yan & Zhuang, Jun, 2021. "Modeling multi-target defender-attacker games with quantal response attack strategies," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    11. Zhang, Xi & Liu, Dong & Tu, Haicheng & Tse, Chi Kong, 2022. "An integrated modeling framework for cascading failure study and robustness assessment of cyber-coupled power grids," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    12. Zhang, Xiaoxiong & Ding, Song & Ge, Bingfeng & Xia, Boyuan & Pedrycz, Witold, 2021. "Resource allocation among multiple targets for a defender-attacker game with false targets consideration," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    13. Zekai Xu & Jinghan He & Zhao Liu & Zhiyi Zhao, 2023. "Collaborative Optimization of Transmission and Distribution Considering Energy Storage Systems on Both Sides of Transmission and Distribution," Energies, MDPI, vol. 16(13), pages 1-23, July.
    14. Wang, Hongping & Fang, Yi-Ping & Zio, Enrico, 2022. "Resilience-oriented optimal post-disruption reconfiguration for coupled traffic-power systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    15. Tan, Bifei & Chen, Simin & Liang, Zipeng & Zheng, Xiaodong & Zhu, Yanjin & Chen, Haoyong, 2024. "An iteration-free hierarchical method for the energy management of multiple-microgrid systems with renewable energy sources and electric vehicles," Applied Energy, Elsevier, vol. 356(C).
    16. Monzer, Mohamad-Houssein & Beydoun, Kamal & Ghaith, Alaa & Flaus, Jean-Marie, 2022. "Model-based IDS design for ICSs," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    17. Konrad, Kai A. & Morath, Florian, 2023. "How to preempt attacks in multi-front conflict with limited resources," European Journal of Operational Research, Elsevier, vol. 305(1), pages 493-500.
    18. Ju, Liwei & Yin, Zhe & Lu, Xiaolong & Yang, Shenbo & Li, Peng & Rao, Rao & Tan, Zhongfu, 2022. "A Tri-dimensional Equilibrium-based stochastic optimal dispatching model for a novel virtual power plant incorporating carbon Capture, Power-to-Gas and electric vehicle aggregator," Applied Energy, Elsevier, vol. 324(C).
    19. Zhao, Yunfei & Huang, Linan & Smidts, Carol & Zhu, Quanyan, 2020. "Finite-horizon semi-Markov game for time-sensitive attack response and probabilistic risk assessment in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    20. Kartick Bhushan & Somnath Chattopadhyaya & Shubham Sharma & Kamal Sharma & Changhe Li & Yanbin Zhang & Elsayed Mohamed Tag Eldin, 2022. "Analyzing Reliability and Maintainability of Crawler Dozer BD155 Transmission Failure Using Markov Method and Total Productive Maintenance: A Novel Case Study for Improvement Productivity," Sustainability, MDPI, vol. 14(21), pages 1-17, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:216:y:2021:i:c:s0951832021004774. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.