IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v201y2020ics0951832019310142.html
   My bibliography  Save this article

Finite-horizon semi-Markov game for time-sensitive attack response and probabilistic risk assessment in nuclear power plants

Author

Listed:
  • Zhao, Yunfei
  • Huang, Linan
  • Smidts, Carol
  • Zhu, Quanyan

Abstract

Cybersecurity has drawn increasing attention in the nuclear industry. To improve the cyber-security posture, it is important to develop effective methods for cyber-attack response and cyber-security risk assessment. In this research, we develop a finite-horizon semi-Markov general-sum game between the defender (i.e., plant operator) and the attacker to obtain the time-sensitive attack response strategy and the real-time risk assessment in nuclear power plants. We propose methods for identifying system states of concern to reduce the state space and for determining state transition probabilities by integrating probabilistic risk assessment techniques. After a proper discretization of the developed continuous-time model, we use dynamic programming to derive the time-varying and state-dependent strategy of the defender based on the solution concept of the mixed-strategy Nash equilibrium. For risk assessment, three risk metrics are considered, and an exact analytical algorithm and a Monte Carlo simulation-based algorithm for obtaining the metrics are developed. Both players’ strategies and the risk metrics are illustrated using a digital feedwater control system used in pressurized water reactors. The results show that the proposed method can support plant operators in timely cyber-attack response and effective risk assessment, reduce the risk, and improve the resilience of nuclear power plants to malicious cyber-attacks.

Suggested Citation

  • Zhao, Yunfei & Huang, Linan & Smidts, Carol & Zhu, Quanyan, 2020. "Finite-horizon semi-Markov game for time-sensitive attack response and probabilistic risk assessment in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
  • Handle: RePEc:eee:reensy:v:201:y:2020:i:c:s0951832019310142
    DOI: 10.1016/j.ress.2020.106878
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832019310142
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.106878?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lalropuia, K.C. & Gupta, Vandana, 2019. "Modeling cyber-physical attacks based on stochastic game and Markov processes," Reliability Engineering and System Safety, Elsevier, vol. 181(C), pages 28-37.
    2. M.‐Elisabeth Paté‐Cornell & Marshall Kuypers & Matthew Smith & Philip Keller, 2018. "Cyber Risk Management for Critical Infrastructure: A Risk Analysis Model and Three Case Studies," Risk Analysis, John Wiley & Sons, vol. 38(2), pages 226-241, February.
    3. Chen, Dongyan & Trivedi, Kishor S., 2005. "Optimization for condition-based maintenance with semi-Markov decision process," Reliability Engineering and System Safety, Elsevier, vol. 90(1), pages 25-29.
    4. Richard Denning & Vinod Mubayi, 2017. "Insights into the Societal Risk of Nuclear Power Plant Accidents," Risk Analysis, John Wiley & Sons, vol. 37(1), pages 160-172, January.
    5. Zhang, Jing & Zhuang, Jun, 2019. "Modeling a multi-target attacker-defender game with multiple attack types," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 465-475.
    6. John W. Mamer, 1986. "Successive Approximations for Finite Horizon, Semi-Markov Decision Processes with Application to Asset Liquidation," Operations Research, INFORMS, vol. 34(4), pages 638-644, August.
    7. Kjell Hausken, 2002. "Probabilistic Risk Analysis and Game Theory," Risk Analysis, John Wiley & Sons, vol. 22(1), pages 17-27, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhiyong Li & Wubin Wen & Rende Dai & Wanting Xi, 2022. "Reliability Evaluation of Smart Substation Based on Time-Varying Probabilistic Hybrid Attack Graph," Energies, MDPI, vol. 15(18), pages 1-15, September.
    2. Antonello, Federico & Buongiorno, Jacopo & Zio, Enrico, 2022. "A methodology to perform dynamic risk assessment using system theory and modeling and simulation: Application to nuclear batteries," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    3. Ding, Zhetong & Chen, Chunyu & Cui, Mingjian & Bi, Wenjun & Chen, Yang & Li, Fangxing, 2021. "Dynamic game-based defensive primary frequency control system considering intelligent attackers," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    4. Alanen, Jarmo & Linnosmaa, Joonas & Malm, Timo & Papakonstantinou, Nikolaos & Ahonen, Toni & Heikkilä, Eetu & Tiusanen, Risto, 2022. "Hybrid ontology for safety, security, and dependability risk assessments and Security Threat Analysis (STA) method for industrial control systems," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    5. Takeda, Satoshi & Kitada, Takanori, 2021. "Simple method based on sensitivity coefficient for stochastic uncertainty analysis in probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    6. Berghout, Tarek & Benbouzid, Mohamed, 2022. "EL-NAHL: Exploring labels autoencoding in augmented hidden layers of feedforward neural networks for cybersecurity in smart grids," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    7. Diao, Xiaoxu & Zhao, Yunfei & Smidts, Carol & Vaddi, Pavan Kumar & Li, Ruixuan & Lei, Hangtian & Chakhchoukh, Yacine & Johnson, Brian & Blanc, Katya Le, 2024. "Dynamic probabilistic risk assessment for electric grid cybersecurity," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Dariusz Gołȩbiewski & Tomasz Barszcz & Wioletta Skrodzka & Igor Wojnicki & Andrzej Bielecki, 2022. "A New Approach to Risk Management in the Power Industry Based on Systems Theory," Energies, MDPI, vol. 15(23), pages 1-19, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Xueqing & Gao, Hui, 2012. "Road maintenance optimization through a discrete-time semi-Markov decision process," Reliability Engineering and System Safety, Elsevier, vol. 103(C), pages 110-119.
    2. Insua, David Rios & Ruggeri, Fabrizio & Soyer, Refik & Wilson, Simon, 2020. "Advances in Bayesian decision making in reliability," European Journal of Operational Research, Elsevier, vol. 282(1), pages 1-18.
    3. Chatwin, Richard E., 2000. "Optimal dynamic pricing of perishable products with stochastic demand and a finite set of prices," European Journal of Operational Research, Elsevier, vol. 125(1), pages 149-174, August.
    4. Daniel Woods & Mustafa Abdallah & Saurabh Bagchi & Shreyas Sundaram & Timothy Cason, 2022. "Network defense and behavioral biases: an experimental study," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 254-286, February.
    5. Maria Polorecka & Jozef Kubas & Pavel Danihelka & Katarina Petrlova & Katarina Repkova Stofkova & Katarina Buganova, 2021. "Use of Software on Modeling Hazardous Substance Release as a Support Tool for Crisis Management," Sustainability, MDPI, vol. 13(1), pages 1-15, January.
    6. Lin, Chen & Xiao, Hui & Kou, Gang & Peng, Rui, 2020. "Defending a series system with individual protection, overarching protection, and disinformation," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    7. Banerjee, Pradeep K. & Turner, T. Rolf, 2012. "A flexible model for the pricing of perishable assets," Omega, Elsevier, vol. 40(5), pages 533-540.
    8. Claus Dierksmeier, 2020. "From Jensen to Jensen: Mechanistic Management Education or Humanistic Management Learning?," Journal of Business Ethics, Springer, vol. 166(1), pages 73-87, September.
    9. Huixia Huo, 2024. "Optimal Corrective Maintenance Policies via an Availability-Cost Hybrid Factor for Software Aging Systems," Mathematics, MDPI, vol. 12(5), pages 1-14, February.
    10. Kartick Bhushan & Somnath Chattopadhyaya & Shubham Sharma & Kamal Sharma & Changhe Li & Yanbin Zhang & Elsayed Mohamed Tag Eldin, 2022. "Analyzing Reliability and Maintainability of Crawler Dozer BD155 Transmission Failure Using Markov Method and Total Productive Maintenance: A Novel Case Study for Improvement Productivity," Sustainability, MDPI, vol. 14(21), pages 1-17, November.
    11. Zhou, Zhi-Jie & Hu, Chang-Hua & Xu, Dong-Ling & Chen, Mao-Yin & Zhou, Dong-Hua, 2010. "A model for real-time failure prognosis based on hidden Markov model and belief rule base," European Journal of Operational Research, Elsevier, vol. 207(1), pages 269-283, November.
    12. Andrew Samuel & Seth D. Guikema, 2012. "Resource Allocation for Homeland Defense: Dealing with the Team Effect," Decision Analysis, INFORMS, vol. 9(3), pages 238-252, September.
    13. Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
    14. Olde Keizer, Minou & Teunter, Ruud, 2014. "Opportunistic condition-based maintenance and aperiodic inspections for a two-unit series system," Research Report 14033-OPERA, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    15. Shahin Shakibaei & Pelin Alpkokin, 2019. "Conflict Resolution in Competitive Liberalized Railway Market: Application of Game Theoretic Concepts," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 22(01), pages 1-21, November.
    16. Yonghui Huang & Xianping Guo & Xinyuan Song, 2011. "Performance Analysis for Controlled Semi-Markov Systems with Application to Maintenance," Journal of Optimization Theory and Applications, Springer, vol. 150(2), pages 395-415, August.
    17. Hunt, Kyle & Agarwal, Puneet & Zhuang, Jun, 2022. "On the adoption of new technology to enhance counterterrorism measures: An attacker–defender game with risk preferences," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    18. Girish Kumar & Vipul Jain & Umang Soni, 2019. "Modelling and simulation of repairable mechanical systems reliability and availability," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(5), pages 1221-1233, October.
    19. Namun Cho & Tae-Seok Jang, 2019. "Asset Market Volatility and New Keynesian Macroeconomics: A Game-Theoretic Approach," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 245-266, June.
    20. Prasenjit Mondal, 2016. "On undiscounted semi-Markov decision processes with absorbing states," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(2), pages 161-177, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:201:y:2020:i:c:s0951832019310142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.