IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v39y2019i9p1899-1912.html
   My bibliography  Save this article

Assessing Engineering Resilience for Systems with Multiple Performance Measures

Author

Listed:
  • Eric Specking
  • Bobby Cottam
  • Gregory Parnell
  • Edward Pohl
  • Matthew Cilli
  • Randy Buchanan
  • Zephan Wade
  • Colin Small

Abstract

Recently, efforts to model and assess a system's resilience to disruptions due to environmental and adversarial threats have increased substantially. Researchers have investigated resilience in many disciplines, including sociology, psychology, computer networks, and engineering systems, to name a few. When assessing engineering system resilience, the resilience assessment typically considers a single performance measure, a disruption, a loss of performance, the time required to recover, or a combination of these elements. We define and use a resilient engineered system definition that separates system resilience into platform and mission resilience. Most complex systems have multiple performance measures; this research proposes using multiple objective decision analysis to assess system resilience for systems with multiple performance measures using two distinct methods. The first method quantifies platform resilience and includes resilience and other “ilities” directly in the value hierarchy, while the second method quantifies mission resilience and uses the “ilities” in the calculation of the expected mission performance for every performance measure in the value hierarchy. We illustrate the mission resilience method using a transportation systems‐of‐systems network with varying levels of resilience due to the level of connectivity and autonomy of the vehicles and platform resilience by using a notional military example. Our analysis found that it is necessary to quantify performance in context with specific mission(s) and scenario(s) under specific threat(s) and then use modeling and simulation to help determine the resilience of a system for a given set of conditions. The example demonstrates how incorporating system mission resilience can improve performance for some performance measures while negatively affecting others.

Suggested Citation

  • Eric Specking & Bobby Cottam & Gregory Parnell & Edward Pohl & Matthew Cilli & Randy Buchanan & Zephan Wade & Colin Small, 2019. "Assessing Engineering Resilience for Systems with Multiple Performance Measures," Risk Analysis, John Wiley & Sons, vol. 39(9), pages 1899-1912, September.
  • Handle: RePEc:wly:riskan:v:39:y:2019:i:9:p:1899-1912
    DOI: 10.1111/risa.13395
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.13395
    Download Restriction: no

    File URL: https://libkey.io/10.1111/risa.13395?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sabrina Larkin & Cate Fox-Lent & Daniel A. Eisenberg & Benjamin D. Trump & Sean Wallace & Colin Chadderton & Igor Linkov, 2015. "Benchmarking agency and organizational practices in resilience decision making," Environment Systems and Decisions, Springer, vol. 35(2), pages 185-195, June.
    2. Hosseini, Seyedmohsen & Barker, Kash & Ramirez-Marquez, Jose E., 2016. "A review of definitions and measures of system resilience," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 47-61.
    3. Bilal M. Ayyub, 2014. "Systems Resilience for Multihazard Environments: Definition, Metrics, and Valuation for Decision Making," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 340-355, February.
    4. Horia-Nicolai L. Teodorescu, 2015. "Defining resilience using probabilistic event trees," Environment Systems and Decisions, Springer, vol. 35(2), pages 279-290, June.
    5. Igor Linkov & Sabrina Larkin & James H. Lambert, 2015. "Concepts and approaches to resilience in a variety of governance and regulatory domains," Environment Systems and Decisions, Springer, vol. 35(2), pages 183-184, June.
    6. Yacov Y. Haimes, 2009. "On the Definition of Resilience in Systems," Risk Analysis, John Wiley & Sons, vol. 29(4), pages 498-501, April.
    7. Henry, Devanandham & Emmanuel Ramirez-Marquez, Jose, 2012. "Generic metrics and quantitative approaches for system resilience as a function of time," Reliability Engineering and System Safety, Elsevier, vol. 99(C), pages 114-122.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jesse M. Keenan & Benjamin D. Trump & William Hynes & Igor Linkov, 2021. "Exploring the Convergence of Resilience Processes and Sustainable Outcomes in Post-COVID, Post-Glasgow Economies," Sustainability, MDPI, vol. 13(23), pages 1-12, December.
    2. Geng, Sunyue & Yang, Ming & Mitici, Mihaela & Liu, Sifeng, 2023. "A resilience assessment framework for complex engineered systems using graphical evaluation and review technique (GERT)," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    3. Cai, Baoping & Zhang, Yanping & Wang, Haifeng & Liu, Yonghong & Ji, Renjie & Gao, Chuntan & Kong, Xiangdi & Liu, Jing, 2021. "Resilience evaluation methodology of engineering systems with dynamic-Bayesian-network-based degradation and maintenance," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    4. S. E. Galaitsi & Jeffrey M. Keisler & Benjamin D. Trump & Igor Linkov, 2021. "The Need to Reconcile Concepts that Characterize Systems Facing Threats," Risk Analysis, John Wiley & Sons, vol. 41(1), pages 3-15, January.
    5. Nicholas Shallcross & Gregory S. Parnell & Ed Pohl & Eric Specking, 2020. "Set‐based design: The state‐of‐practice and research opportunities," Systems Engineering, John Wiley & Sons, vol. 23(5), pages 557-578, September.
    6. Adel Mottahedi & Farhang Sereshki & Mohammad Ataei & Ali Nouri Qarahasanlou & Abbas Barabadi, 2021. "The Resilience of Critical Infrastructure Systems: A Systematic Literature Review," Energies, MDPI, vol. 14(6), pages 1-32, March.
    7. Yu, Yaocheng & Shuai, Bin & Huang, Wencheng, 2024. "Resilience evaluation of train control on-board system based on multi-dimensional continuous-time Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 246(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mottahedi, Adel & Sereshki, Farhang & Ataei, Mohammad & Qarahasanlou, Ali Nouri & Barabadi, Abbas, 2021. "Resilience estimation of critical infrastructure systems: Application of expert judgment," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    2. Liu, Xing & Fang, Yi-Ping & Zio, Enrico, 2021. "A Hierarchical Resilience Enhancement Framework for Interdependent Critical Infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    3. Adel Mottahedi & Farhang Sereshki & Mohammad Ataei & Ali Nouri Qarahasanlou & Abbas Barabadi, 2021. "The Resilience of Critical Infrastructure Systems: A Systematic Literature Review," Energies, MDPI, vol. 14(6), pages 1-32, March.
    4. Uday, Payuna & Chandrahasa, Rakshit & Marais, Karen, 2019. "System Importance Measures: Definitions and Application to System-of-Systems Analysis," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    5. Zeng, Zhiguo & Fang, Yi-Ping & Zhai, Qingqing & Du, Shijia, 2021. "A Markov reward process-based framework for resilience analysis of multistate energy systems under the threat of extreme events," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    6. Poulin, Craig & Kane, Michael B., 2021. "Infrastructure resilience curves: Performance measures and summary metrics," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Jesse M. Keenan, 2018. "Regional resilience trust funds: an exploratory analysis for leveraging insurance surcharges," Environment Systems and Decisions, Springer, vol. 38(1), pages 118-139, March.
    8. Kenneth Martínez & David Claudio, 2023. "Expanding Fundamental Boundaries between Resilience and Survivability in Systems Engineering: A Literature Review," Sustainability, MDPI, vol. 15(6), pages 1-27, March.
    9. Ivo Häring & Mirjam Fehling-Kaschek & Natalie Miller & Katja Faist & Sebastian Ganter & Kushal Srivastava & Aishvarya Kumar Jain & Georg Fischer & Kai Fischer & Jörg Finger & Alexander Stolz & Tobias , 2021. "A performance-based tabular approach for joint systematic improvement of risk control and resilience applied to telecommunication grid, gas network, and ultrasound localization system," Environment Systems and Decisions, Springer, vol. 41(2), pages 286-329, June.
    10. Cai, Baoping & Zhang, Yanping & Wang, Haifeng & Liu, Yonghong & Ji, Renjie & Gao, Chuntan & Kong, Xiangdi & Liu, Jing, 2021. "Resilience evaluation methodology of engineering systems with dynamic-Bayesian-network-based degradation and maintenance," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    11. MacKenzie, Cameron A. & Hu, Chao, 2019. "Decision making under uncertainty for design of resilient engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 192(C).
    12. Almoghathawi, Yasser & Barker, Kash & Albert, Laura A., 2019. "Resilience-driven restoration model for interdependent infrastructure networks," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 12-23.
    13. Dui, Hongyan & Liu, Meng & Song, Jiaying & Wu, Shaomin, 2023. "Importance measure-based resilience management: Review, methodology and perspectives on maintenance," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    14. Tom M. Logan & Seth D. Guikema, 2020. "Reframing Resilience: Equitable Access to Essential Services," Risk Analysis, John Wiley & Sons, vol. 40(8), pages 1538-1553, August.
    15. Patriarca, Riccardo & De Paolis, Alessandro & Costantino, Francesco & Di Gravio, Giulio, 2021. "Simulation model for simple yet robust resilience assessment metrics for engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    16. Das, Laya & Munikoti, Sai & Natarajan, Balasubramaniam & Srinivasan, Babji, 2020. "Measuring smart grid resilience: Methods, challenges and opportunities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    17. Cassottana, Beatrice & Shen, Lijuan & Tang, Loon Ching, 2019. "Modeling the recovery process: A key dimension of resilience," Reliability Engineering and System Safety, Elsevier, vol. 190(C), pages 1-1.
    18. Hossain, Niamat Ullah Ibne & Jaradat, Raed & Hosseini, Seyedmohsen & Marufuzzaman, Mohammad & Buchanan, Randy K., 2019. "A framework for modeling and assessing system resilience using a Bayesian network: A case study of an interdependent electrical infrastructure system," International Journal of Critical Infrastructure Protection, Elsevier, vol. 25(C), pages 62-83.
    19. Kuttler, Emma & Ghorbani-Renani, Nafiseh & Barker, Kash & González, Andrés D. & Johansson, Jonas, 2024. "Protection-interdiction-restoration for resilient multi-commodity networks," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    20. Umunnakwe, A. & Huang, H. & Oikonomou, K. & Davis, K.R., 2021. "Quantitative analysis of power systems resilience: Standardization, categorizations, and challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:39:y:2019:i:9:p:1899-1912. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.