IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v96y2011i7p849-860.html
   My bibliography  Save this article

Modelling and assessment of dependent performance shaping factors through Analytic Network Process

Author

Listed:
  • De Ambroggi, Massimiliano
  • Trucco, Paolo

Abstract

Despite continuous progresses in research and applications, one of the major weaknesses of current HRA methods dwells in their limited capability of modelling the mutual influences between performance shaping factors (PSFs). Indeed at least two types of dependencies between PSFs can be defined: (i) dependency between the states of the PSFs; (ii) dependency between the influences (impacts) of the PSFs on the human performance. This paper introduces a method, based on Analytic Network Process (ANP), for the quantification of the latter, where the overall contribution of each PSF (weight) to the human error probability (HEP) is eventually returned. The core of the method is the modelling process, articulated into two steps: firstly, a qualitative network of dependencies between PSFs is identified, then, the importance of each PSF is quantitatively assessed using ANP. The model allows to distinguish two components of the PSF influence: direct influence that is the influence that the considered PSF is able to express by itself, notwithstanding the presence of other PSFs and indirect influence that is the incremental influence of the considered PSF through its influence on other PSFs. A case study in Air Traffic Control is presented where the proposed approach is integrated into the cognitive simulator PROCOS. The results demonstrated a significant modification of the influence of PSFs over the operator performance when dependencies are taken into account, underlining the importance of considering not only the possible correlation between the states of PSFs but also their mutual dependency in affecting human performance in complex systems.

Suggested Citation

  • De Ambroggi, Massimiliano & Trucco, Paolo, 2011. "Modelling and assessment of dependent performance shaping factors through Analytic Network Process," Reliability Engineering and System Safety, Elsevier, vol. 96(7), pages 849-860.
    • Handle: RePEc:eee:reensy:v:96:y:2011:i:7:p:849-860
    DOI: 10.1016/j.ress.2011.03.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832011000329
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2011.03.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1076-1101.
    2. Thomas L. Saaty & Luis G. Vargas, 2006. "Decision Making with the Analytic Network Process," International Series in Operations Research and Management Science, Springer, number 978-0-387-33987-0, April.
    3. Trucco, P. & Leva, M.C., 2007. "A probabilistic cognitive simulator for HRA studies (PROCOS)," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1117-1130.
    4. Subotic, Branka & Ochieng, Washington Y. & Straeter, Oliver, 2007. "Recovery from equipment failures in ATC: Determination of contextual factors," Reliability Engineering and System Safety, Elsevier, vol. 92(7), pages 858-870.
    5. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1041-1060.
    6. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 2: IDAC performance influencing factors model," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1014-1040.
    7. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1061-1075.
    8. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 997-1013.
    9. Thomas L. Saaty, 2006. "The Analytic Network Process," International Series in Operations Research & Management Science, in: Decision Making with the Analytic Network Process, chapter 0, pages 1-26, Springer.
    10. Park, Kyung S. & Lee, Jae in, 2008. "A new method for estimating human error probabilities: AHP–SLIM," Reliability Engineering and System Safety, Elsevier, vol. 93(4), pages 578-587.
    11. Ahmed Rebai (ed.), 2010. "Bayesian Network," Books, IntechOpen, number 786, January-J.
    12. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    2. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    3. Katrina M Groth & Ali Mosleh, 2012. "Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model," Journal of Risk and Reliability, , vol. 226(4), pages 361-379, August.
    4. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin, 2020. "Performance shaping factors dependence assessment through moderating and mediating effect analysis," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    5. Kyriakidis, Miltos & Majumdar, Arnab & Ochieng, Washington Y., 2018. "The human performance railway operational index—a novel approach to assess human performance for railway operations," Reliability Engineering and System Safety, Elsevier, vol. 170(C), pages 226-243.
    6. Kim, Yochan & Kim, Jaewhan & Park, Jinkyun, 2023. "A data-informed dependency assessment of human reliability," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    7. Kim, Yochan & Park, Jinkyun & Jung, Wondea & Jang, Inseok & Hyun Seong, Poong, 2015. "A statistical approach to estimating effects of performance shaping factors on human error probabilities of soft controls," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 378-387.
    8. Patriarca, Riccardo & Ramos, Marilia & Paltrinieri, Nicola & Massaiu, Salvatore & Costantino, Francesco & Di Gravio, Giulio & Boring, Ronald Laurids, 2020. "Human reliability analysis: Exploring the intellectual structure of a research field," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    9. Peng Liu & Zhizhong Li, 2014. "Human Error Data Collection and Comparison with Predictions by SPAR‐H," Risk Analysis, John Wiley & Sons, vol. 34(9), pages 1706-1719, September.
    10. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    11. Groth, Katrina M. & Swiler, Laura P., 2013. "Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 33-42.
    12. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin & Zhu, Yanzhi, 2020. "Methodology for assessing dependencies between factors influencing airline pilot performance reliability: A case of taxiing tasks," Journal of Air Transport Management, Elsevier, vol. 89(C).
    13. Liu, Peng & Lyu, Xi & Qiu, Yongping & He, Jiandong & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2017. "Identifying key performance shaping factors in digital main control rooms of nuclear power plants: A risk-based approach," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 264-275.
    14. Preischl, Wolfgang & Hellmich, Mario, 2013. "Human error probabilities from operational experience of German nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 150-159.
    15. Su, Xiaoyan & Mahadevan, Sankaran & Xu, Peida & Deng, Yong, 2014. "Inclusion of task dependence in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 128(C), pages 41-55.
    16. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zio, Enrico & Yuan, Chengwei & Wang, Taorui & Jiang, Jianjun, 2022. "A Bayesian belief network framework for nuclear power plant human reliability analysis accounting for dependencies among performance shaping factors," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    17. Liu, Peng & Qiu, Yongping & Hu, Juntao & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2020. "Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 194(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vaurio, Jussi K., 2009. "Human factors, human reliability and risk assessment in license renewal of a nuclear power plant," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1818-1826.
    2. Di Pasquale, Valentina & Miranda, Salvatore & Iannone, Raffaele & Riemma, Stefano, 2015. "A Simulator for Human Error Probability Analysis (SHERPA)," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 17-32.
    3. Sun, Zhiqiang & Li, Zhengyi & Gong, Erling & Xie, Hongwei, 2012. "Estimating Human Error Probability using a modified CREAM," Reliability Engineering and System Safety, Elsevier, vol. 100(C), pages 28-32.
    4. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    5. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    6. París, C. & Queral, C. & Mula, J. & Gómez-Magán, J. & Sánchez-Perea, M. & Meléndez, E. & Gil, J., 2019. "Quantitative risk reduction by means of recovery strategies," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 13-32.
    7. Li, Jue & Li, Heng & Wang, Fan & Cheng, Andy S.K. & Yang, Xincong & Wang, Hongwei, 2021. "Proactive analysis of construction equipment operators’ hazard perception error based on cognitive modeling and a dynamic Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    8. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    9. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin & Zhu, Yanzhi, 2020. "Methodology for assessing dependencies between factors influencing airline pilot performance reliability: A case of taxiing tasks," Journal of Air Transport Management, Elsevier, vol. 89(C).
    10. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    11. Bandeira, Michelle Carvalho Galvão Silva Pinto & Correia, Anderson Ribeiro & Martins, Marcelo Ramos, 2018. "General model analysis of aeronautical accidents involving human and organizational factors," Journal of Air Transport Management, Elsevier, vol. 69(C), pages 137-146.
    12. Lee, Hyun-Chul & Seong, Poong-Hyun, 2009. "A computational model for evaluating the effects of attention, memory, and mental models on situation assessment of nuclear power plant operators," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1796-1805.
    13. Aminu Darda’u Rafindadi & Nasir Shafiq & Idris Othman & Miljan Mikić, 2023. "Mechanism Models of the Conventional and Advanced Methods of Construction Safety Training. Is the Traditional Method of Safety Training Sufficient?," IJERPH, MDPI, vol. 20(2), pages 1-19, January.
    14. Al-Douri, Ahmad & Levine, Camille S. & Groth, Katrina M., 2023. "Identifying human failure events (HFEs) for external hazard probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    15. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    16. Bolbot, Victor & Theotokatos, Gerasimos & Bujorianu, Luminita Manuela & Boulougouris, Evangelos & Vassalos, Dracos, 2019. "Vulnerabilities and safety assurance methods in Cyber-Physical Systems: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 179-193.
    17. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    18. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    19. Schroer, Suzanne & Modarres, Mohammad, 2013. "An event classification schema for evaluating site risk in a multi-unit nuclear power plant probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 117(C), pages 40-51.
    20. Ramos, M.A. & Thieme, Christoph A. & Utne, Ingrid B. & Mosleh, A., 2020. "Human-system concurrent task analysis for maritime autonomous surface ship operation and safety," Reliability Engineering and System Safety, Elsevier, vol. 195(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:96:y:2011:i:7:p:849-860. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.