IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v213y2021ics0951832021003008.html
   My bibliography  Save this article

CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology

Author

Listed:
  • Zhao, Yunfei
  • Smidts, Carol

Abstract

Cognitive modeling and simulation studies how a human dynamically interacts with the external world. Human performance assessment based on this concept has long been researched in both cognitive sciences and engineering disciplines. However, existing methods have difficulties in describing the uncertain relationships in a human’s knowledge and in considering the uncertainties in the cognitive process. To tackle these issues, we propose a novel cognitive modeling and simulation environment (CMS-BN) by introducing Bayesian networks to represent a human’s knowledge and Monte Carlo simulation to account for the uncertainties in the cognitive process. The proposed environment explicitly models information perception, reasoning and response in a human’s cognitive process. Information perception works as a filtering mechanism to downselect signals from the external world. Reasoning and response are modeled as traversing the human knowledge base represented as a Bayesian network to retrieve knowledge and updating human belief and attention distribution accordingly. Uncertainties in the cognitive process are characterized through Monte Carlo simulation. The proposed environment also models the interplay between the cognitive process and two performance shaping factors, stress and fatigue, though additional factors can be further considered. We expect the proposed environment to be useful in human reliability analysis and human performance improvement.

Suggested Citation

  • Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
  • Handle: RePEc:eee:reensy:v:213:y:2021:i:c:s0951832021003008
    DOI: 10.1016/j.ress.2021.107776
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021003008
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107776?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Greco, Salvatore F. & Podofillini, Luca & Dang, Vinh N., 2021. "A Bayesian model to treat within-category and crew-to-crew variability in simulator data for Human Reliability Analysis," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    2. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1076-1101.
    3. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    4. James Chang, Y. & Bley, Dennis & Criscione, Lawrence & Kirwan, Barry & Mosleh, Ali & Madary, Todd & Nowell, Rodney & Richards, Robert & Roth, Emilie M. & Sieben, Scott & Zoulis, Antonios, 2014. "The SACADA database for human reliability and human performance," Reliability Engineering and System Safety, Elsevier, vol. 125(C), pages 117-133.
    5. Abílio Ramos, M. & López Droguett, E. & Mosleh, A. & Das Chagas Moura, M., 2020. "A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    6. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1041-1060.
    7. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 2: IDAC performance influencing factors model," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1014-1040.
    8. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    9. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1061-1075.
    10. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 997-1013.
    11. Katrina M Groth & Matthew R Denman & Michael C Darling & Thomas B Jones & George F Luger, 2020. "Building and using dynamic risk-informed diagnosis procedures for complex system accidents," Journal of Risk and Reliability, , vol. 234(1), pages 193-207, February.
    12. Liu, Peng & Qiu, Yongping & Hu, Juntao & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2020. "Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    13. Groth, Katrina M. & Mosleh, Ali, 2012. "A data-informed PIF hierarchy for model-based Human Reliability Analysis," Reliability Engineering and System Safety, Elsevier, vol. 108(C), pages 154-174.
    14. Zhao, Yunfei & Smidts, Carol, 2019. "A method for systematically developing the knowledge base of reactor operators in nuclear power plants to support cognitive modeling of operator performance," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 64-77.
    15. Mkrtchyan, L. & Podofillini, L. & Dang, V.N., 2015. "Bayesian belief networks for human reliability analysis: A review of applications and gaps," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 1-16.
    16. Groth, Katrina M. & Swiler, Laura P., 2013. "Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 33-42.
    17. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    18. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    19. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Zhao, Yunfei, 2022. "A Bayesian approach to comparing human reliability analysis methods using human performance data," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    3. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2021. "Analysis of recent operational events involving inappropriate actions: influencing factors and root causes," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    4. Asadayoobi, N. & Taghipour, S. & Jaber, M.Y., 2022. "Predicting human reliability based on probabilistic mission completion time using Bayesian Network," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    5. You, Qidong & Guo, Jianbin & Zeng, Shengkui & Che, Haiyang, 2024. "A dynamic Bayesian network based reliability assessment method for short-term multi-round situation awareness considering round dependencies," Reliability Engineering and System Safety, Elsevier, vol. 243(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    3. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    4. Li, Jue & Li, Heng & Wang, Fan & Cheng, Andy S.K. & Yang, Xincong & Wang, Hongwei, 2021. "Proactive analysis of construction equipment operators’ hazard perception error based on cognitive modeling and a dynamic Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Al-Douri, Ahmad & Levine, Camille S. & Groth, Katrina M., 2023. "Identifying human failure events (HFEs) for external hazard probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    7. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud & van Gelder, Pieter, 2020. "BN-SLIM: A Bayesian Network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    8. Wang, Zengkai & Zeng, Shengkui & Guo, Jianbin & Che, Haiyang, 2021. "A Bayesian network for reliability assessment of man-machine phased-mission system considering the phase dependencies of human cognitive error," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    9. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    10. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin & Zhu, Yanzhi, 2020. "Methodology for assessing dependencies between factors influencing airline pilot performance reliability: A case of taxiing tasks," Journal of Air Transport Management, Elsevier, vol. 89(C).
    11. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    12. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    13. Zhang, Xiaoge & Mahadevan, Sankaran & Lau, Nathan & Weinger, Matthew B., 2020. "Multi-source information fusion to assess control room operator performance," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    14. Zhao, Yunfei, 2022. "A Bayesian approach to comparing human reliability analysis methods using human performance data," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    15. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    16. Abílio Ramos, M. & López Droguett, E. & Mosleh, A. & Das Chagas Moura, M., 2020. "A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    17. Ekanem, Nsimah & Mosleh, Ali & Shen, Song-Hua & Ramos, Marilia, 2024. "Phoenix–A model-based human reliability analysis methodology: Data sources and quantitative analysis procedure," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    18. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    19. Kim, Yochan & Park, Jinkyun & Jung, Wondea, 2017. "A classification scheme of erroneous behaviors for human error probability estimations based on simulator data," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 1-13.
    20. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2021. "Analysis of recent operational events involving inappropriate actions: influencing factors and root causes," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:213:y:2021:i:c:s0951832021003008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.