IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v94y2009i10p1557-1567.html
   My bibliography  Save this article

A human–machine interface evaluation method: A difficulty evaluation method in information searching (DEMIS)

Author

Listed:
  • Ha, Jun Su
  • Seong, Poong Hyun

Abstract

A human–machine interface (HMI) evaluation method, which is named “difficulty evaluation method in information searching (DEMIS)†, is proposed and demonstrated with an experimental study. The DEMIS is based on a human performance model and two measures of attentional-resource effectiveness in monitoring and detection tasks in nuclear power plants (NPPs). Operator competence and HMI design are modeled to be most significant factors to human performance. One of the two effectiveness measures is fixation-to-importance ratio (FIR) which represents attentional resource (eye fixations) spent on an information source compared to importance of the information source. The other measure is selective attention effectiveness (SAE) which incorporates FIRs for all information sources. The underlying principle of the measures is that the information source should be selectively attended to according to its informational importance. In this study, poor performance in information searching tasks is modeled to be coupled with difficulties caused by poor mental models of operators or/and poor HMI design. Human performance in information searching tasks is evaluated by analyzing the FIR and the SAE. Operator mental models are evaluated by a questionnaire-based method. Then difficulties caused by a poor HMI design are evaluated by a focused interview based on the FIR evaluation and then root causes leading to poor performance are identified in a systematic way.

Suggested Citation

  • Ha, Jun Su & Seong, Poong Hyun, 2009. "A human–machine interface evaluation method: A difficulty evaluation method in information searching (DEMIS)," Reliability Engineering and System Safety, Elsevier, vol. 94(10), pages 1557-1567.
    • Handle: RePEc:eee:reensy:v:94:y:2009:i:10:p:1557-1567
    DOI: 10.1016/j.ress.2009.02.025
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832009000647
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2009.02.025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jun Su Ha & Poong Hyun Seong, 2009. "HUPESS: Human Performance Evaluation Support System," Springer Series in Reliability Engineering, in: Poong Hyun Seong (ed.), Reliability and Risk Issues in Large Scale Safety-critical Digital Control Systems, chapter 9, pages 197-229, Springer.
    2. Kim, Man Cheol & Seong, Poong Hyun, 2006. "A computational model for knowledge-driven monitoring of nuclear power plant operators based on information theory," Reliability Engineering and System Safety, Elsevier, vol. 91(3), pages 283-291.
    3. Kim, Man Cheol & Seong, Poong Hyun, 2006. "An analytic model for situation assessment of nuclear power plant operators based on Bayesian inference," Reliability Engineering and System Safety, Elsevier, vol. 91(3), pages 270-282.
    4. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Naderpour, Mohsen & Lu, Jie & Zhang, Guangquan, 2015. "An abnormal situation modeling method to assist operators in safety-critical systems," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 33-47.
    2. Zhang, Xiaoge & Mahadevan, Sankaran & Lau, Nathan & Weinger, Matthew B., 2020. "Multi-source information fusion to assess control room operator performance," Reliability Engineering and System Safety, Elsevier, vol. 194(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Hyun-Chul & Seong, Poong-Hyun, 2009. "A computational model for evaluating the effects of attention, memory, and mental models on situation assessment of nuclear power plant operators," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1796-1805.
    2. Banai, Reza, 2010. "Evaluation of land use-transportation systems with the Analytic Network Process," The Journal of Transport and Land Use, Center for Transportation Studies, University of Minnesota, vol. 3(1), pages 85-112.
    3. Fatih Yiğit & Şakir Esnaf, 2021. "A new Fuzzy C-Means and AHP-based three-phased approach for multiple criteria ABC inventory classification," Journal of Intelligent Manufacturing, Springer, vol. 32(6), pages 1517-1528, August.
    4. Rachele Corticelli & Margherita Pazzini & Cecilia Mazzoli & Claudio Lantieri & Annarita Ferrante & Valeria Vignali, 2022. "Urban Regeneration and Soft Mobility: The Case Study of the Rimini Canal Port in Italy," Sustainability, MDPI, vol. 14(21), pages 1-27, November.
    5. Lin, Sheng-Hau & Zhao, Xiaofeng & Wu, Jiuxing & Liang, Fachao & Li, Jia-Hsuan & Lai, Ren-Ji & Hsieh, Jing-Chzi & Tzeng, Gwo-Hshiung, 2021. "An evaluation framework for developing green infrastructure by using a new hybrid multiple attribute decision-making model for promoting environmental sustainability," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    6. Pishchulov, Grigory & Trautrims, Alexander & Chesney, Thomas & Gold, Stefan & Schwab, Leila, 2019. "The Voting Analytic Hierarchy Process revisited: A revised method with application to sustainable supplier selection," International Journal of Production Economics, Elsevier, vol. 211(C), pages 166-179.
    7. Seung-Jin Han & Won-Jae Lee & So-Hee Kim & Sang-Hoon Yoon & Hyunwoong Pyun, 2022. "Assessing Expected Long-term Benefits for the Olympic Games: Delphi-AHP Approach from Korean Olympic Experts," SAGE Open, , vol. 12(4), pages 21582440221, December.
    8. Denys Yemshanov & Frank H. Koch & Yakov Ben‐Haim & Marla Downing & Frank Sapio & Marty Siltanen, 2013. "A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept," Risk Analysis, John Wiley & Sons, vol. 33(9), pages 1694-1709, September.
    9. Mangla, Sachin Kumar & Srivastava, Praveen Ranjan & Eachempati, Prajwal & Tiwari, Aviral Kumar, 2024. "Exploring the impact of key performance factors on energy markets: From energy risk management perspectives," Energy Economics, Elsevier, vol. 131(C).
    10. Seyed Rakhshan & Ali Kamyad & Sohrab Effati, 2015. "Ranking decision-making units by using combination of analytical hierarchical process method and Tchebycheff model in data envelopment analysis," Annals of Operations Research, Springer, vol. 226(1), pages 505-525, March.
    11. V. Srinivasan & G. Shainesh & Anand K. Sharma, 2015. "An approach to prioritize customer-based, cost-effective service enhancements," The Service Industries Journal, Taylor & Francis Journals, vol. 35(14), pages 747-762, October.
    12. Mónica García-Melón & Blanca Pérez-Gladish & Tomás Gómez-Navarro & Paz Mendez-Rodriguez, 2016. "Assessing mutual funds’ corporate social responsibility: a multistakeholder-AHP based methodology," Annals of Operations Research, Springer, vol. 244(2), pages 475-503, September.
    13. Jitendar Kumar Khatri & Bhimaraya Metri, 2016. "SWOT-AHP Approach for Sustainable Manufacturing Strategy Selection: A Case of Indian SME," Global Business Review, International Management Institute, vol. 17(5), pages 1211-1226, October.
    14. Vlachokostas, Ch. & Michailidou, A.V. & Achillas, Ch., 2021. "Multi-Criteria Decision Analysis towards promoting Waste-to-Energy Management Strategies: A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    15. Cui, Ye & E, Hanyu & Pedrycz, Witold & Fayek, Aminah Robinson, 2022. "A granular multicriteria group decision making for renewable energy planning problems," Renewable Energy, Elsevier, vol. 199(C), pages 1047-1059.
    16. Jha, Madan K. & Chowdary, V.M. & Kulkarni, Y. & Mal, B.C., 2014. "Rainwater harvesting planning using geospatial techniques and multicriteria decision analysis," Resources, Conservation & Recycling, Elsevier, vol. 83(C), pages 96-111.
    17. Om Prakash Mishra & Mahesh Chand & Krishan Kumar & Prashant Mishra, 2023. "Investigating applicability of green supply chain management in manufacturing sectors," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(4), pages 1183-1196, August.
    18. David Han-Min Wang & Quang Linh Huynh, 2013. "Mediating Role of Knowledge Management in Effect of Management Accounting Practices on Firm Performance," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 3(3), pages 1-10, June.
    19. Luis Pérez-Domínguez & Luis Alberto Rodríguez-Picón & Alejandro Alvarado-Iniesta & David Luviano Cruz & Zeshui Xu, 2018. "MOORA under Pythagorean Fuzzy Set for Multiple Criteria Decision Making," Complexity, Hindawi, vol. 2018, pages 1-10, April.
    20. Neha Arora & Naresh Kumar, 2021. "Does Financial Inclusion Promote Human Development? Evidence from India," Jindal Journal of Business Research, , vol. 10(2), pages 163-184, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:94:y:2009:i:10:p:1557-1567. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.