IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v197y2012i1p5-2310.1007-s10479-011-0922-3.html
   My bibliography  Save this article

Questionnaire design improvement and missing item scores estimation for rapid and efficient decision making

Author

Listed:
  • Daji Ergu
  • Gang Kou

Abstract

In unconventional emergency decision making process using the analytic hierarchy process (AHP), it is important to quickly collect and process experts’ opinions to make a rapid decision. Questionnaire survey is a commonly used way to collect opinions and views in the AHP. However, many factors such as tedious design format, redundant content, and long length, may lead to inconsistent comparison matrix for the decision problem. Invalid or bad results of a questionnaire survey may cause the decision makers to make wrong decision. Furthermore, in the AHP, the score items for a comparison matrix in a questionnaire increase drastically if there are more comparisons, which result in longer survey. In this paper, a scale format is used to design the score items for a comparison matrix in questionnaire survey. Besides, an induced bias matrix model (IBMM) is proposed to estimate the missing item scores of the reciprocal pairwise comparison matrix. The survey questionnaire can be improved according to the importance of score items and emergency degree of the surveyed questions. A numerical example is used to illustrate the proposed method in unconventional emergency decision making. In addition, three cases of this example are analyzed and compared to address the effectiveness and feasibility of the proposed estimation model in the survey questionnaire design. Copyright Springer Science+Business Media, LLC 2012

Suggested Citation

  • Daji Ergu & Gang Kou, 2012. "Questionnaire design improvement and missing item scores estimation for rapid and efficient decision making," Annals of Operations Research, Springer, vol. 197(1), pages 5-23, August.
    • Handle: RePEc:spr:annopr:v:197:y:2012:i:1:p:5-23:10.1007/s10479-011-0922-3
    DOI: 10.1007/s10479-011-0922-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-011-0922-3
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10479-011-0922-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Linet Özdamar & Ediz Ekinci & Beste Küçükyazici, 2004. "Emergency Logistics Planning in Natural Disasters," Annals of Operations Research, Springer, vol. 129(1), pages 217-245, July.
    2. Fedrizzi, Michele & Giove, Silvio, 2007. "Incomplete pairwise comparison and consistency optimization," European Journal of Operational Research, Elsevier, vol. 183(1), pages 303-313, November.
    3. Ergu, Daji & Kou, Gang & Peng, Yi & Shi, Yong, 2011. "A simple method to improve the consistency ratio of the pair-wise comparison matrix in ANP," European Journal of Operational Research, Elsevier, vol. 213(1), pages 246-259, August.
    4. Lim, Kai H. & Swenseth, Scott R., 1993. "An iterative procedure for reducing problem size in large scale AHP problems," European Journal of Operational Research, Elsevier, vol. 67(1), pages 64-74, May.
    5. Altay, Nezih & Green III, Walter G., 2006. "OR/MS research in disaster operations management," European Journal of Operational Research, Elsevier, vol. 175(1), pages 475-493, November.
    6. Peng, Yi & Kou, Gang & Wang, Guoxun & Shi, Yong, 2011. "FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms," Omega, Elsevier, vol. 39(6), pages 677-689, December.
    7. Yi Peng & Gang Kou & Guoxun Wang & Wenshuai Wu & Yong Shi, 2011. "Ensemble Of Software Defect Predictors: An Ahp-Based Evaluation Method," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 10(01), pages 187-206.
    8. Saaty, Thomas L., 2003. "Decision-making with the AHP: Why is the principal eigenvector necessary," European Journal of Operational Research, Elsevier, vol. 145(1), pages 85-91, February.
    9. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    10. Thomas L. Saaty, 1994. "How to Make a Decision: The Analytic Hierarchy Process," Interfaces, INFORMS, vol. 24(6), pages 19-43, December.
    11. Yi, Wei & Ozdamar, Linet, 2007. "A dynamic logistics coordination model for evacuation and support in disaster response activities," European Journal of Operational Research, Elsevier, vol. 179(3), pages 1177-1193, June.
    12. Yi Peng & Gang Kou & Yong Shi & Zhengxin Chen, 2008. "A Descriptive Framework For The Field Of Data Mining And Knowledge Discovery," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 7(04), pages 639-682.
    13. Millet, Ido & Harker, Patrick T., 1990. "Globally effective questioning in the Analytic Hierarchy Process," European Journal of Operational Research, Elsevier, vol. 48(1), pages 88-97, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    2. Meimei Xia & Jian Chen & Juliang Zhang, 2015. "Multi-criteria decision making based on relative measures," Annals of Operations Research, Springer, vol. 229(1), pages 791-811, June.
    3. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    4. R. Sujatha & T. M. Rajalaxmi, 2016. "Hierarchical Fuzzy Hidden Markov Chain for Web Applications," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(01), pages 83-118, January.
    5. Jeng-Wen Lin & Pu Fun Shen & Bing-Jean Lee, 2015. "Repetitive Model Refinement for Questionnaire Design Improvement in the Evaluation of Working Characteristics in Construction Enterprises," Sustainability, MDPI, vol. 7(11), pages 1-15, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ergu, Daji & Kou, Gang & Peng, Yi & Shi, Yong, 2011. "A simple method to improve the consistency ratio of the pair-wise comparison matrix in ANP," European Journal of Operational Research, Elsevier, vol. 213(1), pages 246-259, August.
    2. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    3. Kou, Gang & Lin, Changsheng, 2014. "A cosine maximization method for the priority vector derivation in AHP," European Journal of Operational Research, Elsevier, vol. 235(1), pages 225-232.
    4. Changsheng Lin & Gang Kou & Daji Ergu, 2013. "An improved statistical approach for consistency test in AHP," Annals of Operations Research, Springer, vol. 211(1), pages 289-299, December.
    5. Lu, Chung-Cheng & Ying, Kuo-Ching & Chen, Hui-Ju, 2016. "Real-time relief distribution in the aftermath of disasters – A rolling horizon approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 93(C), pages 1-20.
    6. Melissa Gama & Bruno Filipe Santos & Maria Paola Scaparra, 2016. "A multi-period shelter location-allocation model with evacuation orders for flood disasters," EURO Journal on Computational Optimization, Springer;EURO - The Association of European Operational Research Societies, vol. 4(3), pages 299-323, September.
    7. Wu, Zhibin & Huang, Shuai & Xu, Jiuping, 2019. "Multi-stage optimization models for individual consistency and group consensus with preference relations," European Journal of Operational Research, Elsevier, vol. 275(1), pages 182-194.
    8. Kang Xu & Jiuping Xu, 2020. "A direct consistency test and improvement method for the analytic hierarchy process," Fuzzy Optimization and Decision Making, Springer, vol. 19(3), pages 359-388, September.
    9. Carmone, Frank J. & Kara, Ali & Zanakis, Stelios H., 1997. "A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP," European Journal of Operational Research, Elsevier, vol. 102(3), pages 538-553, November.
    10. Daji Ergu & Gang Kou & János Fülöp & Yong Shi, 2014. "Further Discussions on Induced Bias Matrix Model for the Pair-Wise Comparison Matrix," Journal of Optimization Theory and Applications, Springer, vol. 161(3), pages 980-993, June.
    11. L. N. Pradeep Kumar Rallabandi & Ravindranath Vandrangi & Subba Rao Rachakonda, 2016. "Improved Consistency Ratio for Pairwise Comparison Matrix in Analytic Hierarchy Processes," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 33(03), pages 1-19, June.
    12. Renata Turkeš & Daniel Palhazi Cuervo & Kenneth Sörensen, 2019. "Pre-positioning of emergency supplies: does putting a price on human life help to save lives?," Annals of Operations Research, Springer, vol. 283(1), pages 865-895, December.
    13. Kou, Gang & Ergu, Daji & Shang, Jennifer, 2014. "Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction," European Journal of Operational Research, Elsevier, vol. 236(1), pages 261-271.
    14. Yi Feng & Shaoze Cui, 2021. "A review of emergency response in disasters: present and future perspectives," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 105(1), pages 1109-1138, January.
    15. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    16. A. Anaya-Arenas & J. Renaud & A. Ruiz, 2014. "Relief distribution networks: a systematic review," Annals of Operations Research, Springer, vol. 223(1), pages 53-79, December.
    17. József Temesi, 2019. "An interactive approach to determine the elements of a pairwise comparison matrix," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(2), pages 533-549, June.
    18. Zhu, Bin & Xu, Zeshui & Zhang, Ren & Hong, Mei, 2016. "Hesitant analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 250(2), pages 602-614.
    19. Agha Iqbal Ali & Guven Ince, 2017. "Distress among disaster-affected populations: delay in relief provision," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(5), pages 533-543, May.
    20. Gralla, Erica & Goentzel, Jarrod, 2018. "Humanitarian transportation planning: Evaluation of practice-based heuristics and recommendations for improvement," European Journal of Operational Research, Elsevier, vol. 269(2), pages 436-450.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:197:y:2012:i:1:p:5-23:10.1007/s10479-011-0922-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.