IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/24213.html
   My bibliography  Save this paper

Does AHP help us make a choice? - An experimental evaluation

Author

Listed:
  • Ishizaka, Alessio
  • Balkenborg, Dieter
  • Kaplan, Todd R

Abstract

In this paper, we use experimental economics methods to test how well Analytic Hierarchy Process (AHP) fares as a choice support system in a real decision problem. AHP provides a ranking that we statistically compare with three additional rankings given by the subjects in the experiment: one at the beginning, one after providing AHP with the necessary pair-wise comparisons and one after learning the ranking provided by AHP. While the rankings vary widely across subjects, we observe that for each individual all four rankings are similar. Hence, subjects are consistent and AHP is, for the most part, able to replicate their rankings. Furthermore, while the rankings are similar, we do find that the AHP ranking helps the decision-makers reformulate their choices by taking into account suggestions made by AHP.

Suggested Citation

  • Ishizaka, Alessio & Balkenborg, Dieter & Kaplan, Todd R, 2010. "Does AHP help us make a choice? - An experimental evaluation," MPRA Paper 24213, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:24213
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/24213/1/MPRA_paper_24213.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Influence of aggregation and measurement scale on ranking a compromise alternative in AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 700-710, April.
    2. James S. Dyer, 1990. "Remarks on the Analytic Hierarchy Process," Management Science, INFORMS, vol. 36(3), pages 249-258, March.
    3. G-T Yeo & D-W Song & J Dinwoodie & M Roe, 2010. "Weighting the competitiveness factors for container ports under conflicting interests," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(8), pages 1249-1257, August.
    4. Vargas, Luis G., 1990. "An overview of the analytic hierarchy process and its applications," European Journal of Operational Research, Elsevier, vol. 48(1), pages 2-8, September.
    5. Ernest H. Forman & Saul I. Gass, 2001. "The Analytic Hierarchy Process---An Exposition," Operations Research, INFORMS, vol. 49(4), pages 469-486, August.
    6. Al-Shemmeri, Tarik & Al-Kloub, Bashar & Pearman, Alan, 1997. "Model choice in multicriteria decision aid," European Journal of Operational Research, Elsevier, vol. 97(3), pages 550-560, March.
    7. Dean S. Karlan, 2005. "Using Experimental Economics to Measure Social Capital and Predict Financial Decisions," American Economic Review, American Economic Association, vol. 95(5), pages 1688-1699, December.
    8. Saaty, Thomas L., 2006. "Rank from comparisons and from ratings in the analytic hierarchy/network processes," European Journal of Operational Research, Elsevier, vol. 168(2), pages 557-570, January.
    9. C W Lee & N K Kwak, 1999. "Information resource planning for a health-care system using an AHP-based goal programming method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(12), pages 1191-1198, December.
    10. Ralph L. Keeney & Detlof von Winterfeldt & Thomas Eppel, 1990. "Eliciting Public Values for Complex Policy Decisions," Management Science, INFORMS, vol. 36(9), pages 1011-1030, September.
    11. repec:pri:rpdevs:gamespaper.pdf is not listed on IDEAS
    12. M M Akarte & N V Surendra & B Ravi & N Rangaraj, 2001. "Web based casting supplier evaluation using analytical hierarchy process," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(5), pages 511-522, May.
    13. Vaidya, Omkarprasad S. & Kumar, Sushil, 2006. "Analytic hierarchy process: An overview of applications," European Journal of Operational Research, Elsevier, vol. 169(1), pages 1-29, February.
    14. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    15. Fatemeh Zahedi, 1986. "The Analytic Hierarchy Process---A Survey of the Method and its Applications," Interfaces, INFORMS, vol. 16(4), pages 96-108, August.
    16. Linares, Pedro, 2009. "Are inconsistent decisions better? An experiment with pairwise comparisons," European Journal of Operational Research, Elsevier, vol. 193(2), pages 492-498, March.
    17. Huizingh, Eelko K. R. E. & Vrolijk, Hans C. J., 1997. "Extending the applicability of the analytic hierarchy process," Socio-Economic Planning Sciences, Elsevier, vol. 31(1), pages 29-39, March.
    18. Rachel Croson & Karen Donohue, 2002. "Experimental Economics and Supply-Chain Management," Interfaces, INFORMS, vol. 32(5), pages 74-82, October.
    19. Bana e Costa, Carlos A. & Vansnick, Jean-Claude, 2008. "A critical analysis of the eigenvalue method used to derive priorities in AHP," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1422-1428, June.
    20. Bodo Sturm & Joachim Weimann, 2006. "Experiments in Environmental Economics and Some Close Relatives," Journal of Economic Surveys, Wiley Blackwell, vol. 20(3), pages 419-457, July.
    21. Karapetrovic, Stanislav & Rosenbloom, E. S., 1999. "A quality control approach to consistency paradoxes in AHP," European Journal of Operational Research, Elsevier, vol. 119(3), pages 704-718, December.
    22. Liberatore, Matthew J. & Nydick, Robert L., 2008. "The analytic hierarchy process in medical and health care decision making: A literature review," European Journal of Operational Research, Elsevier, vol. 189(1), pages 194-207, August.
    23. repec:cup:judgdm:v:4:y:2009:i:3:p:200-213 is not listed on IDEAS
    24. James S. Dyer, 1990. "A Clarification of "Remarks on the Analytic Hierarchy Process"," Management Science, INFORMS, vol. 36(3), pages 274-275, March.
    25. Ho, William, 2008. "Integrated analytic hierarchy process and its applications - A literature review," European Journal of Operational Research, Elsevier, vol. 186(1), pages 211-228, April.
    26. Brugha, Cathal M., 2000. "Relative measurement and the power function," European Journal of Operational Research, Elsevier, vol. 121(3), pages 627-640, March.
    27. Brugha, Cathal M., 2004. "Phased multicriteria preference finding," European Journal of Operational Research, Elsevier, vol. 158(2), pages 308-316, October.
    28. H Fukuyama & W L Weber, 2002. "Evaluating public school district performance via DEA gain functions," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(9), pages 992-1003, September.
    29. Guitouni, Adel & Martel, Jean-Marc, 1998. "Tentative guidelines to help choosing an appropriate MCDA method," European Journal of Operational Research, Elsevier, vol. 109(2), pages 501-521, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guilan Kong & Lili Jiang & Xiaofeng Yin & Tianbing Wang & Dong-Ling Xu & Jian-Bo Yang & Yonghua Hu, 2018. "Combining principal component analysis and the evidential reasoning approach for healthcare quality assessment," Annals of Operations Research, Springer, vol. 271(2), pages 679-699, December.
    2. Corrente, Salvatore & Greco, Salvatore & Ishizaka, Alessio, 2016. "Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression," Omega, Elsevier, vol. 61(C), pages 2-18.
    3. Binkai Xu & Lei Liu & Yanming Sun, 2023. "The Spatio-Temporal Pattern of Regional Coordinated Development in the Common Prosperity Demonstration Zone—Evidence from Zhejiang Province," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    4. Bottomley, Paul A. & Doyle, John R., 2013. "Comparing the validity of numerical judgements elicited by direct rating and point allocation: Insights from objectively verifiable perceptual tasks," European Journal of Operational Research, Elsevier, vol. 228(1), pages 148-157.
    5. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    6. James G. Dolan & Emily Boohaker & Jeroan Allison & Thomas F. Imperiale, 2014. "Can Streamlined Multicriteria Decision Analysis Be Used to Implement Shared Decision Making for Colorectal Cancer Screening?," Medical Decision Making, , vol. 34(6), pages 746-755, August.
    7. Dong, Yucheng & Hong, Wei-Chiang & Xu, Yinfeng & Yu, Shui, 2013. "Numerical scales generated individually for analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 229(3), pages 654-662.
    8. Annamaria Nifo & Gaetano Vecchione, 2014. "Do Institutions Play a Role in Skilled Migration? The Case of Italy," Regional Studies, Taylor & Francis Journals, vol. 48(10), pages 1628-1649, October.
    9. Itzel Inti Maria Donati & Davide Viaggi & Zorica Srdjevic & Bojan Srdjevic & Antonella Di Fonzo & Teresa Del Giudice & Orlando Cimino & Andrea Martelli & Anna Dalla Marta & Roberto Henke & Filiberto A, 2023. "An Analysis of Preference Weights and Setting Priorities by Irrigation Advisory Services Users Based on the Analytic Hierarchy Process," Agriculture, MDPI, vol. 13(8), pages 1-15, August.
    10. Ormerod, Richard J. & Ulrich, Werner, 2013. "Operational research and ethics: A literature review," European Journal of Operational Research, Elsevier, vol. 228(2), pages 291-307.
    11. Nikou, Shahrokh & Mezei, József, 2013. "Evaluation of mobile services and substantial adoption factors with Analytic Hierarchy Process (AHP)," Telecommunications Policy, Elsevier, vol. 37(10), pages 915-929.
    12. J. Hummel & Lotte Steuten & C. Groothuis-Oudshoorn & Nick Mulder & Maarten IJzerman, 2013. "Preferences for Colorectal Cancer Screening Techniques and Intention to Attend: a Multi-Criteria Decision Analysis," Applied Health Economics and Health Policy, Springer, vol. 11(5), pages 499-507, October.
    13. Gabriela D. Oliveira & Luis C. Dias, 2020. "The potential learning effect of a MCDA approach on consumer preferences for alternative fuel vehicles," Annals of Operations Research, Springer, vol. 293(2), pages 767-787, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Influence of aggregation and measurement scale on ranking a compromise alternative in AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 700-710, April.
    2. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.
    3. Tomashevskii, I.L., 2015. "Eigenvector ranking method as a measuring tool: Formulas for errors," European Journal of Operational Research, Elsevier, vol. 240(3), pages 774-780.
    4. Ouesleti, Bilel & Costa-Font, Montserrat & Kallas, Zein & Chema Gil, Jose Maria, 2015. "Determinant Factors Affecting The Point of Purchase Selection: valuation and Perceptions," 2015 Conference, August 9-14, 2015, Milan, Italy 212603, International Association of Agricultural Economists.
    5. Ormerod, Richard J. & Ulrich, Werner, 2013. "Operational research and ethics: A literature review," European Journal of Operational Research, Elsevier, vol. 228(2), pages 291-307.
    6. Bana e Costa, Carlos A. & Vansnick, Jean-Claude, 2008. "A critical analysis of the eigenvalue method used to derive priorities in AHP," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1422-1428, June.
    7. Madjid Tavana & Mariya Sodenkamp & Leena Suhl, 2010. "A soft multi-criteria decision analysis model with application to the European Union enlargement," Annals of Operations Research, Springer, vol. 181(1), pages 393-421, December.
    8. M Tavana & M A Sodenkamp, 2010. "A fuzzy multi-criteria decision analysis model for advanced technology assessment at Kennedy Space Center," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(10), pages 1459-1470, October.
    9. Alessio Ishizaka, 2014. "Comparison of fuzzy logic, AHP, FAHP and hybrid fuzzy AHP for new supplier selection and its performance analysis," International Journal of Integrated Supply Management, Inderscience Enterprises Ltd, vol. 9(1/2), pages 1-22.
    10. Zygmunt Korban & Maja Taraszkiewicz-Łyda, 2022. "The Impact of Time Pressure on the Results of Psychotechnical Tests Based on the Findings of Pilot Studies Conducted on a Group of Students of the Silesian University of Technology—A Case Study," IJERPH, MDPI, vol. 19(22), pages 1-12, November.
    11. Siraj, Sajid & Mikhailov, Ludmil & Keane, John A., 2015. "Contribution of individual judgments toward inconsistency in pairwise comparisons," European Journal of Operational Research, Elsevier, vol. 242(2), pages 557-567.
    12. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    13. Lundström, Johanna & Öhman, Karin & Rönnqvist, Mikael & Gustafsson, Lena, 2014. "How reserve selection is affected by preferences in Swedish boreal forests," Forest Policy and Economics, Elsevier, vol. 41(C), pages 40-50.
    14. Ho, William & Ma, Xin, 2018. "The state-of-the-art integrations and applications of the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 267(2), pages 399-414.
    15. Thomas L. Saaty, 2013. "The Modern Science of Multicriteria Decision Making and Its Practical Applications: The AHP/ANP Approach," Operations Research, INFORMS, vol. 61(5), pages 1101-1118, October.
    16. Wenshuai Wu & Gang Kou, 2016. "A group consensus model for evaluating real estate investment alternatives," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 2(1), pages 1-10, December.
    17. Devesh Kumar & Gunjan Soni & Rohit Joshi & Vipul Jain & Amrik Sohal, 2022. "Modelling supply chain viability during COVID-19 disruption: A case of an Indian automobile manufacturing supply chain," Operations Management Research, Springer, vol. 15(3), pages 1224-1240, December.
    18. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    19. Jiří Mazurek, 2018. "Some notes on the properties of inconsistency indices in pairwise comparisons," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 28(1), pages 27-42.
    20. Schneider, Frank, 2008. "Multiple criteria decision making in application layer networks," Bayreuth Reports on Information Systems Management 36, University of Bayreuth, Chair of Information Systems Management.

    More about this item

    Keywords

    Decision analysis; Multiple Criteria Decision Aid; Analytic Hierarchy Process (AHP);
    All these keywords.

    JEL classification:

    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:24213. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.