IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v130y2025ics0305048324001403.html
   My bibliography  Save this article

A comparative study on precision of direct evaluations, the Pairwise Comparisons Method and the Best-Worst Method

Author

Listed:
  • Cavallo, Bice
  • Ishizaka, Alessio

Abstract

The aim of this paper is to design, carry out and analyze an experiment with over 100 respondents to measure the precision of the respondents when they compare (by evaluation) the areas of nine geometric figures and five distances between cities by using direct evaluations, Pairwise Comparisons Method and Best-Worst Method. The outcomes of the experiment indicate that the direct evaluations are the most imprecise and that there is not statistically significant difference between Best-Worst Method and Pairwise Comparisons Method.

Suggested Citation

  • Cavallo, Bice & Ishizaka, Alessio, 2025. "A comparative study on precision of direct evaluations, the Pairwise Comparisons Method and the Best-Worst Method," Omega, Elsevier, vol. 130(C).
    • Handle: RePEc:eee:jomega:v:130:y:2025:i:c:s0305048324001403
    DOI: 10.1016/j.omega.2024.103175
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048324001403
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.omega.2024.103175?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bice Cavallo & Alessio Ishizaka & Maria Grazia Olivieri & Massimo Squillante, 2019. "Comparing inconsistency of pairwise comparison matrices depending on entries," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(5), pages 842-850, May.
    2. Liang, Fuqi & Brunelli, Matteo & Rezaei, Jafar, 2020. "Consistency issues in the best worst method: Measurements and thresholds," Omega, Elsevier, vol. 96(C).
    3. Ramanathan, Ramakrishnan & Ramanathan, Usha, 2010. "A qualitative perspective to deriving weights from pairwise comparison matrices," Omega, Elsevier, vol. 38(3-4), pages 228-232, June.
    4. Bice Cavallo & Alessio Ishizaka, 2023. "Evaluating scales for pairwise comparisons," Annals of Operations Research, Springer, vol. 325(2), pages 951-965, June.
    5. Mi, Xiaomei & Tang, Ming & Liao, Huchang & Shen, Wenjing & Lev, Benjamin, 2019. "The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what's next?," Omega, Elsevier, vol. 87(C), pages 205-225.
    6. Rezaei, Jafar, 2016. "Best-worst multi-criteria decision-making method: Some properties and a linear model," Omega, Elsevier, vol. 64(C), pages 126-130.
    7. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Qun & Liu, Xinwang & Zhou, Ligang & Qin, Jindong & Rezaei, Jafar, 2024. "An analytical framework for the best–worst method," Omega, Elsevier, vol. 123(C).
    2. Aziz Naghizadeh Vardin & Ramin Ansari & Mohammad Khalilzadeh & Jurgita Antucheviciene & Romualdas Bausys, 2021. "An Integrated Decision Support Model Based on BWM and Fuzzy-VIKOR Techniques for Contractor Selection in Construction Projects," Sustainability, MDPI, vol. 13(12), pages 1-28, June.
    3. Corrente, Salvatore & Greco, Salvatore & Rezaei, Jafar, 2024. "Better decisions with less cognitive load: The Parsimonious BWM," Omega, Elsevier, vol. 126(C).
    4. Kheybari, Siamak & Javdanmehr, Mahsa & Rezaie, Fariba Mahdi & Rezaei, Jafar, 2021. "Corn cultivation location selection for bioethanol production: An application of BWM and extended PROMETHEE II," Energy, Elsevier, vol. 228(C).
    5. Danish Farooq & Sarbast Moslem & Arshad Jamal & Farhan Muhammad Butt & Yahya Almarhabi & Rana Faisal Tufail & Meshal Almoshaogeh, 2021. "Assessment of Significant Factors Affecting Frequent Lane-Changing Related to Road Safety: An Integrated Approach of the AHP–BWM Model," IJERPH, MDPI, vol. 18(20), pages 1-17, October.
    6. Liang, Fuqi & Brunelli, Matteo & Rezaei, Jafar, 2020. "Consistency issues in the best worst method: Measurements and thresholds," Omega, Elsevier, vol. 96(C).
    7. Besharati Fard, Moein & Moradian, Parisa & Emarati, Mohammadreza & Ebadi, Mehdi & Gholamzadeh Chofreh, Abdoulmohammad & Klemeŝ, Jiří Jaromír, 2022. "Ground-mounted photovoltaic power station site selection and economic analysis based on a hybrid fuzzy best-worst method and geographic information system: A case study Guilan province," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    8. Sarbast Moslem & Muhammet Gul & Danish Farooq & Erkan Celik & Omid Ghorbanzadeh & Thomas Blaschke, 2020. "An Integrated Approach of Best-Worst Method (BWM) and Triangular Fuzzy Sets for Evaluating Driver Behavior Factors Related to Road Safety," Mathematics, MDPI, vol. 8(3), pages 1-20, March.
    9. Kusi-Sarpong, Simonov & Orji, Ifeyinwa Juliet & Gupta, Himanshu & Kunc, Martin, 2021. "Risks associated with the implementation of big data analytics in sustainable supply chains," Omega, Elsevier, vol. 105(C).
    10. Siamak Kheybari & Mohammad Reza Mehrpour & Paul Bauer & Alessio Ishizaka, 2024. "How Can Risk-Averse and Risk-Taking Approaches be Considered in a Group Multi-Criteria Decision-Making Problem?," Group Decision and Negotiation, Springer, vol. 33(4), pages 883-909, August.
    11. Md. Raquibuzzaman Khan & Nazia Tabassum & Niaz Ahmed Khan & Mohammad Jahangir Alam, 2022. "Procurement challenges in public-sector agricultural development projects in Bangladesh," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-13, December.
    12. Fumin Deng & Yanjie Li & Huirong Lin & Jinrui Miao & Xuedong Liang, 2020. "A BWM-TOPSIS Hazardous Waste Inventory Safety Risk Evaluation," IJERPH, MDPI, vol. 17(16), pages 1-18, August.
    13. Arman Nedjati & Mohammad Yazdi & Rouzbeh Abbassi, 2022. "A sustainable perspective of optimal site selection of giant air-purifiers in large metropolitan areas," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 24(6), pages 8747-8778, June.
    14. Elkadeem, M.R. & Younes, Ali & Sharshir, Swellam W. & Campana, Pietro Elia & Wang, Shaorong, 2021. "Sustainable siting and design optimization of hybrid renewable energy system: A geospatial multi-criteria analysis," Applied Energy, Elsevier, vol. 295(C).
    15. Amin Vafadarnikjoo & Madjid Tavana & Tiago Botelho & Konstantinos Chalvatzis, 2020. "A neutrosophic enhanced best–worst method for considering decision-makers’ confidence in the best and worst criteria," Annals of Operations Research, Springer, vol. 289(2), pages 391-418, June.
    16. Gao, Fei & Wang, Weixiang & Bi, Chencan & Bi, Wenhao & Zhang, An, 2023. "Prioritization of used aircraft acquisition criteria: A fuzzy best–worst method (BWM)-based approach," Journal of Air Transport Management, Elsevier, vol. 107(C).
    17. Tavana, Madjid & Mina, Hassan & Santos-Arteaga, Francisco J., 2023. "A general Best-Worst method considering interdependency with application to innovation and technology assessment at NASA," Journal of Business Research, Elsevier, vol. 154(C).
    18. Sisto, Roberta & Fernández-Portillo, Luis A. & Yazdani, Morteza & Estepa-Mohedano, Lorenzo & Torkayesh, Ali Ebadi, 2022. "Strategic planning of rural areas: Integrating participatory backcasting and multiple criteria decision analysis tools," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).
    19. Samieinasab, Mina & Hamid, Mahdi & Rabbani, Masoud, 2022. "An integrated resilience engineering-lean management approach to performance assessment and improvement of clinical departments," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    20. Maghsoud Amiri & Mohammad Hashemi-Tabatabaei & Mohammad Ghahremanloo & Mehdi Keshavarz-Ghorabaee & Edmundas Kazimieras Zavadskas & Arturas Kaklauskas, 2021. "Evaluating Life Cycle of Buildings Using an Integrated Approach Based on Quantitative-Qualitative and Simplified Best-Worst Methods (QQM-SBWM)," Sustainability, MDPI, vol. 13(8), pages 1-28, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:130:y:2025:i:c:s0305048324001403. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.