IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v130y2025ics0305048324001403.html
   My bibliography  Save this article

A comparative study on precision of direct evaluations, the Pairwise Comparisons Method and the Best-Worst Method

Author

Listed:
  • Cavallo, Bice
  • Ishizaka, Alessio

Abstract

The aim of this paper is to design, carry out and analyze an experiment with over 100 respondents to measure the precision of the respondents when they compare (by evaluation) the areas of nine geometric figures and five distances between cities by using direct evaluations, Pairwise Comparisons Method and Best-Worst Method. The outcomes of the experiment indicate that the direct evaluations are the most imprecise and that there is not statistically significant difference between Best-Worst Method and Pairwise Comparisons Method.

Suggested Citation

  • Cavallo, Bice & Ishizaka, Alessio, 2025. "A comparative study on precision of direct evaluations, the Pairwise Comparisons Method and the Best-Worst Method," Omega, Elsevier, vol. 130(C).
    • Handle: RePEc:eee:jomega:v:130:y:2025:i:c:s0305048324001403
    DOI: 10.1016/j.omega.2024.103175
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048324001403
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.omega.2024.103175?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bice Cavallo & Alessio Ishizaka & Maria Grazia Olivieri & Massimo Squillante, 2019. "Comparing inconsistency of pairwise comparison matrices depending on entries," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(5), pages 842-850, May.
    2. Liang, Fuqi & Brunelli, Matteo & Rezaei, Jafar, 2020. "Consistency issues in the best worst method: Measurements and thresholds," Omega, Elsevier, vol. 96(C).
    3. Ramanathan, Ramakrishnan & Ramanathan, Usha, 2010. "A qualitative perspective to deriving weights from pairwise comparison matrices," Omega, Elsevier, vol. 38(3-4), pages 228-232, June.
    4. Bice Cavallo & Alessio Ishizaka, 2023. "Evaluating scales for pairwise comparisons," Annals of Operations Research, Springer, vol. 325(2), pages 951-965, June.
    5. Mi, Xiaomei & Tang, Ming & Liao, Huchang & Shen, Wenjing & Lev, Benjamin, 2019. "The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what's next?," Omega, Elsevier, vol. 87(C), pages 205-225.
    6. Rezaei, Jafar, 2016. "Best-worst multi-criteria decision-making method: Some properties and a linear model," Omega, Elsevier, vol. 64(C), pages 126-130.
    7. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Corrente, Salvatore & Greco, Salvatore & Rezaei, Jafar, 2024. "Better decisions with less cognitive load: The Parsimonious BWM," Omega, Elsevier, vol. 126(C).
    2. Wu, Qun & Liu, Xinwang & Zhou, Ligang & Qin, Jindong & Rezaei, Jafar, 2024. "An analytical framework for the best–worst method," Omega, Elsevier, vol. 123(C).
    3. Kheybari, Siamak & Javdanmehr, Mahsa & Rezaie, Fariba Mahdi & Rezaei, Jafar, 2021. "Corn cultivation location selection for bioethanol production: An application of BWM and extended PROMETHEE II," Energy, Elsevier, vol. 228(C).
    4. Danish Farooq & Sarbast Moslem & Arshad Jamal & Farhan Muhammad Butt & Yahya Almarhabi & Rana Faisal Tufail & Meshal Almoshaogeh, 2021. "Assessment of Significant Factors Affecting Frequent Lane-Changing Related to Road Safety: An Integrated Approach of the AHP–BWM Model," IJERPH, MDPI, vol. 18(20), pages 1-17, October.
    5. Aziz Naghizadeh Vardin & Ramin Ansari & Mohammad Khalilzadeh & Jurgita Antucheviciene & Romualdas Bausys, 2021. "An Integrated Decision Support Model Based on BWM and Fuzzy-VIKOR Techniques for Contractor Selection in Construction Projects," Sustainability, MDPI, vol. 13(12), pages 1-28, June.
    6. Junnan Wu & Xin Liu & Dianqi Pan & Yichen Zhang & Jiquan Zhang & Kai Ke, 2023. "Research on Safety Evaluation of Municipal Sewage Treatment Plant Based on Improved Best-Worst Method and Fuzzy Comprehensive Method," Sustainability, MDPI, vol. 15(11), pages 1-15, May.
    7. Feng, Jianghong & Guo, Ping & Xu, Guangyi & Xu, Gangyan & Ning, Yu, 2024. "An integrated decision framework for resilient sustainable waste electric vehicle battery recycling transfer station site selection," Applied Energy, Elsevier, vol. 373(C).
    8. Liang, Fuqi & Brunelli, Matteo & Rezaei, Jafar, 2020. "Consistency issues in the best worst method: Measurements and thresholds," Omega, Elsevier, vol. 96(C).
    9. Besharati Fard, Moein & Moradian, Parisa & Emarati, Mohammadreza & Ebadi, Mehdi & Gholamzadeh Chofreh, Abdoulmohammad & Klemeŝ, Jiří Jaromír, 2022. "Ground-mounted photovoltaic power station site selection and economic analysis based on a hybrid fuzzy best-worst method and geographic information system: A case study Guilan province," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    10. Xiao-Kang Wang & Wen-Hui Hou & Chao Song & Min-Hui Deng & Yong-Yi Li & Jian-Qiang Wang, 2021. "BW-MaxEnt: A Novel MCDM Method for Limited Knowledge," Mathematics, MDPI, vol. 9(14), pages 1-17, July.
    11. Chong Li & He Huang & Ya Luo, 2022. "An Integrated Two-Dimension Linguistic Intuitionistic Fuzzy Decision-Making Approach for Unmanned Aerial Vehicle Supplier Selection," Sustainability, MDPI, vol. 14(18), pages 1-24, September.
    12. Sarbast Moslem & Muhammet Gul & Danish Farooq & Erkan Celik & Omid Ghorbanzadeh & Thomas Blaschke, 2020. "An Integrated Approach of Best-Worst Method (BWM) and Triangular Fuzzy Sets for Evaluating Driver Behavior Factors Related to Road Safety," Mathematics, MDPI, vol. 8(3), pages 1-20, March.
    13. Madjid Tavana & Mehdi Soltanifar & Francisco J. Santos-Arteaga, 2023. "Analytical hierarchy process: revolution and evolution," Annals of Operations Research, Springer, vol. 326(2), pages 879-907, July.
    14. Zsombor Szádoczki & Sándor Bozóki & Patrik Juhász & Sergii V. Kadenko & Vitaliy Tsyganok, 2023. "Incomplete pairwise comparison matrices based on graphs with average degree approximately 3," Annals of Operations Research, Springer, vol. 326(2), pages 783-807, July.
    15. Kusi-Sarpong, Simonov & Orji, Ifeyinwa Juliet & Gupta, Himanshu & Kunc, Martin, 2021. "Risks associated with the implementation of big data analytics in sustainable supply chains," Omega, Elsevier, vol. 105(C).
    16. Gholamreza Haseli & Reza Sheikh & Jianqiang Wang & Hana Tomaskova & Erfan Babaee Tirkolaee, 2021. "A Novel Approach for Group Decision Making Based on the Best–Worst Method (G-BWM): Application to Supply Chain Management," Mathematics, MDPI, vol. 9(16), pages 1-20, August.
    17. Murad, C.A. & Bellinello, M.M. & Silva, A.J. & Netto, A. Caminada & de Souza, G.F.M. & Nabeta, S.I., 2022. "A novel methodology employed for ranking and consolidating performance indicators in holding companies with multiple power plants based on multi-criteria decision-making method," Operations Research Perspectives, Elsevier, vol. 9(C).
    18. Mohammadi, Majid & Rezaei, Jafar, 2020. "Bayesian best-worst method: A probabilistic group decision making model," Omega, Elsevier, vol. 96(C).
    19. Siamak Kheybari & Mohammad Reza Mehrpour & Paul Bauer & Alessio Ishizaka, 2024. "How Can Risk-Averse and Risk-Taking Approaches be Considered in a Group Multi-Criteria Decision-Making Problem?," Group Decision and Negotiation, Springer, vol. 33(4), pages 883-909, August.
    20. Md. Raquibuzzaman Khan & Nazia Tabassum & Niaz Ahmed Khan & Mohammad Jahangir Alam, 2022. "Procurement challenges in public-sector agricultural development projects in Bangladesh," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-13, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:130:y:2025:i:c:s0305048324001403. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.