IDEAS home Printed from https://ideas.repec.org/a/spr/aqjoor/v22y2024i3d10.1007_s10288-023-00553-5.html
   My bibliography  Save this article

Is the best–worst method path dependent? Evidence from an empirical study

Author

Listed:
  • Jiri Mazurek

    (Silesian University Opava)

  • Radomír Perzina

    (Silesian University Opava)

  • Dominik Strzałka

    (Silesian University Opava
    Rzeszów University of Technology)

  • Bartosz Kowal

    (Rzeszów University of Technology)

  • Paweł Kuraś

    (Rzeszów University of Technology)

  • Barbora Petrů Puhrová

    (Tomas Bata University in Zlin)

  • Robert Rajs

    (Carpathian State College in Krosno)

Abstract

The Best–Worst method (BWM) is one of the latest contributions to pairwise comparisons methods. As its name suggests, it is based on pairwise comparisons of all criteria (or possibly other objects, such as alternatives, sub-criteria, etc.) with respect to the best (most important) and the worst (least important) criterion. The main aim of this study is to investigate the path and scale dependency of the BWM. Up to now, it is unknown whether the weights of compared objects obtained by the method differ when the objects are compared first with the best object, and then with the worst, or vice versa. It is also unknown if the outcomes of the method differ when compared objects are presented in a different order, or when different scales are applied. Therefore, an experiment in a laboratory setting is performed with more than 800 respondents university undergraduates from two countries in which the respondents compare areas of randomly generated figures and the relative size of objects is then estimated via the linearized version of the BWM. Last but not least, the accuracy of the BWM is examined with respect to different comparison scales, including Saaty’s nine-point linguistic scale, an integer scale from 1 to 9, and a continuous scale from 1 to infinity.

Suggested Citation

  • Jiri Mazurek & Radomír Perzina & Dominik Strzałka & Bartosz Kowal & Paweł Kuraś & Barbora Petrů Puhrová & Robert Rajs, 2024. "Is the best–worst method path dependent? Evidence from an empirical study," 4OR, Springer, vol. 22(3), pages 387-409, September.
    • Handle: RePEc:spr:aqjoor:v:22:y:2024:i:3:d:10.1007_s10288-023-00553-5
    DOI: 10.1007/s10288-023-00553-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10288-023-00553-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10288-023-00553-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lahtinen, Tuomas J. & Hämäläinen, Raimo P. & Jenytin, Cosmo, 2020. "On preference elicitation processes which mitigate the accumulation of biases in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 282(1), pages 201-210.
    2. Poyhonen, Mari & Hamalainen, Raimo P., 2001. "On the convergence of multiattribute weighting methods," European Journal of Operational Research, Elsevier, vol. 129(3), pages 569-585, March.
    3. Lahtinen, Tuomas J. & Hämäläinen, Raimo P., 2016. "Path dependence and biases in the even swaps decision analysis method," European Journal of Operational Research, Elsevier, vol. 249(3), pages 890-898.
    4. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    5. Mu-Hsin Chang & James J. H. Liou & Huai-Wei Lo, 2019. "A Hybrid MCDM Model for Evaluating Strategic Alliance Partners in the Green Biopharmaceutical Industry," Sustainability, MDPI, vol. 11(15), pages 1-20, July.
    6. Hämäläinen, Raimo P. & Lahtinen, Tuomas J., 2016. "Path dependence in Operational Research—How the modeling process can influence the results," Operations Research Perspectives, Elsevier, vol. 3(C), pages 14-20.
    7. P Leskinen, 2008. "Numerical scaling of ratio scale utilities in multi-criteria decision analysis with geometric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(3), pages 407-415, March.
    8. Rezaei, Jafar, 2016. "Best-worst multi-criteria decision-making method: Some properties and a linear model," Omega, Elsevier, vol. 64(C), pages 126-130.
    9. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    10. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    11. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    12. Landry, Maurice & Malouin, Jean-Louis & Oral, Muhittin, 1983. "Model validation in operations research," European Journal of Operational Research, Elsevier, vol. 14(3), pages 207-220, November.
    13. Hämäläinen, Raimo P. & Alaja, Susanna, 2008. "The threat of weighting biases in environmental decision analysis," Ecological Economics, Elsevier, vol. 68(1-2), pages 556-569, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lahtinen, Tuomas J. & Hämäläinen, Raimo P. & Jenytin, Cosmo, 2020. "On preference elicitation processes which mitigate the accumulation of biases in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 282(1), pages 201-210.
    2. Amelia Bilbao-Terol & Mar Arenas-Parra & Raquel Quiroga-García & Celia Bilbao-Terol, 2022. "An extended best–worst multiple reference point method: application in the assessment of non-life insurance companies," Operational Research, Springer, vol. 22(5), pages 5323-5362, November.
    3. Lahtinen, Tuomas J. & Hämäläinen, Raimo P., 2016. "Path dependence and biases in the even swaps decision analysis method," European Journal of Operational Research, Elsevier, vol. 249(3), pages 890-898.
    4. Zhang, Long & Bai, Wuliyasu, 2021. "Sustainability of crop–based biodiesel for transportation in China: Barrier analysis and life cycle ecological footprint calculations," Technological Forecasting and Social Change, Elsevier, vol. 164(C).
    5. Rabia Bovkir & Eda Ustaoglu & Arif Cagdas Aydinoglu, 2023. "Assessment of Urban Quality of Life Index at Local Scale with Different Weighting Approaches," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(2), pages 655-678, January.
    6. Ilyas Mzougui & Zoubir El Felsoufi, 2021. "A modified method to improve failure analysis," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 12(2), pages 231-244, April.
    7. Sondoss Elsawah & Elena Bakhanova & Raimo P. Hämäläinen & Alexey Voinov, 2023. "A Competency Framework for Participatory Modeling," Group Decision and Negotiation, Springer, vol. 32(3), pages 569-601, June.
    8. Madjid Tavana & Mehdi Soltanifar & Francisco J. Santos-Arteaga, 2023. "Analytical hierarchy process: revolution and evolution," Annals of Operations Research, Springer, vol. 326(2), pages 879-907, July.
    9. Kumar, Aalok & Anbanandam, Ramesh, 2022. "Assessment of environmental and social sustainability performance of the freight transportation industry: An index-based approach," Transport Policy, Elsevier, vol. 124(C), pages 43-60.
    10. Hämäläinen, Raimo P. & Lahtinen, Tuomas J., 2016. "Path dependence in Operational Research—How the modeling process can influence the results," Operations Research Perspectives, Elsevier, vol. 3(C), pages 14-20.
    11. Ren, Jingzheng & Liang, Hanwei & Chan, Felix T.S., 2017. "Urban sewage sludge, sustainability, and transition for Eco-City: Multi-criteria sustainability assessment of technologies based on best-worst method," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 29-39.
    12. James J. H. Liou & Perry C. Y. Liu & Huai-Wei Lo, 2020. "A Failure Mode Assessment Model Based on Neutrosophic Logic for Switched-Mode Power Supply Risk Analysis," Mathematics, MDPI, vol. 8(12), pages 1-19, December.
    13. Liang, Fuqi & Brunelli, Matteo & Rezaei, Jafar, 2020. "Consistency issues in the best worst method: Measurements and thresholds," Omega, Elsevier, vol. 96(C).
    14. Salimi, Negin & Rezaei, Jafar, 2018. "Evaluating firms’ R&D performance using best worst method," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 147-155.
    15. Ravindra Singh Saluja & Varinder Singh, 2023. "Attribute-based characterization, coding, and selection of joining processes using a novel MADM approach," OPSEARCH, Springer;Operational Research Society of India, vol. 60(2), pages 616-655, June.
    16. Mortenson, Michael J. & Doherty, Neil F. & Robinson, Stewart, 2015. "Operational research from Taylorism to Terabytes: A research agenda for the analytics age," European Journal of Operational Research, Elsevier, vol. 241(3), pages 583-595.
    17. Zheng Yuan & Baohua Wen & Cheng He & Jin Zhou & Zhonghua Zhou & Feng Xu, 2022. "Application of Multi-Criteria Decision-Making Analysis to Rural Spatial Sustainability Evaluation: A Systematic Review," IJERPH, MDPI, vol. 19(11), pages 1-31, May.
    18. Junli Zhang & Guoteng Wang & Zheng Xu & Zheren Zhang, 2022. "A Comprehensive Evaluation Method and Strengthening Measures for AC/DC Hybrid Power Grids," Energies, MDPI, vol. 15(12), pages 1-20, June.
    19. Hamzeh Soltanali & Mehdi Khojastehpour & Siamak Kheybari, 2023. "Evaluating the critical success factors for maintenance management in agro-industries using multi-criteria decision-making techniques," Operations Management Research, Springer, vol. 16(2), pages 949-968, June.
    20. Yossi Hadad & Baruch Keren & Dima Alberg, 2023. "An Expert System for Ranking and Matching Electric Vehicles to Customer Specifications and Requirements," Energies, MDPI, vol. 16(11), pages 1-18, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aqjoor:v:22:y:2024:i:3:d:10.1007_s10288-023-00553-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.