IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v96y2020ics0305048319308448.html
   My bibliography  Save this article

Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods

Author

Listed:
  • Mohammadi, Majid
  • Rezaei, Jafar

Abstract

One of the essential problems in multi-criteria decision-making (MCDM) is ranking a set of alternatives based on a set of criteria. In this regard, there exist several MCDM methods which rank the alternatives in different ways. As such, it would be worthwhile to try and arrive at a consensus on this important subject. In this paper, a new approach is proposed based on the half-quadratic (HQ) theory. The proposed approach determines an optimal weight for each of the MCDM ranking methods, which are used to compute the aggregated final ranking. The weight of each ranking method is obtained via a minimizer function that is inspired by the HQ theory, which automatically fulfills the basic constraints of weights in MCDM. The proposed framework also provides a consensus index and a trust level for the aggregated ranking. To illustrate the proposed approach, the evaluation and comparison of ontology alignment systems are modeled as an MCDM problem and the proposed framework is applied to the ontology alignment evaluation initiative (OAEI) 2018, for which the ranking of participating systems is of the utmost importance.

Suggested Citation

  • Mohammadi, Majid & Rezaei, Jafar, 2020. "Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods," Omega, Elsevier, vol. 96(C).
    • Handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319308448
    DOI: 10.1016/j.omega.2020.102254
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048319308448
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.omega.2020.102254?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Govindan, Kannan & Kadziński, Miłosz & Sivakumar, R., 2017. "Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain," Omega, Elsevier, vol. 71(C), pages 129-145.
    2. Gang Kou & Yanqun Lu & Yi Peng & Yong Shi, 2012. "Evaluation Of Classification Algorithms Using Mcdm And Rank Correlation," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 11(01), pages 197-225.
    3. Du, Yuxian & Gao, Cai & Hu, Yong & Mahadevan, Sankaran & Deng, Yong, 2014. "A new method of identifying influential nodes in complex networks based on TOPSIS," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 399(C), pages 57-69.
    4. Peng, Yi & Kou, Gang & Wang, Guoxun & Shi, Yong, 2011. "FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms," Omega, Elsevier, vol. 39(6), pages 677-689, December.
    5. Shojaei, Payam & Seyed Haeri, Seyed Amin & Mohammadi, Sahar, 2018. "Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 4-13.
    6. Edwards, Ward & Barron, F. Hutton, 1994. "SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement," Organizational Behavior and Human Decision Processes, Elsevier, vol. 60(3), pages 306-325, December.
    7. Banu Soylu, 2010. "Integrating Prometheeii With The Tchebycheff Function For Multi Criteria Decision Making," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 9(04), pages 525-545.
    8. Opricovic, Serafim & Tzeng, Gwo-Hshiung, 2004. "Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS," European Journal of Operational Research, Elsevier, vol. 156(2), pages 445-455, July.
    9. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ridha, Hussein Mohammed & Gomes, Chandima & Hizam, Hashim & Ahmadipour, Masoud & Heidari, Ali Asghar & Chen, Huiling, 2021. "Multi-objective optimization and multi-criteria decision-making methods for optimal design of standalone photovoltaic system: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    2. Feng, Jianghong & Xu, Su Xiu & Xu, Gangyan & Cheng, Huibing, 2022. "An integrated decision-making method for locating parking centers of recyclable waste transportation vehicles," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 157(C).
    3. Akbari, Sina & Escobedo, Adolfo R., 2023. "Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties," Omega, Elsevier, vol. 119(C).
    4. Wang, Qun & Jia, Guozhu & Song, Wenyan, 2022. "Identifying critical factors in systems with interrelated components: A method considering heterogeneous influence and strength attenuation," European Journal of Operational Research, Elsevier, vol. 303(1), pages 456-470.
    5. Juin-Hao Ho & Gwo-Guang Lee & Ming-Tsang Lu, 2020. "Exploring the Implementation of a Legal AI Bot for Sustainable Development in Legal Advisory Institutions," Sustainability, MDPI, vol. 12(15), pages 1-17, July.
    6. Amin Mahmoudi & Saad Ahmed Javed, 2022. "Probabilistic Approach to Multi-Stage Supplier Evaluation: Confidence Level Measurement in Ordinal Priority Approach," Group Decision and Negotiation, Springer, vol. 31(5), pages 1051-1096, October.
    7. Meng, Fanyong & Tang, Jie & An, Qingxian, 2023. "Cooperative game based two-stage consensus adjustment mechanism for large-scale group decision making," Omega, Elsevier, vol. 117(C).
    8. Fu, Yelin & Lu, Yihe & Yu, Chen & Lai, Kin Keung, 2022. "Inter-country comparisons of energy system performance with the energy trilemma index: An ensemble ranking methodology based on the half-quadratic theory," Energy, Elsevier, vol. 261(PA).
    9. Jalil Heidary Dahooie & Ali Husseinzadeh Kashan & Zahra Shoaei Naeini & Amir Salar Vanaki & Edmundas Kazimieras Zavadskas & Zenonas Turskis, 2022. "A Hybrid Multi-Criteria-Decision-Making Aggregation Method and Geographic Information System for Selecting Optimal Solar Power Plants in Iran," Energies, MDPI, vol. 15(8), pages 1-20, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zheng Yuan & Baohua Wen & Cheng He & Jin Zhou & Zhonghua Zhou & Feng Xu, 2022. "Application of Multi-Criteria Decision-Making Analysis to Rural Spatial Sustainability Evaluation: A Systematic Review," IJERPH, MDPI, vol. 19(11), pages 1-31, May.
    2. Thomas L. Saaty & Daji Ergu, 2015. "When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(06), pages 1171-1187, November.
    3. Aytekin, Ahmet & Korucuk, Selçuk & Görçün, Ömer Faruk, 2024. "Determining the factors affecting transportation demand management and selecting the best strategy: A case study," Transport Policy, Elsevier, vol. 146(C), pages 150-166.
    4. Eduardo Fernandez & Jorge Navarro & Rafael Olmedo, 2018. "Characterization of the Effectiveness of Several Outranking-Based Multi-Criteria Sorting Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1047-1084, July.
    5. Mi, Xiaomei & Tang, Ming & Liao, Huchang & Shen, Wenjing & Lev, Benjamin, 2019. "The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what's next?," Omega, Elsevier, vol. 87(C), pages 205-225.
    6. Huseyin Kocak & Atalay Caglar & Gulin Zeynep Oztas, 2018. "Euclidean Best–Worst Method and Its Application," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(05), pages 1587-1605, September.
    7. Morteza Yazdani & Dragan Pamucar & Prasenjit Chatterjee & Ali Ebadi Torkayesh, 2022. "“A multi-tier sustainable food supplier selection model under uncertainty”," Operations Management Research, Springer, vol. 15(1), pages 116-145, June.
    8. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    9. Hisham Alidrisi, 2021. "An Innovative Job Evaluation Approach Using the VIKOR Algorithm," JRFM, MDPI, vol. 14(6), pages 1-19, June.
    10. Jing Wang & Jian-Qiang Wang & Hong-Yu Zhang & Xiao-Hong Chen, 2017. "Distance-Based Multi-Criteria Group Decision-Making Approaches with Multi-Hesitant Fuzzy Linguistic Information," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(04), pages 1069-1099, July.
    11. Lei Wang & Qing Liu & Tongle Yin, 2018. "Decision-making of investment in navigation safety improving schemes with application of cumulative prospect theory," Journal of Risk and Reliability, , vol. 232(6), pages 710-724, December.
    12. Mete, Suleyman & Yucesan, Melih & Gul, Muhammet & Ozceylan, Eren, 2023. "An integrated hybrid MCDM approach to evaluate countries’ COVID-19 risks," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    13. Abderahman Rejeb & Karim Rejeb & John G. Keogh & Suhaiza Zailani, 2022. "Barriers to Blockchain Adoption in the Circular Economy: A Fuzzy Delphi and Best-Worst Approach," Sustainability, MDPI, vol. 14(6), pages 1-23, March.
    14. Kuo, Ting, 2017. "A modified TOPSIS with a different ranking index," European Journal of Operational Research, Elsevier, vol. 260(1), pages 152-160.
    15. Peide Liu & Peng Wang, 2017. "Some Improved Linguistic Intuitionistic Fuzzy Aggregation Operators and Their Applications to Multiple-Attribute Decision Making," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(03), pages 817-850, May.
    16. Iwaro, Joseph & Mwasha, Abrahams & Williams, Rupert G. & Zico, Ricardo, 2014. "An Integrated Criteria Weighting Framework for the sustainable performance assessment and design of building envelope," Renewable and Sustainable Energy Reviews, Elsevier, vol. 29(C), pages 417-434.
    17. Máximo Méndez & Mariano Frutos & Fabio Miguel & Ricardo Aguasca-Colomo, 2020. "TOPSIS Decision on Approximate Pareto Fronts by Using Evolutionary Algorithms: Application to an Engineering Design Problem," Mathematics, MDPI, vol. 8(11), pages 1-27, November.
    18. Kusi-Sarpong, Simonov & Orji, Ifeyinwa Juliet & Gupta, Himanshu & Kunc, Martin, 2021. "Risks associated with the implementation of big data analytics in sustainable supply chains," Omega, Elsevier, vol. 105(C).
    19. Ginger Saltos & Mihaela Cocea, 2017. "An Exploration of Crime Prediction Using Data Mining on Open Data," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(05), pages 1155-1181, September.
    20. Babak Daneshvar Rouyendegh & Kazim Topuz & Ali Dag & Asil Oztekin, 2019. "An AHP-IFT Integrated Model for Performance Evaluation of E-Commerce Web Sites," Information Systems Frontiers, Springer, vol. 21(6), pages 1345-1355, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319308448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.