IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v286y2020i3p963-985.html
   My bibliography  Save this article

A preference learning framework for multiple criteria sorting with diverse additive value models and valued assignment examples

Author

Listed:
  • Liu, Jiapeng
  • Kadziński, Miłosz
  • Liao, Xiuwu
  • Mao, Xiaoxin
  • Wang, Yao

Abstract

We present a preference learning framework for multiple criteria sorting. We consider sorting procedures applying an additive value model with diverse types of marginal value functions (including linear, piecewise-linear, splined, and general monotone ones) under a unified analytical framework. Differently from the existing sorting methods that infer a preference model from crisp decision examples, where each reference alternative is assigned to a unique class, our framework allows considering valued assignment examples in which a reference alternative can be classified into multiple classes with respective credibility degrees. We propose an optimization model for constructing a preference model from such valued examples by maximizing the credible consistency among reference alternatives. To improve the predictive ability of the constructed model on new instances, we employ the regularization techniques. Moreover, to enhance the capability of addressing large-scale datasets, we introduce a state-of-the-art algorithm that is widely used in the machine learning community to solve the proposed optimization model in a computationally efficient way. Using the constructed additive value model, we determine both crisp and valued assignments for non-reference alternatives. Moreover, we allow the Decision Maker to prioritize the importance of classes and give the method a flexibility to adjust classification performance across classes according to the specified priorities. The practical usefulness of the analytical framework is demonstrated on a real-world dataset by comparing it to several existing sorting methods.

Suggested Citation

  • Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu & Mao, Xiaoxin & Wang, Yao, 2020. "A preference learning framework for multiple criteria sorting with diverse additive value models and valued assignment examples," European Journal of Operational Research, Elsevier, vol. 286(3), pages 963-985.
  • Handle: RePEc:eee:ejores:v:286:y:2020:i:3:p:963-985
    DOI: 10.1016/j.ejor.2020.04.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720303465
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.04.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2010. "Multiple criteria sorting with a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1455-1470, December.
    2. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 2001. "Rough sets theory for multicriteria decision analysis," European Journal of Operational Research, Elsevier, vol. 129(1), pages 1-47, February.
    3. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2010. "Electre Tri-C: A multiple criteria sorting method based on characteristic reference actions," European Journal of Operational Research, Elsevier, vol. 204(3), pages 565-580, August.
    4. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    5. Liu, Jiapeng & Liao, Xiuwu & Kadziński, Miłosz & Słowiński, Roman, 2019. "Preference disaggregation within the regularization framework for sorting problems with multiple potentially non-monotonic criteria," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1071-1089.
    6. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    7. Figueira, Jose & Roy, Bernard, 2002. "Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure," European Journal of Operational Research, Elsevier, vol. 139(2), pages 317-326, June.
    8. Doumpos, Michael & Zopounidis, Constantin & Galariotis, Emilios, 2014. "Inferring robust decision models in multicriteria classification problems: An experimental analysis," European Journal of Operational Research, Elsevier, vol. 236(2), pages 601-611.
    9. Dias, Luis C. & Vetschera, Rudolf, 2019. "On generating utility functions in Stochastic Multicriteria Acceptability Analysis," European Journal of Operational Research, Elsevier, vol. 278(2), pages 672-685.
    10. Risto Lahdelma & Pekka Salminen, 2010. "Stochastic Multicriteria Acceptability Analysis (SMAA)," International Series in Operations Research & Management Science, in: Matthias Ehrgott & José Rui Figueira & Salvatore Greco (ed.), Trends in Multiple Criteria Decision Analysis, chapter 0, pages 285-315, Springer.
    11. Liu, Jiapeng & Liao, Xiuwu & Zhao, Wenhong & Yang, Na, 2016. "A classification approach based on the outranking model for multiple criteria ABC analysis," Omega, Elsevier, vol. 61(C), pages 19-34.
    12. Tervonen, Tommi & Figueira, José Rui & Lahdelma, Risto & Dias, Juscelino Almeida & Salminen, Pekka, 2009. "A stochastic method for robustness analysis in sorting problems," European Journal of Operational Research, Elsevier, vol. 192(1), pages 236-242, January.
    13. Spliet, Remy & Tervonen, Tommi, 2014. "Preference inference with general additive value models and holistic pair-wise statements," European Journal of Operational Research, Elsevier, vol. 232(3), pages 607-612.
    14. Dias, Luis & Mousseau, Vincent & Figueira, Jose & Climaco, Joao, 2002. "An aggregation/disaggregation approach to obtain robust conclusions with ELECTRE TRI," European Journal of Operational Research, Elsevier, vol. 138(2), pages 332-348, April.
    15. Brito, Anderson J. & de Almeida, Adiel Teixeira & Mota, Caroline M.M., 2010. "A multicriteria model for risk sorting of natural gas pipelines based on ELECTRE TRI integrating Utility Theory," European Journal of Operational Research, Elsevier, vol. 200(3), pages 812-821, February.
    16. Cailloux, Olivier & Meyer, Patrick & Mousseau, Vincent, 2012. "Eliciting Electre Tri category limits for a group of decision makers," European Journal of Operational Research, Elsevier, vol. 223(1), pages 133-140.
    17. Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2016. "Multiple Criteria Hierarchy Process for ELECTRE Tri methods," European Journal of Operational Research, Elsevier, vol. 252(1), pages 191-203.
    18. Michael Doumpos & Constantin Zopounidis & Emilios C. C Galariotis, 2014. "Inferring robust decision models in multicriteria classification problems: An experimental analysis," Post-Print hal-00961323, HAL.
    19. Pelissari, Renata & Oliveira, Maria Célia & Ben Amor, Sarah & Abackerli, Alvaro José, 2019. "A new FlowSort-based method to deal with information imperfections in sorting decision-making problems," European Journal of Operational Research, Elsevier, vol. 276(1), pages 235-246.
    20. Sobrie, Olivier & Gillis, Nicolas & Mousseau, Vincent & Pirlot, Marc, 2018. "UTA-poly and UTA-splines: Additive value functions with polynomial marginals," European Journal of Operational Research, Elsevier, vol. 264(2), pages 405-418.
    21. James G. March, 1978. "Bounded Rationality, Ambiguity, and the Engineering of Choice," Bell Journal of Economics, The RAND Corporation, vol. 9(2), pages 587-608, Autumn.
    22. Ghaderi, Mohammad & Ruiz, Francisco & Agell, Núria, 2017. "A linear programming approach for learning non-monotonic additive value functions in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 259(3), pages 1073-1084.
    23. Doumpos, Michalis & Figueira, José Rui, 2019. "A multicriteria outranking approach for modeling corporate credit ratings: An application of the Electre Tri-nC method," Omega, Elsevier, vol. 82(C), pages 166-180.
    24. Salvatore Corrente & Michael Doumpos & Salvatore Greco & Roman Słowiński & Constantin Zopounidis, 2017. "Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions," Annals of Operations Research, Springer, vol. 251(1), pages 117-139, April.
    25. Kadziński, Miłosz & Ghaderi, Mohammad & Dąbrowski, Maciej, 2020. "Contingent preference disaggregation model for multiple criteria sorting problem," European Journal of Operational Research, Elsevier, vol. 281(2), pages 369-387.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dias, Luis C. & Dias, Joana & Ventura, Tiago & Rocha, Humberto & Ferreira, Brígida & Khouri, Leila & Lopes, Maria do Carmo, 2022. "Learning target-based preferences through additive models: An application in radiotherapy treatment planning," European Journal of Operational Research, Elsevier, vol. 302(1), pages 270-279.
    2. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods. Part II: theoretical results and general issues," 4OR, Springer, vol. 21(2), pages 181-204, June.
    3. Wu, Xingli & Liao, Huchang, 2023. "Value-driven preference disaggregation analysis for uncertain preference information," Omega, Elsevier, vol. 115(C).
    4. Zhen Zhang & Zhuolin Li, 2023. "Consensus-based TOPSIS-Sort-B for multi-criteria sorting in the context of group decision-making," Annals of Operations Research, Springer, vol. 325(2), pages 911-938, June.
    5. Li, Cong-Cong & Dong, Yucheng & Liang, Haiming & Pedrycz, Witold & Herrera, Francisco, 2022. "Data-driven method to learning personalized individual semantics to support linguistic multi-attribute decision making," Omega, Elsevier, vol. 111(C).
    6. Ru, Zice & Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu, 2023. "Probabilistic ordinal regression methods for multiple criteria sorting admitting certain and uncertain preferences," European Journal of Operational Research, Elsevier, vol. 311(2), pages 596-616.
    7. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    8. Wang, Liang & Zhang, Zi-Xin & Ishizaka, Alessio & Wang, Ying-Ming & Martínez, Luis, 2023. "TODIMSort: A TODIM based method for sorting problems," Omega, Elsevier, vol. 115(C).
    9. Kadziński, Miłosz & Ciomek, Krzysztof, 2021. "Active learning strategies for interactive elicitation of assignment examples for threshold-based multiple criteria sorting," European Journal of Operational Research, Elsevier, vol. 293(2), pages 658-680.
    10. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    11. Tlili, Ali & Belahcène, Khaled & Khaled, Oumaima & Mousseau, Vincent & Ouerdane, Wassila, 2022. "Learning non-compensatory sorting models using efficient SAT/MaxSAT formulations," European Journal of Operational Research, Elsevier, vol. 298(3), pages 979-1006.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kadziński, Miłosz & Ciomek, Krzysztof, 2021. "Active learning strategies for interactive elicitation of assignment examples for threshold-based multiple criteria sorting," European Journal of Operational Research, Elsevier, vol. 293(2), pages 658-680.
    2. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    3. Kadziński, Miłosz & Ghaderi, Mohammad & Dąbrowski, Maciej, 2020. "Contingent preference disaggregation model for multiple criteria sorting problem," European Journal of Operational Research, Elsevier, vol. 281(2), pages 369-387.
    4. Liu, Jiapeng & Liao, Xiuwu & Kadziński, Miłosz & Słowiński, Roman, 2019. "Preference disaggregation within the regularization framework for sorting problems with multiple potentially non-monotonic criteria," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1071-1089.
    5. Tlili, Ali & Belahcène, Khaled & Khaled, Oumaima & Mousseau, Vincent & Ouerdane, Wassila, 2022. "Learning non-compensatory sorting models using efficient SAT/MaxSAT formulations," European Journal of Operational Research, Elsevier, vol. 298(3), pages 979-1006.
    6. Sarah Ben Amor & Fateh Belaid & Ramzi Benkraiem & Boumediene Ramdani & Khaled Guesmi, 2023. "Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda," Annals of Operations Research, Springer, vol. 325(2), pages 771-793, June.
    7. Miłosz Kadziński & Magdalena Martyn, 2021. "Enriched preference modeling and robustness analysis for the ELECTRE Tri-B method," Annals of Operations Research, Springer, vol. 306(1), pages 173-207, November.
    8. Kadziński, Miłosz & Wójcik, Michał & Ciomek, Krzysztof, 2022. "Review and experimental comparison of ranking and choice procedures for constructing a univocal recommendation in a preference disaggregation setting," Omega, Elsevier, vol. 113(C).
    9. Ru, Zice & Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu, 2023. "Probabilistic ordinal regression methods for multiple criteria sorting admitting certain and uncertain preferences," European Journal of Operational Research, Elsevier, vol. 311(2), pages 596-616.
    10. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    11. Zhen Zhang & Zhuolin Li, 2023. "Consensus-based TOPSIS-Sort-B for multi-criteria sorting in the context of group decision-making," Annals of Operations Research, Springer, vol. 325(2), pages 911-938, June.
    12. Kadziński, Miłosz & Cinelli, Marco & Ciomek, Krzysztof & Coles, Stuart R. & Nadagouda, Mallikarjuna N. & Varma, Rajender S. & Kirwan, Kerry, 2018. "Co-constructive development of a green chemistry-based model for the assessment of nanoparticles synthesis," European Journal of Operational Research, Elsevier, vol. 264(2), pages 472-490.
    13. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    14. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    15. Liu, Jiapeng & Liao, Xiuwu & Huang, Wei & Yang, Jian-bo, 2018. "A new decision-making approach for multiple criteria sorting with an imbalanced set of assignment examples," European Journal of Operational Research, Elsevier, vol. 265(2), pages 598-620.
    16. Jindong Qin & Yingying Liang & Luis Martinez & Alessio Ishizaka & Witold Pedrycz, 2023. "ORESTE-SORT: a novel multiple criteria sorting method for sorting port group competitiveness," Annals of Operations Research, Springer, vol. 325(2), pages 875-909, June.
    17. Eduardo Fernandez & Jorge Navarro & Rafael Olmedo, 2018. "Characterization of the Effectiveness of Several Outranking-Based Multi-Criteria Sorting Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1047-1084, July.
    18. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    19. Fernandez, Eduardo & Navarro, Jorge, 2011. "A new approach to multi-criteria sorting based on fuzzy outranking relations: The THESEUS method," European Journal of Operational Research, Elsevier, vol. 213(2), pages 405-413, September.
    20. Ciomek, Krzysztof & Ferretti, Valentina & Kadzinski, Milosz, 2018. "Predictive analytics and disused railways requalification: insights from a Post Factum Analysis perspective," LSE Research Online Documents on Economics 85922, London School of Economics and Political Science, LSE Library.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:286:y:2020:i:3:p:963-985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.