IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v266y2018i2p689-701.html
   My bibliography  Save this article

Bi-criteria optimization of decision trees with applications to data analysis

Author

Listed:
  • Chikalov, Igor
  • Hussain, Shahid
  • Moshkov, Mikhail

Abstract

This paper is devoted to the study of bi-criteria optimization problems for decision trees. We consider different cost functions such as depth, average depth, and number of nodes. We design algorithms that allow us to construct the set of Pareto optimal points (POPs) for a given decision table and the corresponding bi-criteria optimization problem. These algorithms are suitable for investigation of medium-sized decision tables. We discuss three examples of applications of the created tools: the study of relationships among depth, average depth and number of nodes for decision trees for corner point detection (such trees are used in computer vision for object tracking), study of systems of decision rules derived from decision trees, and comparison of different greedy algorithms for decision tree construction as single- and bi-criteria optimization algorithms.

Suggested Citation

  • Chikalov, Igor & Hussain, Shahid & Moshkov, Mikhail, 2018. "Bi-criteria optimization of decision trees with applications to data analysis," European Journal of Operational Research, Elsevier, vol. 266(2), pages 689-701.
    • Handle: RePEc:eee:ejores:v:266:y:2018:i:2:p:689-701
    DOI: 10.1016/j.ejor.2017.10.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221717309347
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2017.10.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pawlak, Zdzisaw & Sowinski, Roman, 1994. "Rough set approach to multi-attribute decision analysis," European Journal of Operational Research, Elsevier, vol. 72(3), pages 443-459, February.
    2. Muller, Wolfgang & Wiederhold, Eckhard, 2002. "Applying decision tree methodology for rules extraction under cognitive constraints," European Journal of Operational Research, Elsevier, vol. 136(2), pages 282-289, January.
    3. Frini, Anissa & Guitouni, Adel & Martel, Jean-Marc, 2012. "A general decomposition approach for multi-criteria decision trees," European Journal of Operational Research, Elsevier, vol. 220(2), pages 452-460.
    4. Jose Pangilinan & Gerrit Janssens, 2011. "Pareto-optimality of oblique decision trees from evolutionary algorithms," Journal of Global Optimization, Springer, vol. 51(2), pages 301-311, October.
    5. Abellán, Joaquín & Masegosa, Andrés R., 2010. "An ensemble method using credal decision trees," European Journal of Operational Research, Elsevier, vol. 205(1), pages 218-226, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Blanquero, Rafael & Carrizosa, Emilio & Molero-Río, Cristina & Morales, Dolores Romero, 2022. "On sparse optimal regression trees," European Journal of Operational Research, Elsevier, vol. 299(3), pages 1045-1054.
    2. Gambella, Claudio & Ghaddar, Bissan & Naoum-Sawaya, Joe, 2021. "Optimization problems for machine learning: A survey," European Journal of Operational Research, Elsevier, vol. 290(3), pages 807-828.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Azad, Mohammad & Moshkov, Mikhail, 2017. "Multi-stage optimization of decision and inhibitory trees for decision tables with many-valued decisions," European Journal of Operational Research, Elsevier, vol. 263(3), pages 910-921.
    2. Azam, Nouman & Zhang, Yan & Yao, JingTao, 2017. "Evaluation functions and decision conditions of three-way decisions with game-theoretic rough sets," European Journal of Operational Research, Elsevier, vol. 261(2), pages 704-714.
    3. Pawlak, Zdzislaw, 1997. "Rough set approach to knowledge-based decision support," European Journal of Operational Research, Elsevier, vol. 99(1), pages 48-57, May.
    4. Hu, Qiwei & Chakhar, Salem & Siraj, Sajid & Labib, Ashraf, 2017. "Spare parts classification in industrial manufacturing using the dominance-based rough set approach," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1136-1163.
    5. Salvatore Barbagallo & Simona Consoli & Nello Pappalardo & Salvatore Greco & Santo Zimbone, 2006. "Discovering Reservoir Operating Rules by a Rough Set Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 20(1), pages 19-36, February.
    6. Zopounidis, Constantin & Doumpos, Michael, 2002. "Multicriteria classification and sorting methods: A literature review," European Journal of Operational Research, Elsevier, vol. 138(2), pages 229-246, April.
    7. Cang, Shuang & Yu, Hongnian, 2014. "A combination selection algorithm on forecasting," European Journal of Operational Research, Elsevier, vol. 234(1), pages 127-139.
    8. Thomassey, Sébastien, 2010. "Sales forecasts in clothing industry: The key success factor of the supply chain management," International Journal of Production Economics, Elsevier, vol. 128(2), pages 470-483, December.
    9. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    10. Yun Kang & Shunxiang Wu & Yuwen Li & Wei Weng, 2017. "New and improved: grey multi-granulation rough sets," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(12), pages 2575-2589, September.
    11. Gülgönül Bozoğlu Batı & İsmail Hakkı Armutlulu, 2020. "Work and family conflict analysis of female entrepreneurs in Turkey and classification with rough set theory," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-12, December.
    12. Yuan Li & Xiuwu Liao & Wenhong Zhao, 2009. "A rough set approach to knowledge discovery in analyzing competitive advantages of firms," Annals of Operations Research, Springer, vol. 168(1), pages 205-223, April.
    13. Qiang Yang & Ping-an Du & Yong Wang & Bin Liang, 2017. "A rough set approach for determining weights of decision makers in group decision making," PLOS ONE, Public Library of Science, vol. 12(2), pages 1-16, February.
    14. Siskos, Y. & Spyridakos, A., 1999. "Intelligent multicriteria decision support: Overview and perspectives," European Journal of Operational Research, Elsevier, vol. 113(2), pages 236-246, March.
    15. Wu, Siqi & Wu, Meng & Dong, Yucheng & Liang, Haiming & Zhao, Sihai, 2020. "The 2-rank additive model with axiomatic design in multiple attribute decision making," European Journal of Operational Research, Elsevier, vol. 287(2), pages 536-545.
    16. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 1999. "Rough approximation of a preference relation by dominance relations," European Journal of Operational Research, Elsevier, vol. 117(1), pages 63-83, August.
    17. Anissa Frini & Adel Guitouni & Abderrezak Benaskeur, 2017. "Solving Dynamic Multi-Criteria Resource-Target Allocation Problem Under Uncertainty: A Comparison of Decomposition and Myopic Approaches," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(06), pages 1465-1496, November.
    18. Tobias Witt & Matthias Klumpp, 2021. "Multi-Period Multi-Criteria Decision Making under Uncertainty: A Renewable Energy Transition Case from Germany," Sustainability, MDPI, vol. 13(11), pages 1-20, June.
    19. Emilio Carrizosa & Cristina Molero-Río & Dolores Romero Morales, 2021. "Mathematical optimization in classification and regression trees," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 5-33, April.
    20. Jie Zhang & Zihao Tang & Bin Deng & Siyan Liu & Yifei Xiang, 2022. "A Case Study of Grassroots Water Conservancy Services Evaluation and Obstacle Factors Diagnosis Based on Gray Correlation-TOPSIS Model in Hunan Province, China," IJERPH, MDPI, vol. 20(1), pages 1-18, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:266:y:2018:i:2:p:689-701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.