IDEAS home Printed from https://ideas.repec.org/a/spr/decisn/v47y2020i4d10.1007_s40622-020-00265-3.html
   My bibliography  Save this article

An approach of improving decision tree classifier using condensed informative data

Author

Listed:
  • Archana R. Panhalkar

    (Shri Guru Gobind Singhji Institute of Engineering and Technology)

  • Dharmpal D. Doye

    (Shri Guru Gobind Singhji Institute of Engineering and Technology)

Abstract

The advancement of new technologies in today’s era produces a vast amount of data. To store, analyze and mine knowledge from huge data requires large space as well as better execution speed. To train classifiers using a large amount of data requires more time and space. To avoid wastage of time and space, there is a need to mine significant information from a huge collection of data. Decision tree is one of the promising classifiers which mine knowledge from huge data. This paper aims to reduce the data to construct efficient decision tree classifier. This paper presents a method which finds informative data to improve the performance of decision tree classifier. Two clustering-based methods are proposed for dimensionality reduction and utilizing knowledge from outliers. These condensed data are applied to the decision tree for high prediction accuracy. The uniqueness of the first method is that it finds the representative instances from clusters that utilize knowledge of its neighboring data. The second method uses supervised clustering which finds the number of cluster representatives for the reduction of data. With an increase in the prediction accuracy of a tree, these methods decrease the size, building time and space required for decision tree classifiers. These novel methods are united into a single supervised and unsupervised Decision Tree based on Cluster Analysis Pre-processing (DTCAP) which hunts the informative instances from a small, medium and large dataset. The experiments are conducted on a standard UCI dataset of different sizes. It illustrates that the method with its simplicity performs a reduction of data up to 50%. It produces a qualitative dataset which enhances the performance of the decision tree classifier.

Suggested Citation

  • Archana R. Panhalkar & Dharmpal D. Doye, 2020. "An approach of improving decision tree classifier using condensed informative data," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 47(4), pages 431-445, December.
  • Handle: RePEc:spr:decisn:v:47:y:2020:i:4:d:10.1007_s40622-020-00265-3
    DOI: 10.1007/s40622-020-00265-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40622-020-00265-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40622-020-00265-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. G. V. Kass, 1980. "An Exploratory Technique for Investigating Large Quantities of Categorical Data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(2), pages 119-127, June.
    2. Robert Thorndike, 1953. "Who belongs in the family?," Psychometrika, Springer;The Psychometric Society, vol. 18(4), pages 267-276, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Strobl, Carolin & Boulesteix, Anne-Laure & Augustin, Thomas, 2007. "Unbiased split selection for classification trees based on the Gini Index," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 483-501, September.
    2. Becken, Susanne & Stantic, Bela & Chen, Jinyan & Connolly, Rod M., 2022. "Twitter conversations reveal issue salience of aviation in the broader context of climate change," Journal of Air Transport Management, Elsevier, vol. 98(C).
    3. Orietta Nicolis & Jean Paul Maidana & Fabian Contreras & Danilo Leal, 2024. "Analyzing the Impact of COVID-19 on Economic Sustainability: A Clustering Approach," Sustainability, MDPI, vol. 16(4), pages 1-30, February.
    4. I. Albarrán & P. Alonso-González & J. M. Marin, 2017. "Some criticism to a general model in Solvency II: an explanation from a clustering point of view," Empirical Economics, Springer, vol. 52(4), pages 1289-1308, June.
    5. Yousaf Muhammad & Dey Sandeep Kumar, 2022. "Best proxy to determine firm performance using financial ratios: A CHAID approach," Review of Economic Perspectives, Sciendo, vol. 22(3), pages 219-239, September.
    6. Michele Cincera, 2005. "Firms' productivity growth and R&D spillovers: An analysis of alternative technological proximity measures," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(8), pages 657-682.
    7. Bas Donkers & Richard Paap & Jedid‐Jah Jonker & Philip Hans Franses, 2006. "Deriving target selection rules from endogenously selected samples," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(5), pages 549-562, July.
    8. Korneliusz Pylak & Piotr Oleszczuk & Przemysław Kowalik, 2021. "Typology of Smart Specializations Across European Regions," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 1), pages 503-512.
    9. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.
    10. Junyong Jang & Yongbin Cho & Juntae Park, 2024. "Bus Route Sketching: A Multimetric Analysis from the User’s and Operator’s Perspectives," Sustainability, MDPI, vol. 16(16), pages 1-19, August.
    11. Lea Piscitelli & Annalisa De Boni & Rocco Roma & Giovanni Ottomano Palmisano, 2023. "Carbon Farming: How to Support Farmers in Choosing the Best Management Strategies for Low-Impact Food Production," Land, MDPI, vol. 13(1), pages 1-16, December.
    12. Elizaveta Zinovyeva & Raphael C. G. Reule & Wolfgang Karl Hardle, 2021. "Understanding Smart Contracts: Hype or Hope?," Papers 2103.08447, arXiv.org.
    13. H Seol & H Lee & S Kim & Y Park, 2008. "The impact of information technology on organizational efficiency in public services: a DEA-based DT approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 231-238, February.
    14. Vanhoucke, Mario & Maenhout, Broos, 2009. "On the characterization and generation of nurse scheduling problem instances," European Journal of Operational Research, Elsevier, vol. 196(2), pages 457-467, July.
    15. Todor Krastevich, 2013. "Using Predictive Modeling to Improve Direct Marketing Performance," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 3, pages 25-55.
    16. Zhao, Yingrui & Hu, Songhua & Zhang, Ming, 2024. "Evaluating equitable Transit-Oriented development (TOD) via the Node-Place-People model," Transportation Research Part A: Policy and Practice, Elsevier, vol. 185(C).
    17. Wei, Xiupeng & Kusiak, Andrew & Li, Mingyang & Tang, Fan & Zeng, Yaohui, 2015. "Multi-objective optimization of the HVAC (heating, ventilation, and air conditioning) system performance," Energy, Elsevier, vol. 83(C), pages 294-306.
    18. Adrien Ehrhardt & Christophe Biernacki & Vincent Vandewalle & Philippe Heinrich, 2019. "Feature quantization for parsimonious and interpretable predictive models," Papers 1903.08920, arXiv.org.
    19. Onur Doğan & Hakan Aşan & Ejder Ayç, 2015. "Use Of Data Mining Techniques In Advance Decision Making Processes In A Local Firm," European Journal of Business and Economics, Central Bohemia University, vol. 10(2), pages 6821:10-682, January.
    20. Jae-Dong Kim & Tae-Hyeong Kim & Sung Won Han, 2023. "Demand Forecasting of Spare Parts Using Artificial Intelligence: A Case Study of K-X Tanks," Mathematics, MDPI, vol. 11(3), pages 1-10, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:decisn:v:47:y:2020:i:4:d:10.1007_s40622-020-00265-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.