IDEAS home Printed from https://ideas.repec.org/a/spr/fuzinf/v1y2009i1d10.1007_s12543-009-0001-5.html
   My bibliography  Save this article

Categorical data clustering with automatic selection of cluster number

Author

Listed:
  • Hai-yong Liao

    (Hong Kong Baptist University)

  • Michael K. Ng

    (Hong Kong Baptist University)

Abstract

In this paper, we investigate the problem of determining the number of clusters in the k-modes based categorical data clustering process. We propose a new categorical data clustering algorithm with automatic selection of k. The new algorithm extends the k-modes clustering algorithm by introducing a penalty term to the objective function to make more clusters compete for objects. In the new objective function, we employ a regularization parameter to control the number of clusters in a clustering process. Instead of finding k directly, we choose a suitable value of regularization parameter such that the corresponding clustering result is the most stable one among all the generated clustering results. Experimental results on synthetic data sets and the real data sets are used to demonstrate the effectiveness of the proposed algorithm.

Suggested Citation

  • Hai-yong Liao & Michael K. Ng, 2009. "Categorical data clustering with automatic selection of cluster number," Fuzzy Information and Engineering, Springer, vol. 1(1), pages 5-25, March.
    • Handle: RePEc:spr:fuzinf:v:1:y:2009:i:1:d:10.1007_s12543-009-0001-5
    DOI: 10.1007/s12543-009-0001-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12543-009-0001-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12543-009-0001-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Glenn Milligan & Martha Cooper, 1985. "An examination of procedures for determining the number of clusters in a data set," Psychometrika, Springer;The Psychometric Society, vol. 50(2), pages 159-179, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Pei-chen Barry & Hansen, Mark & Mukherjee, Avijit, 2008. "Scenario-based air traffic flow management: From theory to practice," Transportation Research Part B: Methodological, Elsevier, vol. 42(7-8), pages 685-702, August.
    2. Hélène Syed Zwick & S. Ali Shah Syed, 2017. "The polarization impact of the crisis on the Eurozone labour markets: a hierarchical cluster analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 24(7), pages 472-476, April.
    3. Goethner, Maximilian & Hornuf, Lars & Regner, Tobias, 2021. "Protecting investors in equity crowdfunding: An empirical analysis of the small investor protection act," Technological Forecasting and Social Change, Elsevier, vol. 162(C).
    4. Pennings, J.S.J. & van Kranenburg, H.L. & Hagedoorn, J., 2005. "Past, present and future of the telecommunications industry," Research Memorandum 016, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    5. Li-Xuan Qin & Steven G. Self, 2006. "The Clustering of Regression Models Method with Applications in Gene Expression Data," Biometrics, The International Biometric Society, vol. 62(2), pages 526-533, June.
    6. Caroline Méjean & Pauline Macouillard & Sandrine Péneau & Camille Lassale & Serge Hercberg & Katia Castetbon, 2014. "Association of Perception of Front-of-Pack Labels with Dietary, Lifestyle and Health Characteristics," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-11, March.
    7. Li, Pai-Ling & Chiou, Jeng-Min, 2011. "Identifying cluster number for subspace projected functional data clustering," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2090-2103, June.
    8. Luis García-González & Ángel Abós & Sergio Diloy-Peña & Alexander Gil-Arias & Javier Sevil-Serrano, 2020. "Can a Hybrid Sport Education/Teaching Games for Understanding Volleyball Unit Be More Effective in Less Motivated Students? An Examination into a Set of Motivation-Related Variables," Sustainability, MDPI, vol. 12(15), pages 1-16, July.
    9. Hyeri Choi & Min Jae Park, 2019. "Evaluating the Efficiency of Governmental Excellence for Social Progress: Focusing on Low- and Lower-Middle-Income Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 111-130, January.
    10. Alessandra Cepparulo & Antonello Zanfei, 2019. "The diffusion of public eServices in European cities," Working Papers 1904, University of Urbino Carlo Bo, Department of Economics, Society & Politics - Scientific Committee - L. Stefanini & G. Travaglini, revised 2019.
    11. Ana Helena Tavares & Jakob Raymaekers & Peter J. Rousseeuw & Paula Brito & Vera Afreixo, 2020. "Clustering genomic words in human DNA using peaks and trends of distributions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 14(1), pages 57-76, March.
    12. Noelia Caceres & Luis M. Romero & Francisco J. Morales & Antonio Reyes & Francisco G. Benitez, 2018. "Estimating traffic volumes on intercity road locations using roadway attributes, socioeconomic features and other work-related activity characteristics," Transportation, Springer, vol. 45(5), pages 1449-1473, September.
    13. Michele Cincera, 2005. "Firms' productivity growth and R&D spillovers: An analysis of alternative technological proximity measures," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(8), pages 657-682.
    14. André Lucas & Julia Schaumburg & Bernd Schwaab, 2019. "Bank Business Models at Zero Interest Rates," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 542-555, July.
    15. Wang, Ketong & Porter, Michael D., 2018. "Optimal Bayesian clustering using non-negative matrix factorization," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 395-411.
    16. Douglas L. Steinley & M. J. Brusco, 2019. "Using an Iterative Reallocation Partitioning Algorithm to Verify Test Multidimensionality," Journal of Classification, Springer;The Classification Society, vol. 36(3), pages 397-413, October.
    17. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    18. Rong, Rong & Houser, Daniel, 2015. "Growing stars: A laboratory analysis of network formation," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 380-394.
    19. Javier Sevil-Serrano & Alberto Aibar-Solana & Ángel Abós & José Antonio Julián & Luis García-González, 2019. "Healthy or Unhealthy? The Cocktail of Health-Related Behavior Profiles in Spanish Adolescents," IJERPH, MDPI, vol. 16(17), pages 1-14, August.
    20. Jacques-Antoine Gauthier & Eric D. Widmer & Philipp Bucher & Cédric Notredame, 2009. "How Much Does It Cost?," Sociological Methods & Research, , vol. 38(1), pages 197-231, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:fuzinf:v:1:y:2009:i:1:d:10.1007_s12543-009-0001-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.