IDEAS home Printed from https://ideas.repec.org/a/wsi/jikmxx/v05y2006i04ns0219649206001578.html
   My bibliography  Save this article

Bayesian Feature Selection for Clustering Problems

Author

Listed:
  • Eduardo R. Hruschka

    (Catholic University of Santos (UniSantos), Brazil)

  • Estevam R. Hruschka

    (Federal University of São Carlos, Brazil)

  • Thiago F. Covões

    (Catholic University of Santos (UniSantos), Brazil)

  • Nelson F. F. Ebecken

    (COPPE / Federal University of Rio de Janeiro, Brazil)

Abstract

Bayesian methods have been successfully used for feature selection in many supervised learning tasks. In this paper, the adaptation of such methods for unsupervised learning (clustering) is investigated. We adopt an algorithm that iterates between clustering (assuming that the number of clusters is unknowna priori) and feature selection. From this standpoint, two Bayesian approaches for feature selection are addressed: (i) Naïve Bayes Wrapper (NBW), and (ii) Markov Blanket Filter (MBF) obtained from the construction of Bayesian networks. Experiments in ten datasets illustrate the performance of each proposed method. Advantages of feature selection are demonstrated by comparing the results obtained from Bayesian feature selection with the results achieved without any kind of feature selection, i.e., using all the available features. In most of the performed experiments, NBW and MBF have allowed reducing the number of features, while providing good quality partitions in relation to those found by means of the full set of features. Also, NBW has outperformed its Bayesian feature selection counterpart (MBF) in most of the assessed datasets, mainly when the cardinality of the selected feature subset is taken into consideration.

Suggested Citation

  • Eduardo R. Hruschka & Estevam R. Hruschka & Thiago F. Covões & Nelson F. F. Ebecken, 2006. "Bayesian Feature Selection for Clustering Problems," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 315-327.
  • Handle: RePEc:wsi:jikmxx:v:05:y:2006:i:04:n:s0219649206001578
    DOI: 10.1142/S0219649206001578
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S0219649206001578
    Download Restriction: Access to full text is restricted to subscribers

    File URL: https://libkey.io/10.1142/S0219649206001578?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clyde Holsapple & Anita Lee & Jim Otto, 1997. "A machine learning method for multi-expert decision support," Annals of Operations Research, Springer, vol. 75(0), pages 171-188, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuan Li & Xiuwu Liao & Wenhong Zhao, 2009. "A rough set approach to knowledge discovery in analyzing competitive advantages of firms," Annals of Operations Research, Springer, vol. 168(1), pages 205-223, April.
    2. Kazim Topuz & Hasmet Uner & Asil Oztekin & Mehmet Bayram Yildirim, 2018. "Predicting pediatric clinic no-shows: a decision analytic framework using elastic net and Bayesian belief network," Annals of Operations Research, Springer, vol. 263(1), pages 479-499, April.
    3. Weiwei Chen & Jie Song & Leyuan Shi & Liang Pi & Peter Sun, 2013. "Data mining-based dispatching system for solving the local pickup and delivery problem," Annals of Operations Research, Springer, vol. 203(1), pages 351-370, March.
    4. Cuiqing Jiang & Zhao Wang & Ruiya Wang & Yong Ding, 2018. "Loan default prediction by combining soft information extracted from descriptive text in online peer-to-peer lending," Annals of Operations Research, Springer, vol. 266(1), pages 511-529, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:jikmxx:v:05:y:2006:i:04:n:s0219649206001578. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/jikm/jikm.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.