IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0120455.html
   My bibliography  Save this article

A Multi-Label Learning Based Kernel Automatic Recommendation Method for Support Vector Machine

Author

Listed:
  • Xueying Zhang
  • Qinbao Song

Abstract

Choosing an appropriate kernel is very important and critical when classifying a new problem with Support Vector Machine. So far, more attention has been paid on constructing new kernels and choosing suitable parameter values for a specific kernel function, but less on kernel selection. Furthermore, most of current kernel selection methods focus on seeking a best kernel with the highest classification accuracy via cross-validation, they are time consuming and ignore the differences among the number of support vectors and the CPU time of SVM with different kernels. Considering the tradeoff between classification success ratio and CPU time, there may be multiple kernel functions performing equally well on the same classification problem. Aiming to automatically select those appropriate kernel functions for a given data set, we propose a multi-label learning based kernel recommendation method built on the data characteristics. For each data set, the meta-knowledge data base is first created by extracting the feature vector of data characteristics and identifying the corresponding applicable kernel set. Then the kernel recommendation model is constructed on the generated meta-knowledge data base with the multi-label classification method. Finally, the appropriate kernel functions are recommended to a new data set by the recommendation model according to the characteristics of the new data set. Extensive experiments over 132 UCI benchmark data sets, with five different types of data set characteristics, eleven typical kernels (Linear, Polynomial, Radial Basis Function, Sigmoidal function, Laplace, Multiquadric, Rational Quadratic, Spherical, Spline, Wave and Circular), and five multi-label classification methods demonstrate that, compared with the existing kernel selection methods and the most widely used RBF kernel function, SVM with the kernel function recommended by our proposed method achieved the highest classification performance.

Suggested Citation

  • Xueying Zhang & Qinbao Song, 2015. "A Multi-Label Learning Based Kernel Automatic Recommendation Method for Support Vector Machine," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-30, April.
  • Handle: RePEc:plo:pone00:0120455
    DOI: 10.1371/journal.pone.0120455
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0120455
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0120455&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0120455?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Grigorios Tsoumakas & Ioannis Katakis, 2007. "Multi-Label Classification: An Overview," International Journal of Data Warehousing and Mining (IJDWM), IGI Global, vol. 3(3), pages 1-13, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Radu Cristian Alexandru Iacob & Vlad Cristian Monea & Dan Rădulescu & Andrei-Florin Ceapă & Traian Rebedea & Ștefan Trăușan-Matu, 2020. "AlgoLabel: A Large Dataset for Multi-Label Classification of Algorithmic Challenges," Mathematics, MDPI, vol. 8(11), pages 1-18, November.
    2. Azzini, Antonia & Cortesi, Nicola & Marrara, Stefania & Topalović, Amir, 2019. "A Multi-Label Machine Learning Approach to Support Pathologist's Histological Analysis," Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference (2019), Rovinj, Croatia, in: Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference, Rovinj, Croatia, 12-14 September 2019, pages 197-208, IRENET - Society for Advancing Innovation and Research in Economy, Zagreb.
    3. Junming Yin & Jerry Luo & Susan A. Brown, 2021. "Learning from Crowdsourced Multi-labeling: A Variational Bayesian Approach," Information Systems Research, INFORMS, vol. 32(3), pages 752-773, September.
    4. Mohanrasu, S.S. & Janani, K. & Rakkiyappan, R., 2024. "A COPRAS-based Approach to Multi-Label Feature Selection for Text Classification," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 222(C), pages 3-23.
    5. Bocheng Li & Yunqiu Zhang & Xusheng Wu, 2022. "DLKN-MLC: A Disease Prediction Model via Multi-Label Learning," IJERPH, MDPI, vol. 19(15), pages 1-15, August.
    6. Hamid Bekamiri & Daniel S. Hain & Roman Jurowetzki, 2021. "PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT," Papers 2103.11933, arXiv.org, revised Oct 2021.
    7. Chaker Jebari, 2016. "Multi-Label Genre Classification of Web Pages Using an Adaptive Centroid-Based Classifier," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 15(01), pages 1-21, March.
    8. Francisco J. Ribadas-Pena & Shuyuan Cao & Víctor M. Darriba Bilbao, 2022. "Improving Large-Scale k -Nearest Neighbor Text Categorization with Label Autoencoders," Mathematics, MDPI, vol. 10(16), pages 1-22, August.
    9. Tao Shu & Zhiyi Wang & Huading Jia & Wenjin Zhao & Jixian Zhou & Tao Peng, 2022. "Consumers’ Opinions towards Public Health Effects of Online Games: An Empirical Study Based on Social Media Comments in China," IJERPH, MDPI, vol. 19(19), pages 1-19, October.
    10. Bogaert, Matthias & Lootens, Justine & Van den Poel, Dirk & Ballings, Michel, 2019. "Evaluating multi-label classifiers and recommender systems in the financial service sector," European Journal of Operational Research, Elsevier, vol. 279(2), pages 620-634.
    11. Yi-Hui Chen & Eric Jui-Lin Lu & Yu-Ting Lin & Ya-Wen Cheng, 2016. "Document overlapping clustering using formal concept analysis," Journal of Advances in Technology and Engineering Research, A/Professor Akbar A. Khatibi, vol. 2(2), pages 28-34.
    12. D. Thorleuchter & D. Van Den Poel, 2013. "Semantic Compared Cross Impact Analysis," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 13/862, Ghent University, Faculty of Economics and Business Administration.
    13. Han Zou & Jing Ge & Ruichao Liu & Lin He, 2023. "Feature Recognition of Regional Architecture Forms Based on Machine Learning: A Case Study of Architecture Heritage in Hubei Province, China," Sustainability, MDPI, vol. 15(4), pages 1-27, February.
    14. Josef Schwaiger & Timo Hammerl & Johannsen Florian & Susanne Leist, 2021. "UR: SMART–A tool for analyzing social media content," Information Systems and e-Business Management, Springer, vol. 19(4), pages 1275-1320, December.
    15. Verwaeren, Jan & Waegeman, Willem & De Baets, Bernard, 2012. "Learning partial ordinal class memberships with kernel-based proportional odds models," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 928-942.
    16. Huazhen Wang & Xin Liu & Bing Lv & Fan Yang & Yanzhu Hong, 2014. "Reliable Multi-Label Learning via Conformal Predictor and Random Forest for Syndrome Differentiation of Chronic Fatigue in Traditional Chinese Medicine," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-14, June.
    17. D. Thorleuchter & D. Van Den Poel & A. Prinzie & -, 2010. "A compared R&D-based and patent-based cross impact analysis for identifying relationships between technologies," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 10/632, Ghent University, Faculty of Economics and Business Administration.
    18. Debaere, Steven & Coussement, Kristof & De Ruyck, Tom, 2018. "Multi-label classification of member participation in online innovation communities," European Journal of Operational Research, Elsevier, vol. 270(2), pages 761-774.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0120455. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.