IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v254y2017i1d10.1007_s10479-017-2445-z.html
   My bibliography  Save this article

Embedded variable selection method using signomial classification

Author

Listed:
  • Kyoungmi Hwang

    (Samsung Electronics)

  • Dohyun Kim

    (Myongji University)

  • Kyungsik Lee

    (Seoul National University)

  • Chungmok Lee

    (Hankuk University of Foreign Studies)

  • Sungsoo Park

    (KAIST)

Abstract

We propose two variable selection methods using signomial classification. We attempt to select, among a set of the input variables, the variables that lead to the best performance of the classifier. One method repeatedly removes variables based on backward selection, whereas the second method directly selects a set of variables by solving an optimization problem. The proposed methods conduct variable selection considering nonlinear interactions of variables and obtain a signomial classifier with the selected variables. Computational results show that the proposed methods more effectively selects desirable variables for predicting output and provide the classifiers with better or comparable test error rates, as compared with existing methods.

Suggested Citation

  • Kyoungmi Hwang & Dohyun Kim & Kyungsik Lee & Chungmok Lee & Sungsoo Park, 2017. "Embedded variable selection method using signomial classification," Annals of Operations Research, Springer, vol. 254(1), pages 89-109, July.
  • Handle: RePEc:spr:annopr:v:254:y:2017:i:1:d:10.1007_s10479-017-2445-z
    DOI: 10.1007/s10479-017-2445-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-017-2445-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-017-2445-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P. S. Bradley & O. L. Mangasarian & W. N. Street, 1998. "Feature Selection via Mathematical Programming," INFORMS Journal on Computing, INFORMS, vol. 10(2), pages 209-217, May.
    2. Kyungsik Lee & Norman Kim & Myong Jeong, 2014. "The sparse signomial classification and regression model," Annals of Operations Research, Springer, vol. 216(1), pages 257-286, May.
    3. E. L. Lawler & D. E. Wood, 1966. "Branch-and-Bound Methods: A Survey," Operations Research, INFORMS, vol. 14(4), pages 699-719, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oyebayo Ridwan Olaniran & Ali Rashash R. Alzahrani, 2023. "On the Oracle Properties of Bayesian Random Forest for Sparse High-Dimensional Gaussian Regression," Mathematics, MDPI, vol. 11(24), pages 1-29, December.
    2. Mostafa Rezaei & Ivor Cribben & Michele Samorani, 2021. "A clustering-based feature selection method for automatically generated relational attributes," Annals of Operations Research, Springer, vol. 303(1), pages 233-263, August.
    3. Young Woong Park & Diego Klabjan, 2020. "Subset selection for multiple linear regression via optimization," Journal of Global Optimization, Springer, vol. 77(3), pages 543-574, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kezong Tang & Xiong-Fei Wei & Yuan-Hao Jiang & Zi-Wei Chen & Lihua Yang, 2023. "An Adaptive Ant Colony Optimization for Solving Large-Scale Traveling Salesman Problem," Mathematics, MDPI, vol. 11(21), pages 1-26, October.
    2. Weiqiang Pan & Zhilong Shan & Ting Chen & Fangjiong Chen & Jing Feng, 2016. "Optimal pilot design for OFDM systems with non-contiguous subcarriers based on semi-definite programming," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 63(2), pages 297-305, October.
    3. Fox, B. L. & Lenstra, J. K. & Rinnooy Kan, A. H. G. & Schrage, L. E., 1977. "Branching From The Largest Upper Bound: Folklore And Facts," Econometric Institute Archives 272158, Erasmus University Rotterdam.
    4. Brandner, Hubertus & Lessmann, Stefan & Voß, Stefan, 2013. "A memetic approach to construct transductive discrete support vector machines," European Journal of Operational Research, Elsevier, vol. 230(3), pages 581-595.
    5. Notte, Gastón & Pedemonte, Martín & Cancela, Héctor & Chilibroste, Pablo, 2016. "Resource allocation in pastoral dairy production systems: Evaluating exact and genetic algorithms approaches," Agricultural Systems, Elsevier, vol. 148(C), pages 114-123.
    6. Ravi, V. & Zimmermann, H. -J., 2000. "Fuzzy rule based classification with FeatureSelector and modified threshold accepting," European Journal of Operational Research, Elsevier, vol. 123(1), pages 16-28, May.
    7. Juan F. R. Herrera & José M. G. Salmerón & Eligius M. T. Hendrix & Rafael Asenjo & Leocadio G. Casado, 2017. "On parallel Branch and Bound frameworks for Global Optimization," Journal of Global Optimization, Springer, vol. 69(3), pages 547-560, November.
    8. Gautam Mitra & Frank Ellison & Alan Scowcroft, 2007. "Quadratic programming for portfolio planning: Insights into algorithmic and computational issues Part II — Processing of portfolio planning models with discrete constraints," Journal of Asset Management, Palgrave Macmillan, vol. 8(4), pages 249-258, November.
    9. Efrat Taig & Ohad Ben-Shahar, 2019. "Gradient Surfing: A New Deterministic Approach for Low-Dimensional Global Optimization," Journal of Optimization Theory and Applications, Springer, vol. 180(3), pages 855-878, March.
    10. Mehdi Seraj & Pejman Bahramian & Abdulkareem Alhassan & Rasool Dehghanzadeh Shahabad, 2020. "The validity of Rodrik’s conclusion on real exchange rate and economic growth: factor priority evidence from feature selection approach," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-6, December.
    11. Peng Du & Jiming Peng & Tamás Terlaky, 2009. "Self-adaptive support vector machines: modelling and experiments," Computational Management Science, Springer, vol. 6(1), pages 41-51, February.
    12. Dingding Qi & Yingjun Zhao & Zhengjun Wang & Wei Wang & Li Pi & Longyue Li, 2024. "Joint Approach for Vehicle Routing Problems Based on Genetic Algorithm and Graph Convolutional Network," Mathematics, MDPI, vol. 12(19), pages 1-18, October.
    13. Ekart, Aniko & Nemeth, S. Z., 2005. "Stability analysis of tree structured decision functions," European Journal of Operational Research, Elsevier, vol. 160(3), pages 676-695, February.
    14. Rosato, Paolo & Stellin, Giuseppe, 1995. "MULTI CRITERIA ANALYSIS IN FARM MANAGEMENT FOLLOWING THE COMMON AGRICULTURAL POLICY REFORM: AN APPLICATION OF MULTI-OBJECTIVE INTEGER LINEAR PROGRAMMING; Proceedings of the 4th Minnesota Padova Confer," Working Papers 14414, University of Minnesota, Center for International Food and Agricultural Policy.
    15. Jiancheng Long & Wai Yuen Szeto, 2019. "Link-Based System Optimum Dynamic Traffic Assignment Problems in General Networks," Operations Research, INFORMS, vol. 67(1), pages 167-182, January.
    16. Unler, Alper & Murat, Alper, 2010. "A discrete particle swarm optimization method for feature selection in binary classification problems," European Journal of Operational Research, Elsevier, vol. 206(3), pages 528-539, November.
    17. Wang, Lizhi & Nikouei Mehr, Maryam, 2019. "An optimization approach to epistasis detection," European Journal of Operational Research, Elsevier, vol. 274(3), pages 1069-1076.
    18. Gianluca Gazzola & Myong K. Jeong, 2021. "Support vector regression for polyhedral and missing data," Annals of Operations Research, Springer, vol. 303(1), pages 483-506, August.
    19. de Mast, Jeroen, 2011. "The tactical use of constraints and structure in diagnostic problem solving," Omega, Elsevier, vol. 39(6), pages 702-709, December.
    20. Robin Mueller-Bady & Martin Kappes & Inmaculada Medina-Bulo & Francisco Palomo-Lozano, 2019. "An evolutionary hybrid search heuristic for monitor placement in communication networks," Journal of Heuristics, Springer, vol. 25(6), pages 861-899, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:254:y:2017:i:1:d:10.1007_s10479-017-2445-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.