IDEAS home Printed from https://ideas.repec.org/a/aes/infoec/v25y2021i2p64-74.html
   My bibliography  Save this article

Basic Hyperparameters Tuning Methods for Classification Algorithms

Author

Listed:
  • Claudia ANTAL-VAIDA

Abstract

Considering the dynamics of the economic environment and the amount of data generated every second, the decision-making process is changing and becomes data driven, highly influencing the business strategies setup in order to keep the competitive advantage. However, without technology, data analysis would not be feasible, reason why machine learning is seen as a disruptive innovation for businesses, especially due to its capacity to convert data into actionable outcomes. Though, for a high-quality machine learning model result, algorithm selection and hyperparameters optimization play vital roles, hence became high-interest topics in the field. To achieve this, various automatic selection methods have been proposed and the aim of this paper is to compare two of them – GridSearch and RandomizedSearch - and assess their impact on the model accuracy by comparing with the results obtained when default hyperparameters were applied.

Suggested Citation

  • Claudia ANTAL-VAIDA, 2021. "Basic Hyperparameters Tuning Methods for Classification Algorithms," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 25(2), pages 64-74.
    • Handle: RePEc:aes:infoec:v:25:y:2021:i:2:p:64-74
    as

    Download full text from publisher

    File URL: http://revistaie.ase.ro/content/98/06%20-%20antal.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Raymond C. W. Leung & Yu-Man Tam, 2021. "Statistical Arbitrage Risk Premium by Machine Learning," Papers 2103.09987, arXiv.org.
    2. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can machine learning help to select portfolios of mutual funds?," Economics Working Papers 1772, Department of Economics and Business, Universitat Pompeu Fabra.
    3. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    4. Lee, In & Lee, Kyoochun, 2015. "The Internet of Things (IoT): Applications, investments, and challenges for enterprises," Business Horizons, Elsevier, vol. 58(4), pages 431-440.
    5. Jing Wang & Weisheng Lu & Fan Xue & Meng Ye, 2021. "A Machine Learning-Based Approach for BIM Object Localization," Springer Books, in: Gui Ye & Hongping Yuan & Jian Zuo (ed.), Proceedings of the 24th International Symposium on Advancement of Construction Management and Real Estate, pages 1391-1399, Springer.
    6. Costa, Alexandre Bonnet R. & Ferreira, Pedro Cavalcanti G. & Gaglianone, Wagner P. & Guillén, Osmani Teixeira C. & Issler, João Victor & Lin, Yihao, 2021. "Machine learning and oil price point and density forecasting," Energy Economics, Elsevier, vol. 102(C).
    7. Christian M. Dahl & Torben S. D. Johansen & Emil N. S{o}rensen & Christian E. Westermann & Simon F. Wittrock, 2021. "Applications of Machine Learning in Document Digitisation," Papers 2102.03239, arXiv.org.
    8. Hao Ni & Xin Dong & Jinsong Zheng & Guangxi Yu, 2021. "An Introduction to Machine Learning in Quantitative Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number q0275, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caratozzolo, Vincenzo & Misuri, Alessio & Cozzani, Valerio, 2022. "A generalized equipment vulnerability model for the quantitative risk assessment of horizontal vessels involved in Natech scenarios triggered by floods," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    2. Omar, Yamila M. & Minoufekr, Meysam & Plapper, Peter, 2019. "Business analytics in manufacturing: Current trends, challenges and pathway to market leadership," Operations Research Perspectives, Elsevier, vol. 6(C).
    3. Benlagha, Noureddine & Hemrit, Wael, 2020. "Internet use and insurance growth: evidence from a panel of OECD countries," Technology in Society, Elsevier, vol. 62(C).
    4. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    5. Lu, Chujie & Li, Sihui & Reddy Penaka, Santhan & Olofsson, Thomas, 2023. "Automated machine learning-based framework of heating and cooling load prediction for quick residential building design," Energy, Elsevier, vol. 274(C).
    6. Huo, Dongyang & Malik, Asad Waqar & Ravana, Sri Devi & Rahman, Anis Ur & Ahmedy, Ismail, 2024. "Mapping smart farming: Addressing agricultural challenges in data-driven era," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    7. Mentor Lecaj & Granit Curri, 2021. "Advantages Of International Commercial Arbitration In Resolving The Commercial Contests," Perspectives of Law and Public Administration, Societatea de Stiinte Juridice si Administrative (Society of Juridical and Administrative Sciences), vol. 10(2), pages 96-101, June.
    8. Simon Grima & Jonathan Spiteri & Inna Romānova, 2020. "A STEEP framework analysis of the key factors impacting the use of blockchain technology in the insurance industry," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 45(3), pages 398-425, July.
    9. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    10. Binoy Debnath & Md Shihab Shakur & Fahmida Tanjum & M. Azizur Rahman & Ziaul Haq Adnan, 2022. "Impact of Additive Manufacturing on the Supply Chain of Aerospace Spare Parts Industry—A Review," Logistics, MDPI, vol. 6(2), pages 1-25, April.
    11. Mohamed El-Sayed M. Essa & Ahmed M. El-shafeey & Amna Hassan Omar & Adel Essa Fathi & Ahmed Sabry Abo El Maref & Joseph Victor W. Lotfy & Mohamed Saleh El-Sayed, 2023. "Reliable Integration of Neural Network and Internet of Things for Forecasting, Controlling, and Monitoring of Experimental Building Management System," Sustainability, MDPI, vol. 15(3), pages 1-29, January.
    12. Cui, Yongfeng & Liu, Wei & Rani, Pratibha & Alrasheedi, Melfi, 2021. "Internet of Things (IoT) adoption barriers for the circular economy using Pythagorean fuzzy SWARA-CoCoSo decision-making approach in the manufacturing sector," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    13. Zhang, Tiantian & Nakagawa, Kei & Matsumoto, Ken'ichi, 2023. "Evaluating solar photovoltaic power efficiency based on economic dimensions for 26 countries using a three-stage data envelopment analysis," Applied Energy, Elsevier, vol. 335(C).
    14. Sandeep Jagtap & George Skouteris & Vilendra Choudhari & Shahin Rahimifard & Linh Nguyen Khanh Duong, 2021. "An Internet of Things Approach for Water Efficiency: A Case Study of the Beverage Factory," Sustainability, MDPI, vol. 13(6), pages 1-10, March.
    15. Charalampopoulos, George & Katsianis, Dimitris & Varoutas, Dimitris, 2020. "Investigating the intertwining impact of wholesale access pricing and the commitment to net neutrality principle on European next-generation access networks private investment plans: An options-game a," Telecommunications Policy, Elsevier, vol. 44(3).
    16. Elsisi, Mahmoud & Amer, Mohammed & Dababat, Alya’ & Su, Chun-Lien, 2023. "A comprehensive review of machine learning and IoT solutions for demand side energy management, conservation, and resilient operation," Energy, Elsevier, vol. 281(C).
    17. Abdul Mateen Khan & Muhammad Abubakar Tariq & Sardar Kashif Ur Rehman & Talha Saeed & Fahad K. Alqahtani & Mohamed Sherif, 2024. "BIM Integration with XAI Using LIME and MOO for Automated Green Building Energy Performance Analysis," Energies, MDPI, vol. 17(13), pages 1-36, July.
    18. Elias G. Carayannis & David F. J. Campbell & Evangelos Grigoroudis, 2022. "Helix Trilogy: the Triple, Quadruple, and Quintuple Innovation Helices from a Theory, Policy, and Practice Set of Perspectives," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(3), pages 2272-2301, September.
    19. Jorge Tarifa-Fernández & Ana María Sánchez-Pérez & Salvador Cruz-Rambaud, 2019. "Internet of Things and Their Coming Perspectives: A Real Options Approach," Sustainability, MDPI, vol. 11(11), pages 1-15, June.
    20. Leonel Jorge Ribeiro Nunes & Radu Godina & João Carlos de Oliveira Matias, 2019. "Technological Innovation in Biomass Energy for the Sustainable Growth of Textile Industry," Sustainability, MDPI, vol. 11(2), pages 1-12, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aes:infoec:v:25:y:2021:i:2:p:64-74. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Paul Pocatilu (email available below). General contact details of provider: https://edirc.repec.org/data/aseeero.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.