IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i3p426-d1328206.html
   My bibliography  Save this article

Exploratory Landscape Validation for Bayesian Optimization Algorithms

Author

Listed:
  • Taleh Agasiev

    (Department of Computer-Aided Design Systems, Bauman Moscow State Technical University, Moscow 105005, Russia)

  • Anatoly Karpenko

    (Department of Computer-Aided Design Systems, Bauman Moscow State Technical University, Moscow 105005, Russia)

Abstract

Bayesian optimization algorithms are widely used for solving problems with a high computational complexity in terms of objective function evaluation. The efficiency of Bayesian optimization is strongly dependent on the quality of the surrogate models of an objective function, which are built and refined at each iteration. The quality of surrogate models, and hence the performance of an optimization algorithm, can be greatly improved by selecting the appropriate hyperparameter values of the approximation algorithm. The common approach to finding good hyperparameter values for each iteration of Bayesian optimization is to build surrogate models with different hyperparameter values and choose the best one based on some estimation of the approximation error, for example, a cross-validation score. Building multiple surrogate models for each iteration of Bayesian optimization is computationally demanding and significantly increases the time required to solve an optimization problem. This paper suggests a new approach, called exploratory landscape validation, to find good hyperparameter values with less computational effort. Exploratory landscape validation metrics can be used to predict the best hyperparameter values, which can improve both the quality of the solutions found by Bayesian optimization and the time needed to solve problems.

Suggested Citation

  • Taleh Agasiev & Anatoly Karpenko, 2024. "Exploratory Landscape Validation for Bayesian Optimization Algorithms," Mathematics, MDPI, vol. 12(3), pages 1-21, January.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:3:p:426-:d:1328206
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/3/426/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/3/426/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jiangang Hao & Tin Kam Ho, 2019. "Machine Learning Made Easy: A Review of Scikit-learn Package in Python Programming Language," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 348-361, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ehab Issa El-Sayed & Salah K. ElSayed & Mohammad Alsharef, 2024. "Data-Driven Approaches for State-of-Charge Estimation in Battery Electric Vehicles Using Machine and Deep Learning Techniques," Sustainability, MDPI, vol. 16(21), pages 1-21, October.
    2. Muideen Adegoke & Alaka Hafiz & Saheed Ajayi & Razak Olu-Ajayi, 2022. "Application of Multilayer Extreme Learning Machine for Efficient Building Energy Prediction," Energies, MDPI, vol. 15(24), pages 1-21, December.
    3. Harold Doran, 2023. "A Collection of Numerical Recipes Useful for Building Scalable Psychometric Applications," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 37-69, February.
    4. Ehsan Harirchian & Tom Lahmer & Shahla Rasulzade, 2020. "Earthquake Hazard Safety Assessment of Existing Buildings Using Optimized Multi-Layer Perceptron Neural Network," Energies, MDPI, vol. 13(8), pages 1-16, April.
    5. Lilia Tightiz & Joon Yoo, 2022. "A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends," Energies, MDPI, vol. 15(22), pages 1-24, November.
    6. Anthony Njuguna Matheri & Zanele Blessed Sithole & Belaid Mohamed, 2024. "Data-Driven Circular Economy of Biowaste to Bioenergy with Conventional Prediction Modelling and Machine Learning," Circular Economy and Sustainability, Springer, vol. 4(2), pages 929-950, June.
    7. Muhammad Khalid Anser & Munir Ahmad & Muhammad Azhar Khan & Abdelmohsen A. Nassani & Mohamed Haffar & Khalid Zaman, 2024. "The “IMPACT” of Web of Science Coverage and Scientific and Technical Journal Articles on the World’s Income: Scientific Informatics and the Knowledge-Driven Economy," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 3147-3173, March.
    8. Ayed Alwadain & Rao Faizan Ali & Amgad Muneer, 2023. "Estimating Financial Fraud through Transaction-Level Features and Machine Learning," Mathematics, MDPI, vol. 11(5), pages 1-15, February.
    9. Maksymilian Mądziel & Tiziana Campisi, 2023. "Energy Consumption of Electric Vehicles: Analysis of Selected Parameters Based on Created Database," Energies, MDPI, vol. 16(3), pages 1-18, February.
    10. Ann-Kathrin Edrich & Anil Yildiz & Ribana Roscher & Alexander Bast & Frank Graf & Julia Kowalski, 2024. "A modular framework for FAIR shallow landslide susceptibility mapping based on machine learning," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 120(9), pages 8953-8982, July.
    11. Campos, Inês & Korsnes, Marius & Labanca, Nicola & Bertoldi, Paolo, 2024. "Can renewable energy prosumerism cater for sufficiency and inclusion?," Renewable and Sustainable Energy Reviews, Elsevier, vol. 197(C).
    12. Saheed, Yakub Kayode & Abdulganiyu, Oluwadamilare Harazeem & Majikumna, Kaloma Usman & Mustapha, Musa & Workneh, Abebaw Degu, 2024. "ResNet50-1D-CNN: A new lightweight resNet50-One-dimensional convolution neural network transfer learning-based approach for improved intrusion detection in cyber-physical systems," International Journal of Critical Infrastructure Protection, Elsevier, vol. 45(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:3:p:426-:d:1328206. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.