IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i9p1494-d806484.html
   My bibliography  Save this article

Out of the Niche: Using Direct Search Methods to Find Multiple Global Optima

Author

Listed:
  • Javier Cano

    (Department of Computer Science and Statistics, Rey Juan Carlos University, 28933 Madrid, Spain
    Department of Statistics, University of Auckland, Auckland 1010, New Zealand)

  • Cesar Alfaro

    (Department of Computer Science and Statistics, Rey Juan Carlos University, 28933 Madrid, Spain)

  • Javier Gomez

    (Department of Computer Science and Statistics, Rey Juan Carlos University, 28933 Madrid, Spain)

  • Abraham Duarte

    (Department of Computer Science and Statistics, Rey Juan Carlos University, 28933 Madrid, Spain)

Abstract

Multimodal optimization deals with problems where multiple feasible global solutions coexist. Despite sharing a common objective function value, some global optima may be preferred to others for various reasons. In such cases, it is paramount to devise methods that are able to find as many global optima as possible within an affordable computational budget. Niching strategies have received an overwhelming attention in recent years as the most suitable technique to tackle these kinds of problems. In this paper we explore a different approach, based on a systematic yet versatile use of traditional direct search methods. When tested over reference benchmark functions, our proposal, despite its apparent simplicity, noticeably resists the comparison with state-of-the-art niching methods in most cases, both in the number of global optima found and in the number of function evaluations required. However, rather than trying to outperform niching methods—far more elaborated—our aim is to enrich them with the knowledge gained from exploiting the distinctive features of direct search methods. To that end, we propose two new performance measures that can be used to evaluate, compare and monitor the progress of optimization algorithms of (possibly) very different nature in their effort to find as many global optima of a given multimodal objective function as possible. We believe that adopting these metrics as reference criteria could lead to more sophisticated and computationally-efficient algorithms, which could benefit from the brute force of derivative-free local search methods.

Suggested Citation

  • Javier Cano & Cesar Alfaro & Javier Gomez & Abraham Duarte, 2022. "Out of the Niche: Using Direct Search Methods to Find Multiple Global Optima," Mathematics, MDPI, vol. 10(9), pages 1-20, April.
  • Handle: RePEc:gam:jmathe:v:10:y:2022:i:9:p:1494-:d:806484
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/9/1494/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/10/9/1494/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Locatelli, Marco & Schoen, Fabio, 2012. "Local search based heuristics for global optimization: Atomic clusters and beyond," European Journal of Operational Research, Elsevier, vol. 222(1), pages 1-9.
    2. Chang, Kuo-Hao, 2012. "Stochastic Nelder–Mead simplex method – A new globally convergent direct search method for simulation optimization," European Journal of Operational Research, Elsevier, vol. 220(3), pages 684-694.
    3. Abraham Duarte & Rafael Martí & Fred Glover & Francisco Gortazar, 2011. "Hybrid scatter tabu search for unconstrained global optimization," Annals of Operations Research, Springer, vol. 183(1), pages 95-123, March.
    4. Zhao, Zhiwei & Yang, Jingming & Hu, Ziyu & Che, Haijun, 2016. "A differential evolution algorithm with self-adaptive strategy and control parameters based on symmetric Latin hypercube design for unconstrained optimization problems," European Journal of Operational Research, Elsevier, vol. 250(1), pages 30-45.
    5. Luis Rios & Nikolaos Sahinidis, 2013. "Derivative-free optimization: a review of algorithms and comparison of software implementations," Journal of Global Optimization, Springer, vol. 56(3), pages 1247-1293, July.
    6. Pierre Hansen & Nenad Mladenović & José Moreno Pérez, 2010. "Variable neighbourhood search: methods and applications," Annals of Operations Research, Springer, vol. 175(1), pages 367-407, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Árpád Bűrmen & Tadej Tuma, 2022. "Preface to the Special Issue on “Optimization Theory and Applications”," Mathematics, MDPI, vol. 10(24), pages 1-3, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Satyajith Amaran & Nikolaos V. Sahinidis & Bikram Sharda & Scott J. Bury, 2016. "Simulation optimization: a review of algorithms and applications," Annals of Operations Research, Springer, vol. 240(1), pages 351-380, May.
    2. Gilberto F. Sousa Filho & Teobaldo L. Bulhões Júnior & Lucidio A. F. Cabral & Luiz Satoru Ochi & Fábio Protti, 2017. "New heuristics for the Bicluster Editing Problem," Annals of Operations Research, Springer, vol. 258(2), pages 781-814, November.
    3. Christophe Gouel & Nicolas Legrand, 2017. "Estimating the Competitive Storage Model with Trending Commodity Prices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(4), pages 744-763, June.
    4. Zhao, Jake, 2020. "Accounting for the corporate cash increase," European Economic Review, Elsevier, vol. 123(C).
    5. H. Asefi & S. Lim & M. Maghrebi & S. Shahparvari, 2019. "Mathematical modelling and heuristic approaches to the location-routing problem of a cost-effective integrated solid waste management," Annals of Operations Research, Springer, vol. 273(1), pages 75-110, February.
    6. Breitmoser, Yves & Valasek, Justin, 2017. "A rationale for unanimity in committees," Discussion Papers, Research Unit: Economics of Change SP II 2017-308, WZB Berlin Social Science Center.
    7. Tavakol Aghaei, Vahid & Ağababaoğlu, Arda & Bawo, Biram & Naseradinmousavi, Peiman & Yıldırım, Sinan & Yeşilyurt, Serhat & Onat, Ahmet, 2023. "Energy optimization of wind turbines via a neural control policy based on reinforcement learning Markov chain Monte Carlo algorithm," Applied Energy, Elsevier, vol. 341(C).
    8. Astorino, Annabella & Avolio, Matteo & Fuduli, Antonio, 2022. "A maximum-margin multisphere approach for binary Multiple Instance Learning," European Journal of Operational Research, Elsevier, vol. 299(2), pages 642-652.
    9. Gläser, Sina & Stücken, Mareike, 2021. "Introduction of an underground waste container system–model and solution approaches," European Journal of Operational Research, Elsevier, vol. 295(2), pages 675-689.
    10. Olivera Janković & Stefan Mišković & Zorica Stanimirović & Raca Todosijević, 2017. "Novel formulations and VNS-based heuristics for single and multiple allocation p-hub maximal covering problems," Annals of Operations Research, Springer, vol. 259(1), pages 191-216, December.
    11. Pál, László & Sándor, Zsolt, 2023. "Comparing procedures for estimating random coefficient logit demand models with a special focus on obtaining global optima," International Journal of Industrial Organization, Elsevier, vol. 88(C).
    12. Qihong Feng & Kuankuan Wu & Jiyuan Zhang & Sen Wang & Xianmin Zhang & Daiyu Zhou & An Zhao, 2022. "Optimization of Well Control during Gas Flooding Using the Deep-LSTM-Based Proxy Model: A Case Study in the Baoshaceng Reservoir, Tarim, China," Energies, MDPI, vol. 15(7), pages 1-14, March.
    13. Ade Irawan, Chandra & Starita, Stefano & Chan, Hing Kai & Eskandarpour, Majid & Reihaneh, Mohammad, 2023. "Routing in offshore wind farms: A multi-period location and maintenance problem with joint use of a service operation vessel and a safe transfer boat," European Journal of Operational Research, Elsevier, vol. 307(1), pages 328-350.
    14. Luca Riboldi & Lars O. Nord, 2017. "Lifetime Assessment of Combined Cycles for Cogeneration of Power and Heat in Offshore Oil and Gas Installations," Energies, MDPI, vol. 10(6), pages 1-23, May.
    15. Ahmed, Rasel & Mahadzir, Shuhaimi & Ferdush, Jannatul & Matovu, Fahad & Mota-Babiloni, Adrián & Hafyan, Rendra Hakim, 2024. "Surrogate-assisted constrained hybrid particle swarm optimization algorithm for propane pre-cooled mixed refrigerant LNG process optimization," Energy, Elsevier, vol. 305(C).
    16. Yıldız, Gazi Bilal & Soylu, Banu, 2019. "A multiobjective post-sales guarantee and repair services network design problem," International Journal of Production Economics, Elsevier, vol. 216(C), pages 305-320.
    17. Khakifirooz, Marzieh & Fathi, Michel & Lee, I-Chen & Tseng, Sheng-Tsaing, 2023. "Neural ordinary differential equation for sequential optimal design of fatigue test under accelerated life test analysis," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    18. Gu, Ziyuan & Li, Yifan & Saberi, Meead & Rashidi, Taha H. & Liu, Zhiyuan, 2023. "Macroscopic parking dynamics and equitable pricing: Integrating trip-based modeling with simulation-based robust optimization," Transportation Research Part B: Methodological, Elsevier, vol. 173(C), pages 354-381.
    19. Khalid Mohammed Saffer Alzaidi & Oguz Bayat & Osman N. Uçan, 2018. "A Heuristic Approach for Optimal Planning and Operation of Distribution Systems," Journal of Optimization, Hindawi, vol. 2018, pages 1-19, June.
    20. Gandhi, Akhilesh & Zantye, Manali S. & Faruque Hasan, M.M., 2022. "Cryogenic energy storage: Standalone design, rigorous optimization and techno-economic analysis," Applied Energy, Elsevier, vol. 322(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:9:p:1494-:d:806484. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.