IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v71y2018i1d10.1007_s10898-017-0589-7.html
   My bibliography  Save this article

GOSH: derivative-free global optimization using multi-dimensional space-filling curves

Author

Listed:
  • Daniela Lera

    (Università di Cagliari)

  • Yaroslav D. Sergeyev

    (Università della Calabria and the Institute of High Performance Computing and Networking of the National Research Council of Italy
    Lobachevskiy University of Nizhni Novgorod)

Abstract

Global optimization is a field of mathematical programming dealing with finding global (absolute) minima of multi-dimensional multiextremal functions. Problems of this kind where the objective function is non-differentiable, satisfies the Lipschitz condition with an unknown Lipschitz constant, and is given as a “black-box” are very often encountered in engineering optimization applications. Due to the presence of multiple local minima and the absence of differentiability, traditional optimization techniques using gradients and working with problems having only one minimum cannot be applied in this case. These real-life applied problems are attacked here by employing one of the mostly abstract mathematical objects—space-filling curves. A practical derivative-free deterministic method reducing the dimensionality of the problem by using space-filling curves and working simultaneously with all possible estimates of Lipschitz and Hölder constants is proposed. A smart adaptive balancing of local and global information collected during the search is performed at each iteration. Conditions ensuring convergence of the new method to the global minima are established. Results of numerical experiments on 1000 randomly generated test functions show a clear superiority of the new method w.r.t. the popular method DIRECT and other competitors.

Suggested Citation

  • Daniela Lera & Yaroslav D. Sergeyev, 2018. "GOSH: derivative-free global optimization using multi-dimensional space-filling curves," Journal of Global Optimization, Springer, vol. 71(1), pages 193-211, May.
    • Handle: RePEc:spr:jglopt:v:71:y:2018:i:1:d:10.1007_s10898-017-0589-7
    DOI: 10.1007/s10898-017-0589-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-017-0589-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10898-017-0589-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Konstantin Barkalov & Victor Gergel, 2016. "Parallel global optimization on GPU," Journal of Global Optimization, Springer, vol. 66(1), pages 3-20, September.
    2. Giampaolo Liuzzi & Stefano Lucidi & Veronica Piccialli, 2010. "A partition-based global optimization algorithm," Journal of Global Optimization, Springer, vol. 48(1), pages 113-128, September.
    3. Anatoly Zhigljavsky & Antanas Žilinskas, 2008. "Stochastic Global Optimization," Springer Optimization and Its Applications, Springer, number 978-0-387-74740-8, June.
    4. J. Calvin & A. Žilinskas, 2000. "One-Dimensional P-Algorithm with Convergence Rate O(n−3+δ) for Smooth Functions," Journal of Optimization Theory and Applications, Springer, vol. 106(2), pages 297-307, August.
    5. Antanas Žilinskas, 2010. "On similarities between two models of global optimization: statistical models and radial basis functions," Journal of Global Optimization, Springer, vol. 48(1), pages 173-182, September.
    6. Grishagin, Vladimir & Israfilov, Ruslan & Sergeyev, Yaroslav, 2018. "Convergence conditions and numerical comparison of global optimization methods based on dimensionality reduction schemes," Applied Mathematics and Computation, Elsevier, vol. 318(C), pages 270-280.
    7. Daniela Lera & Yaroslav Sergeyev, 2010. "An information global minimization algorithm using the local improvement technique," Journal of Global Optimization, Springer, vol. 48(1), pages 99-112, September.
    8. Remigijus Paulavičius & Yaroslav Sergeyev & Dmitri Kvasov & Julius Žilinskas, 2014. "Globally-biased Disimpl algorithm for expensive global optimization," Journal of Global Optimization, Springer, vol. 59(2), pages 545-567, July.
    9. Antanas Žilinskas & Julius Žilinskas, 2013. "A hybrid global optimization algorithm for non-linear least squares regression," Journal of Global Optimization, Springer, vol. 56(2), pages 265-277, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mikhail Posypkin & Oleg Khamisov, 2021. "Automatic Convexity Deduction for Efficient Function’s Range Bounding," Mathematics, MDPI, vol. 9(2), pages 1-16, January.
    2. Lera, Daniela & Posypkin, Mikhail & Sergeyev, Yaroslav D., 2021. "Space-filling curves for numerical approximation and visualization of solutions to systems of nonlinear inequalities with applications in robotics," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    3. Alberto Lovison & Kaisa Miettinen, 2021. "On the Extension of the DIRECT Algorithm to Multiple Objectives," Journal of Global Optimization, Springer, vol. 79(2), pages 387-412, February.
    4. Ziadi, Raouf & Bencherif-Madani, Abdelatif & Ellaia, Rachid, 2020. "A deterministic method for continuous global optimization using a dense curve," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 178(C), pages 62-91.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kvasov, Dmitri E. & Mukhametzhanov, Marat S., 2018. "Metaheuristic vs. deterministic global optimization algorithms: The univariate case," Applied Mathematics and Computation, Elsevier, vol. 318(C), pages 245-259.
    2. Yaroslav D. Sergeyev & Marat S. Mukhametzhanov & Dmitri E. Kvasov & Daniela Lera, 2016. "Derivative-Free Local Tuning and Local Improvement Techniques Embedded in the Univariate Global Optimization," Journal of Optimization Theory and Applications, Springer, vol. 171(1), pages 186-208, October.
    3. James Calvin & Gražina Gimbutienė & William O. Phillips & Antanas Žilinskas, 2018. "On convergence rate of a rectangular partition based global optimization algorithm," Journal of Global Optimization, Springer, vol. 71(1), pages 165-191, May.
    4. Remigijus Paulavičius & Julius Žilinskas, 2014. "Simplicial Lipschitz optimization without the Lipschitz constant," Journal of Global Optimization, Springer, vol. 59(1), pages 23-40, May.
    5. Grishagin, Vladimir & Israfilov, Ruslan & Sergeyev, Yaroslav, 2018. "Convergence conditions and numerical comparison of global optimization methods based on dimensionality reduction schemes," Applied Mathematics and Computation, Elsevier, vol. 318(C), pages 270-280.
    6. Sergeyev, Yaroslav D. & Kvasov, Dmitri E. & Mukhametzhanov, Marat S., 2017. "Operational zones for comparing metaheuristic and deterministic one-dimensional global optimization algorithms," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 141(C), pages 96-109.
    7. Antanas Žilinskas & James Calvin, 2019. "Bi-objective decision making in global optimization based on statistical models," Journal of Global Optimization, Springer, vol. 74(4), pages 599-609, August.
    8. Lera, Daniela & Posypkin, Mikhail & Sergeyev, Yaroslav D., 2021. "Space-filling curves for numerical approximation and visualization of solutions to systems of nonlinear inequalities with applications in robotics," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    9. Remigijus Paulavičius & Lakhdar Chiter & Julius Žilinskas, 2018. "Global optimization based on bisection of rectangles, function values at diagonals, and a set of Lipschitz constants," Journal of Global Optimization, Springer, vol. 71(1), pages 5-20, May.
    10. R. Cavoretto & A. Rossi & M. S. Mukhametzhanov & Ya. D. Sergeyev, 2021. "On the search of the shape parameter in radial basis functions using univariate global optimization methods," Journal of Global Optimization, Springer, vol. 79(2), pages 305-327, February.
    11. James M. Calvin & Antanas Žilinskas, 2014. "On a Global Optimization Algorithm for Bivariate Smooth Functions," Journal of Optimization Theory and Applications, Springer, vol. 163(2), pages 528-547, November.
    12. G. Liuzzi & S. Lucidi & V. Piccialli, 2016. "Exploiting derivative-free local searches in DIRECT-type algorithms for global optimization," Computational Optimization and Applications, Springer, vol. 65(2), pages 449-475, November.
    13. Konstantin Barkalov & Roman Strongin, 2018. "Solving a set of global optimization problems by the parallel technique with uniform convergence," Journal of Global Optimization, Springer, vol. 71(1), pages 21-36, May.
    14. E. F. Campana & M. Diez & G. Liuzzi & S. Lucidi & R. Pellegrini & V. Piccialli & F. Rinaldi & A. Serani, 2018. "A multi-objective DIRECT algorithm for ship hull optimization," Computational Optimization and Applications, Springer, vol. 71(1), pages 53-72, September.
    15. Jonas Mockus & Remigijus Paulavičius & Dainius Rusakevičius & Dmitrij Šešok & Julius Žilinskas, 2017. "Application of Reduced-set Pareto-Lipschitzian Optimization to truss optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 425-450, January.
    16. Ferreiro-Ferreiro, Ana M. & García-Rodríguez, José A. & Souto, Luis & Vázquez, Carlos, 2019. "Basin Hopping with synched multi L-BFGS local searches. Parallel implementation in multi-CPU and GPUs," Applied Mathematics and Computation, Elsevier, vol. 356(C), pages 282-298.
    17. Remigijus Paulavičius & Yaroslav Sergeyev & Dmitri Kvasov & Julius Žilinskas, 2014. "Globally-biased Disimpl algorithm for expensive global optimization," Journal of Global Optimization, Springer, vol. 59(2), pages 545-567, July.
    18. Albertas Gimbutas & Antanas Žilinskas, 2018. "An algorithm of simplicial Lipschitz optimization with the bi-criteria selection of simplices for the bi-section," Journal of Global Optimization, Springer, vol. 71(1), pages 115-127, May.
    19. Qunfeng Liu & Guang Yang & Zhongzhi Zhang & Jinping Zeng, 2017. "Improving the convergence rate of the DIRECT global optimization algorithm," Journal of Global Optimization, Springer, vol. 67(4), pages 851-872, April.
    20. Kristian Sabo & Rudolf Scitovski & Šime Ungar & Zoran Tomljanović, 2024. "A method for searching for a globally optimal k-partition of higher-dimensional datasets," Journal of Global Optimization, Springer, vol. 89(3), pages 633-653, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:71:y:2018:i:1:d:10.1007_s10898-017-0589-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.