IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v74y2019i4d10.1007_s10898-018-0622-5.html
   My bibliography  Save this article

Bi-objective decision making in global optimization based on statistical models

Author

Listed:
  • Antanas Žilinskas

    (Vilnius University)

  • James Calvin

    (New Jersey Institute of Technology)

Abstract

A global optimization problem is considered where the objective functions are assumed “black box” and “expensive”. An algorithm is theoretically substantiated using a statistical model of objective functions and the theory of rational decision making under uncertainty. The search process is defined as a sequence of bi-objective selections of sites for the computation of the objective function values. It is shown that two well known (the maximum average improvement, and the maximum improvement probability) algorithms are special cases of the proposed general approach.

Suggested Citation

  • Antanas Žilinskas & James Calvin, 2019. "Bi-objective decision making in global optimization based on statistical models," Journal of Global Optimization, Springer, vol. 74(4), pages 599-609, August.
  • Handle: RePEc:spr:jglopt:v:74:y:2019:i:4:d:10.1007_s10898-018-0622-5
    DOI: 10.1007/s10898-018-0622-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-018-0622-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-018-0622-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jack Kleijnen & Wim Beers & Inneke Nieuwenhuyse, 2012. "Expected improvement in efficient global optimization through bootstrapped kriging," Journal of Global Optimization, Springer, vol. 54(1), pages 59-73, September.
    2. Antanas Žilinskas, 2014. "A statistical model-based algorithm for ‘black-box’ multi-objective optimisation," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(1), pages 82-93.
    3. Anatoly Zhigljavsky & Antanas Žilinskas, 2008. "Stochastic Global Optimization," Springer Optimization and Its Applications, Springer, number 978-0-387-74740-8, June.
    4. J. Calvin & A. Žilinskas, 2000. "One-Dimensional P-Algorithm with Convergence Rate O(n−3+δ) for Smooth Functions," Journal of Optimization Theory and Applications, Springer, vol. 106(2), pages 297-307, August.
    5. Michael Emmerich & Kaifeng Yang & André Deutz & Hao Wang & Carlos M. Fonseca, 2016. "A Multicriteria Generalization of Bayesian Global Optimization," Springer Optimization and Its Applications, in: Panos M. Pardalos & Anatoly Zhigljavsky & Julius Žilinskas (ed.), Advances in Stochastic and Deterministic Global Optimization, pages 229-242, Springer.
    6. Albertas Gimbutas & Antanas Žilinskas, 2018. "An algorithm of simplicial Lipschitz optimization with the bi-criteria selection of simplices for the bi-section," Journal of Global Optimization, Springer, vol. 71(1), pages 115-127, May.
    7. Antanas Žilinskas & Julius Žilinskas, 2013. "A hybrid global optimization algorithm for non-linear least squares regression," Journal of Global Optimization, Springer, vol. 56(2), pages 265-277, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kaito Majima & Kosuke Kawakami & Kota Ishizuka & Kazuhide Nakata, 2024. "Keyword-Level Bayesian Online Bid Optimization for Sponsored Search Advertising," SN Operations Research Forum, Springer, vol. 5(2), pages 1-32, June.
    2. Gabriele Eichfelder & Kathrin Klamroth & Julia Niebling, 2021. "Nonconvex constrained optimization by a filtering branch and bound," Journal of Global Optimization, Springer, vol. 80(1), pages 31-61, May.
    3. Jolan Wauters & Andy Keane & Joris Degroote, 2020. "Development of an adaptive infill criterion for constrained multi-objective asynchronous surrogate-based optimization," Journal of Global Optimization, Springer, vol. 78(1), pages 137-160, September.
    4. François Bachoc & Céline Helbert & Victor Picheny, 2020. "Gaussian process optimization with failures: classification and convergence proof," Journal of Global Optimization, Springer, vol. 78(3), pages 483-506, November.
    5. Krityakierne, Tipaluck & Baowan, Duangkamon, 2020. "Aggregated GP-based Optimization for Contaminant Source Localization," Operations Research Perspectives, Elsevier, vol. 7(C).
    6. Qiang Yang & Litao Hua & Xudong Gao & Dongdong Xu & Zhenyu Lu & Sang-Woon Jeon & Jun Zhang, 2022. "Stochastic Cognitive Dominance Leading Particle Swarm Optimization for Multimodal Problems," Mathematics, MDPI, vol. 10(5), pages 1-34, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniela Lera & Yaroslav D. Sergeyev, 2018. "GOSH: derivative-free global optimization using multi-dimensional space-filling curves," Journal of Global Optimization, Springer, vol. 71(1), pages 193-211, May.
    2. James Calvin & Gražina Gimbutienė & William O. Phillips & Antanas Žilinskas, 2018. "On convergence rate of a rectangular partition based global optimization algorithm," Journal of Global Optimization, Springer, vol. 71(1), pages 165-191, May.
    3. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    4. Remigijus Paulavičius & Yaroslav Sergeyev & Dmitri Kvasov & Julius Žilinskas, 2014. "Globally-biased Disimpl algorithm for expensive global optimization," Journal of Global Optimization, Springer, vol. 59(2), pages 545-567, July.
    5. Remigijus Paulavičius & Julius Žilinskas, 2014. "Simplicial Lipschitz optimization without the Lipschitz constant," Journal of Global Optimization, Springer, vol. 59(1), pages 23-40, May.
    6. James M. Calvin & Antanas Žilinskas, 2014. "On a Global Optimization Algorithm for Bivariate Smooth Functions," Journal of Optimization Theory and Applications, Springer, vol. 163(2), pages 528-547, November.
    7. Usama Khaled & Ali M. Eltamaly & Abderrahmane Beroual, 2017. "Optimal Power Flow Using Particle Swarm Optimization of Renewable Hybrid Distributed Generation," Energies, MDPI, vol. 10(7), pages 1-14, July.
    8. Vasiliy V. Grigoriev & Petr N. Vabishchevich, 2021. "Bayesian Estimation of Adsorption and Desorption Parameters for Pore Scale Transport," Mathematics, MDPI, vol. 9(16), pages 1-16, August.
    9. Eric Bradford & Artur M. Schweidtmann & Alexei Lapkin, 2018. "Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm," Journal of Global Optimization, Springer, vol. 71(2), pages 407-438, June.
    10. Kleijnen, Jack P.C. & Mehdad, E., 2013. "Conditional simulation for efficient global optimization," Other publications TiSEM 52e4860d-9887-4a63-b19a-7, Tilburg University, School of Economics and Management.
    11. Christopher M. Cotnoir & Balša Terzić, 2017. "Decoupling linear and nonlinear regimes: an evaluation of efficiency for nonlinear multidimensional optimization," Journal of Global Optimization, Springer, vol. 68(3), pages 663-675, July.
    12. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Classic Kriging versus Kriging with Bootstrapping or Conditional Simulation : Classic Kriging's Robust Confidence Intervals and Optimization (Revised version of CentER DP 2013-038)," Discussion Paper 2014-076, Tilburg University, Center for Economic Research.
    13. Moody Chu & Matthew Lin & Liqi Wang, 2014. "A study of singular spectrum analysis with global optimization techniques," Journal of Global Optimization, Springer, vol. 60(3), pages 551-574, November.
    14. Victor Gergel & Evgeny Kozinov, 2018. "Efficient multicriterial optimization based on intensive reuse of search information," Journal of Global Optimization, Springer, vol. 71(1), pages 73-90, May.
    15. Ferreiro-Ferreiro, Ana M. & García-Rodríguez, José A. & Souto, Luis & Vázquez, Carlos, 2019. "Basin Hopping with synched multi L-BFGS local searches. Parallel implementation in multi-CPU and GPUs," Applied Mathematics and Computation, Elsevier, vol. 356(C), pages 282-298.
    16. Yaroslav D. Sergeyev & Marat S. Mukhametzhanov & Dmitri E. Kvasov & Daniela Lera, 2016. "Derivative-Free Local Tuning and Local Improvement Techniques Embedded in the Univariate Global Optimization," Journal of Optimization Theory and Applications, Springer, vol. 171(1), pages 186-208, October.
    17. James Calvin, 2010. "A lower bound on convergence rates of nonadaptive algorithms for univariate optimization with noise," Journal of Global Optimization, Springer, vol. 48(1), pages 17-27, September.
    18. Daniela Lera & Yaroslav Sergeyev, 2010. "An information global minimization algorithm using the local improvement technique," Journal of Global Optimization, Springer, vol. 48(1), pages 99-112, September.
    19. Linas Stripinis & Remigijus Paulavičius, 2022. "Experimental Study of Excessive Local Refinement Reduction Techniques for Global Optimization DIRECT-Type Algorithms," Mathematics, MDPI, vol. 10(20), pages 1-18, October.
    20. Kvasov, Dmitri E. & Mukhametzhanov, Marat S., 2018. "Metaheuristic vs. deterministic global optimization algorithms: The univariate case," Applied Mathematics and Computation, Elsevier, vol. 318(C), pages 245-259.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:74:y:2019:i:4:d:10.1007_s10898-018-0622-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.