IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v75y2019i1d10.1007_s10898-019-00798-7.html
   My bibliography  Save this article

Efficient computation of expected hypervolume improvement using box decomposition algorithms

Author

Listed:
  • Kaifeng Yang

    (Leiden University)

  • Michael Emmerich

    (Leiden University)

  • André Deutz

    (Leiden University)

  • Thomas Bäck

    (Leiden University)

Abstract

In the field of multi-objective optimization algorithms, multi-objective Bayesian Global Optimization (MOBGO) is an important branch, in addition to evolutionary multi-objective optimization algorithms. MOBGO utilizes Gaussian Process models learned from previous objective function evaluations to decide the next evaluation site by maximizing or minimizing an infill criterion. A commonly used criterion in MOBGO is the Expected Hypervolume Improvement (EHVI), which shows a good performance on a wide range of problems, with respect to exploration and exploitation. However, so far, it has been a challenge to calculate exact EHVI values efficiently. This paper proposes an efficient algorithm for the exact calculation of the EHVI for in a generic case. This efficient algorithm is based on partitioning the integration volume into a set of axis-parallel slices. Theoretically, the upper bound time complexities can be improved from previously $$O (n^2)$$ O ( n 2 ) and $$O(n^3)$$ O ( n 3 ) , for two- and three-objective problems respectively, to $$\varTheta (n\log n)$$ Θ ( n log n ) , which is asymptotically optimal. This article generalizes the scheme in higher dimensional cases by utilizing a new hyperbox decomposition technique, which is proposed by Dächert et al. (Eur J Oper Res 260(3):841–855, 2017). It also utilizes a generalization of the multilayered integration scheme that scales linearly in the number of hyperboxes of the decomposition. The speed comparison shows that the proposed algorithm in this paper significantly reduces computation time. Finally, this decomposition technique is applied in the calculation of the Probability of Improvement (PoI).

Suggested Citation

  • Kaifeng Yang & Michael Emmerich & André Deutz & Thomas Bäck, 2019. "Efficient computation of expected hypervolume improvement using box decomposition algorithms," Journal of Global Optimization, Springer, vol. 75(1), pages 3-34, September.
  • Handle: RePEc:spr:jglopt:v:75:y:2019:i:1:d:10.1007_s10898-019-00798-7
    DOI: 10.1007/s10898-019-00798-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-019-00798-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-019-00798-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Couckuyt & Dirk Deschrijver & Tom Dhaene, 2014. "Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization," Journal of Global Optimization, Springer, vol. 60(3), pages 575-594, November.
    2. Dächert, Kerstin & Klamroth, Kathrin & Lacour, Renaud & Vanderpooten, Daniel, 2017. "Efficient computation of the search region in multi-objective optimization," European Journal of Operational Research, Elsevier, vol. 260(3), pages 841-855.
    3. Michael Emmerich & Kaifeng Yang & André Deutz & Hao Wang & Carlos M. Fonseca, 2016. "A Multicriteria Generalization of Bayesian Global Optimization," Springer Optimization and Its Applications, in: Panos M. Pardalos & Anatoly Zhigljavsky & Julius Žilinskas (ed.), Advances in Stochastic and Deterministic Global Optimization, pages 229-242, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fuhao Ji & Auralee Edelen & Ryan Roussel & Xiaozhe Shen & Sara Miskovich & Stephen Weathersby & Duan Luo & Mianzhen Mo & Patrick Kramer & Christopher Mayes & Mohamed A. K. Othman & Emilio Nanni & Xiji, 2024. "Multi-objective Bayesian active learning for MeV-ultrafast electron diffraction," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    2. Eichfelder, Gabriele & Warnow, Leo, 2023. "Advancements in the computation of enclosures for multi-objective optimization problems," European Journal of Operational Research, Elsevier, vol. 310(1), pages 315-327.
    3. Jixiang Qing & Ivo Couckuyt & Tom Dhaene, 2023. "A robust multi-objective Bayesian optimization framework considering input uncertainty," Journal of Global Optimization, Springer, vol. 86(3), pages 693-711, July.
    4. Nicolai Palm & Markus Landerer & Herbert Palm, 2022. "Gaussian Process Regression Based Multi-Objective Bayesian Optimization for Power System Design," Sustainability, MDPI, vol. 14(19), pages 1-23, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    2. Audet, Charles & Bigeon, Jean & Cartier, Dominique & Le Digabel, Sébastien & Salomon, Ludovic, 2021. "Performance indicators in multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 292(2), pages 397-422.
    3. Satya Tamby & Daniel Vanderpooten, 2021. "Enumeration of the Nondominated Set of Multiobjective Discrete Optimization Problems," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 72-85, January.
    4. Jixiang Qing & Ivo Couckuyt & Tom Dhaene, 2023. "A robust multi-objective Bayesian optimization framework considering input uncertainty," Journal of Global Optimization, Springer, vol. 86(3), pages 693-711, July.
    5. Kerstin Dächert & Ria Grindel & Elisabeth Leoff & Jonas Mahnkopp & Florian Schirra & Jörg Wenzel, 2022. "Multicriteria asset allocation in practice," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(2), pages 349-373, June.
    6. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Global Optimization for Black-box Simulation via Sequential Intrinsic Kriging," Other publications TiSEM 8fa8d96f-a086-4c4b-88ab-9, Tilburg University, School of Economics and Management.
    7. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Balancing global and local search in parallel efficient global optimization algorithms," Journal of Global Optimization, Springer, vol. 67(4), pages 873-892, April.
    8. Gabriele Eichfelder & Peter Kirst & Laura Meng & Oliver Stein, 2021. "A general branch-and-bound framework for continuous global multiobjective optimization," Journal of Global Optimization, Springer, vol. 80(1), pages 195-227, May.
    9. Jesús Martínez-Frutos & David Herrero-Pérez, 2016. "Kriging-based infill sampling criterion for constraint handling in multi-objective optimization," Journal of Global Optimization, Springer, vol. 64(1), pages 97-115, January.
    10. Eric Bradford & Artur M. Schweidtmann & Alexei Lapkin, 2018. "Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm," Journal of Global Optimization, Springer, vol. 71(2), pages 407-438, June.
    11. Holzmann, Tim & Smith, J.C., 2018. "Solving discrete multi-objective optimization problems using modified augmented weighted Tchebychev scalarizations," European Journal of Operational Research, Elsevier, vol. 271(2), pages 436-449.
    12. Tim Holzmann & J. Cole Smith, 2019. "Shortest path interdiction problem with arc improvement recourse: A multiobjective approach," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(3), pages 230-252, April.
    13. Ozgu Turgut & Evrim Dalkiran & Alper E. Murat, 2019. "An exact parallel objective space decomposition algorithm for solving multi-objective integer programming problems," Journal of Global Optimization, Springer, vol. 75(1), pages 35-62, September.
    14. Boland, Natashia & Charkhgard, Hadi & Savelsbergh, Martin, 2019. "Preprocessing and cut generation techniques for multi-objective binary programming," European Journal of Operational Research, Elsevier, vol. 274(3), pages 858-875.
    15. Capitanescu, F. & Marvuglia, A. & Benetto, E. & Ahmadi, A. & Tiruta-Barna, L., 2017. "Linear programming-based directed local search for expensive multi-objective optimization problems: Application to drinking water production plants," European Journal of Operational Research, Elsevier, vol. 262(1), pages 322-334.
    16. Jolan Wauters & Andy Keane & Joris Degroote, 2020. "Development of an adaptive infill criterion for constrained multi-objective asynchronous surrogate-based optimization," Journal of Global Optimization, Springer, vol. 78(1), pages 137-160, September.
    17. Paul Feliot & Julien Bect & Emmanuel Vazquez, 2017. "A Bayesian approach to constrained single- and multi-objective optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 97-133, January.
    18. Eichfelder, Gabriele & Warnow, Leo, 2023. "Advancements in the computation of enclosures for multi-objective optimization problems," European Journal of Operational Research, Elsevier, vol. 310(1), pages 315-327.
    19. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Pseudo expected improvement criterion for parallel EGO algorithm," Journal of Global Optimization, Springer, vol. 68(3), pages 641-662, July.
    20. Kerstin Dachert & Ria Grindel & Elisabeth Leoff & Jonas Mahnkopp & Florian Schirra & Jorg Wenzel, 2021. "Multicriteria asset allocation in practice," Papers 2103.10958, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:75:y:2019:i:1:d:10.1007_s10898-019-00798-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.