IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v60y2014i3p575-594.html
   My bibliography  Save this article

Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization

Author

Listed:
  • Ivo Couckuyt
  • Dirk Deschrijver
  • Tom Dhaene

Abstract

The use of surrogate based optimization (SBO) is widely spread in engineering design to reduce the number of computational expensive simulations. However, “real-world” problems often consist of multiple, conflicting objectives leading to a set of competitive solutions (the Pareto front). The objectives are often aggregated into a single cost function to reduce the computational cost, though a better approach is to use multiobjective optimization methods to directly identify a set of Pareto-optimal solutions, which can be used by the designer to make more efficient design decisions (instead of weighting and aggregating the costs upfront). Most of the work in multiobjective optimization is focused on multiobjective evolutionary algorithms (MOEAs). While MOEAs are well-suited to handle large, intractable design spaces, they typically require thousands of expensive simulations, which is prohibitively expensive for the problems under study. Therefore, the use of surrogate models in multiobjective optimization, denoted as multiobjective surrogate-based optimization, may prove to be even more worthwhile than SBO methods to expedite the optimization of computational expensive systems. In this paper, the authors propose the efficient multiobjective optimization (EMO) algorithm which uses Kriging models and multiobjective versions of the probability of improvement and expected improvement criteria to identify the Pareto front with a minimal number of expensive simulations. The EMO algorithm is applied on multiple standard benchmark problems and compared against the well-known NSGA-II, SPEA2 and SMS-EMOA multiobjective optimization methods. Copyright Springer Science+Business Media New York 2014

Suggested Citation

  • Ivo Couckuyt & Dirk Deschrijver & Tom Dhaene, 2014. "Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization," Journal of Global Optimization, Springer, vol. 60(3), pages 575-594, November.
  • Handle: RePEc:spr:jglopt:v:60:y:2014:i:3:p:575-594
    DOI: 10.1007/s10898-013-0118-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10898-013-0118-2
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10898-013-0118-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Beume, Nicola & Naujoks, Boris & Emmerich, Michael, 2007. "SMS-EMOA: Multiobjective selection based on dominated hypervolume," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1653-1669, September.
    2. Johannes Bader & Kalyanmoy Deb & Eckart Zitzler, 2010. "Faster Hypervolume-Based Search Using Monte Carlo Sampling," Lecture Notes in Economics and Mathematical Systems, in: Matthias Ehrgott & Boris Naujoks & Theodor J. Stewart & Jyrki Wallenius (ed.), Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems, pages 313-326, Springer.
    3. Edwin R. van Dam & Bart Husslage & Dick den Hertog & Hans Melissen, 2007. "Maximin Latin Hypercube Designs in Two Dimensions," Operations Research, INFORMS, vol. 55(1), pages 158-169, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Duro, João A. & Ozturk, Umud Esat & Oara, Daniel C. & Salomon, Shaul & Lygoe, Robert J. & Burke, Richard & Purshouse, Robin C., 2023. "Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem," European Journal of Operational Research, Elsevier, vol. 307(1), pages 421-446.
    2. Mehdad, E. & Kleijnen, Jack P.C., 2014. "Global Optimization for Black-box Simulation via Sequential Intrinsic Kriging," Discussion Paper 2014-063, Tilburg University, Center for Economic Research.
    3. Lee, Juseong & Mitici, Mihaela, 2022. "Multi-objective design of aircraft maintenance using Gaussian process learning and adaptive sampling," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    4. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Balancing global and local search in parallel efficient global optimization algorithms," Journal of Global Optimization, Springer, vol. 67(4), pages 873-892, April.
    5. Paul Feliot & Julien Bect & Emmanuel Vazquez, 2017. "A Bayesian approach to constrained single- and multi-objective optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 97-133, January.
    6. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    7. Prashant Singh & Ivo Couckuyt & Khairy Elsayed & Dirk Deschrijver & Tom Dhaene, 2017. "Multi-objective Geometry Optimization of a Gas Cyclone Using Triple-Fidelity Co-Kriging Surrogate Models," Journal of Optimization Theory and Applications, Springer, vol. 175(1), pages 172-193, October.
    8. Jolan Wauters & Andy Keane & Joris Degroote, 2020. "Development of an adaptive infill criterion for constrained multi-objective asynchronous surrogate-based optimization," Journal of Global Optimization, Springer, vol. 78(1), pages 137-160, September.
    9. Dawei Zhan & Jiachang Qian & Yuansheng Cheng, 2017. "Pseudo expected improvement criterion for parallel EGO algorithm," Journal of Global Optimization, Springer, vol. 68(3), pages 641-662, July.
    10. Jixiang Qing & Ivo Couckuyt & Tom Dhaene, 2023. "A robust multi-objective Bayesian optimization framework considering input uncertainty," Journal of Global Optimization, Springer, vol. 86(3), pages 693-711, July.
    11. Kaifeng Yang & Michael Emmerich & André Deutz & Thomas Bäck, 2019. "Efficient computation of expected hypervolume improvement using box decomposition algorithms," Journal of Global Optimization, Springer, vol. 75(1), pages 3-34, September.
    12. Jesús Martínez-Frutos & David Herrero-Pérez, 2016. "Kriging-based infill sampling criterion for constraint handling in multi-objective optimization," Journal of Global Optimization, Springer, vol. 64(1), pages 97-115, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua Q. Hale & Helin Zhu & Enlu Zhou, 2020. "Domination Measure: A New Metric for Solving Multiobjective Optimization," INFORMS Journal on Computing, INFORMS, vol. 32(3), pages 565-581, July.
    2. Liagkouras, Konstantinos & Metaxiotis, Konstantinos, 2021. "Improving multi-objective algorithms performance by emulating behaviors from the human social analogue in candidate solutions," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1019-1036.
    3. Gong, Wenyin & Cai, Zhihua, 2009. "An improved multiobjective differential evolution based on Pareto-adaptive [epsilon]-dominance and orthogonal design," European Journal of Operational Research, Elsevier, vol. 198(2), pages 576-601, October.
    4. Andrea Ponti & Antonio Candelieri & Ilaria Giordani & Francesco Archetti, 2023. "Intrusion Detection in Networks by Wasserstein Enabled Many-Objective Evolutionary Algorithms," Mathematics, MDPI, vol. 11(10), pages 1-14, May.
    5. Yunsong Han & Hong Yu & Cheng Sun, 2017. "Simulation-Based Multiobjective Optimization of Timber-Glass Residential Buildings in Severe Cold Regions," Sustainability, MDPI, vol. 9(12), pages 1-18, December.
    6. Nondy, J. & Gogoi, T.K., 2021. "Performance comparison of multi-objective evolutionary algorithms for exergetic and exergoenvironomic optimization of a benchmark combined heat and power system," Energy, Elsevier, vol. 233(C).
    7. Sergio Cabello, 2023. "Faster distance-based representative skyline and k-center along pareto front in the plane," Journal of Global Optimization, Springer, vol. 86(2), pages 441-466, June.
    8. Houssem R. E. H. Bouchekara & Yusuf A. Sha’aban & Mohammad S. Shahriar & Makbul A. M. Ramli & Abdullahi A. Mas’ud, 2023. "Wind Farm Layout Optimization/Expansion with Real Wind Turbines Using a Multi-Objective EA Based on an Enhanced Inverted Generational Distance Metric Combined with the Two-Archive Algorithm 2," Sustainability, MDPI, vol. 15(3), pages 1-32, January.
    9. Edwin Dam & Bart Husslage & Dick Hertog, 2010. "One-dimensional nested maximin designs," Journal of Global Optimization, Springer, vol. 46(2), pages 287-306, February.
    10. Rennen, G., 2008. "Subset Selection from Large Datasets for Kriging Modeling," Discussion Paper 2008-26, Tilburg University, Center for Economic Research.
    11. Braun, Marlon & Shukla, Pradyumn, 2024. "On cone-based decompositions of proper Pareto-optimality in multi-objective optimization," European Journal of Operational Research, Elsevier, vol. 317(2), pages 592-602.
    12. Jesús Martínez-Frutos & David Herrero-Pérez, 2016. "Kriging-based infill sampling criterion for constraint handling in multi-objective optimization," Journal of Global Optimization, Springer, vol. 64(1), pages 97-115, January.
    13. José Antonio Castán Rocha & Alejandro Santiago & Alejandro H. García-Ruiz & Jesús David Terán-Villanueva & Salvador Ibarra Martínez & Mayra Guadalupe Treviño Berrones, 2024. "Pareto Approximation Empirical Results of Energy-Aware Optimization for Precedence-Constrained Task Scheduling Considering Switching Off Completely Idle Machines," Mathematics, MDPI, vol. 12(23), pages 1-53, November.
    14. Eric Bradford & Artur M. Schweidtmann & Alexei Lapkin, 2018. "Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm," Journal of Global Optimization, Springer, vol. 71(2), pages 407-438, June.
    15. Pilechiha, Peiman & Mahdavinejad, Mohammadjavad & Pour Rahimian, Farzad & Carnemolla, Phillippa & Seyedzadeh, Saleh, 2020. "Multi-objective optimisation framework for designing office windows: quality of view, daylight and energy efficiency," Applied Energy, Elsevier, vol. 261(C).
    16. Dubois-Lacoste, Jérémie & López-Ibáñez, Manuel & Stützle, Thomas, 2015. "Anytime Pareto local search," European Journal of Operational Research, Elsevier, vol. 243(2), pages 369-385.
    17. Liuqing Yang & Yongdao Zhou & Min-Qian Liu, 2021. "Maximin distance designs based on densest packings," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(5), pages 615-634, July.
    18. Hyoungjin Kim & Meng-Sing Liou, 2013. "New fitness sharing approach for multi-objective genetic algorithms," Journal of Global Optimization, Springer, vol. 55(3), pages 579-595, March.
    19. Garcia-Teruel, Anna & DuPont, Bryony & Forehand, David I.M., 2021. "Hull geometry optimisation of wave energy converters: On the choice of the objective functions and the optimisation formulation," Applied Energy, Elsevier, vol. 298(C).
    20. Prescott, Philip, 2009. "Orthogonal-column Latin hypercube designs with small samples," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1191-1200, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:60:y:2014:i:3:p:575-594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.