IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v35y2023i2p318-334.html
   My bibliography  Save this article

Reference Vector Assisted Candidate Search with Aggregated Surrogate for Computationally Expensive Many Objective Optimization Problems

Author

Listed:
  • Wenyu Wang

    (Department of Industrial Systems Engineering and Management, College of Design and Engineering, National University of Singapore, Singapore 117576, Singapore)

  • Christine A. Shoemaker

    (Department of Industrial Systems Engineering and Management, College of Design and Engineering, National University of Singapore, Singapore 117576, Singapore)

Abstract

Pareto-optimal sets of multiobjective optimization problems with black-box and computationally expensive objective functions are generally hard to locate within a limited computational budget, and this situation gets even worse when more than three objectives are involved. To this end, we present a novel surrogate-assisted many-objective optimization algorithm RECAS. Unlike most prior studies, the proposed algorithm is a non–evolutionary-based method, and it iteratively determines new points for expensive evaluation via a series of independent reference vector assisted candidate searches. Furthermore, to make the number of surrogates to be maintained independent of the number of objectives, in each candidate search, RECAS constructs a surrogate model in an aggregated manner to approximate the quality assessment indicator of each point rather than a certain objective function. Under some mild assumptions, this study proves that RECAS converges almost surely to the Pareto-optimal front. In the numerical experiments, the effectiveness and reliability of RECAS are examined on both DTLZ and WFG test suites with the number of objectives varying from 2 to 10. Compared with six state-of-the-art many-objective optimization algorithms, RECAS generally performs better in maintaining convergent and well-spread approximation of the Pareto-optimal front. Finally, the good performance of RECAS on two watershed simulation model calibration problems indicates its great potential in handling real-world applications.

Suggested Citation

  • Wenyu Wang & Christine A. Shoemaker, 2023. "Reference Vector Assisted Candidate Search with Aggregated Surrogate for Computationally Expensive Many Objective Optimization Problems," INFORMS Journal on Computing, INFORMS, vol. 35(2), pages 318-334, March.
  • Handle: RePEc:inm:orijoc:v:35:y:2023:i:2:p:318-334
    DOI: 10.1287/ijoc.2022.1260
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijoc.2022.1260
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2022.1260?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Audet, Charles & Savard, Gilles & Zghal, Walid, 2010. "A mesh adaptive direct search algorithm for multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 204(3), pages 545-556, August.
    2. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.
    3. Regis, Rommel G. & Shoemaker, Christine A., 2007. "Parallel radial basis function methods for the global optimization of expensive functions," European Journal of Operational Research, Elsevier, vol. 182(2), pages 514-535, October.
    4. Juliane Müller & Marcus Day, 2019. "Surrogate Optimization of Computationally Expensive Black-Box Problems with Hidden Constraints," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 689-702, October.
    5. Beume, Nicola & Naujoks, Boris & Emmerich, Michael, 2007. "SMS-EMOA: Multiobjective selection based on dominated hypervolume," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1653-1669, September.
    6. Rommel G. Regis & Christine A. Shoemaker, 2007. "A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions," INFORMS Journal on Computing, INFORMS, vol. 19(4), pages 497-509, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juliane Müller & Jangho Park & Reetik Sahu & Charuleka Varadharajan & Bhavna Arora & Boris Faybishenko & Deborah Agarwal, 2021. "Surrogate optimization of deep neural networks for groundwater predictions," Journal of Global Optimization, Springer, vol. 81(1), pages 203-231, September.
    2. Juliane Müller, 2017. "SOCEMO: Surrogate Optimization of Computationally Expensive Multiobjective Problems," INFORMS Journal on Computing, INFORMS, vol. 29(4), pages 581-596, November.
    3. Zhe Zhou & Fusheng Bai, 2018. "An adaptive framework for costly black-box global optimization based on radial basis function interpolation," Journal of Global Optimization, Springer, vol. 70(4), pages 757-781, April.
    4. Taimoor Akhtar & Christine Shoemaker, 2016. "Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection," Journal of Global Optimization, Springer, vol. 64(1), pages 17-32, January.
    5. Audet, Charles & Bigeon, Jean & Cartier, Dominique & Le Digabel, Sébastien & Salomon, Ludovic, 2021. "Performance indicators in multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 292(2), pages 397-422.
    6. Wenyu Wang & Taimoor Akhtar & Christine A. Shoemaker, 2022. "Integrating $$\varepsilon $$ ε -dominance and RBF surrogate optimization for solving computationally expensive many-objective optimization problems," Journal of Global Optimization, Springer, vol. 82(4), pages 965-992, April.
    7. Belmiro P. M. Duarte & Anthony C. Atkinson & Satya P. Singh & Marco S. Reis, 2023. "Optimal design of experiments for hypothesis testing on ordered treatments via intersection-union tests," Statistical Papers, Springer, vol. 64(2), pages 587-615, April.
    8. Hau T. Mai & Jaewook Lee & Joowon Kang & H. Nguyen-Xuan & Jaehong Lee, 2022. "An Improved Blind Kriging Surrogate Model for Design Optimization Problems," Mathematics, MDPI, vol. 10(16), pages 1-19, August.
    9. Chow, Joseph Y.J. & Regan, Amelia C., 2011. "Network-based real option models," Transportation Research Part B: Methodological, Elsevier, vol. 45(4), pages 682-695, May.
    10. Wu, Xin & Zheng, Yi & Wu, Bin & Tian, Yong & Han, Feng & Zheng, Chunmiao, 2016. "Optimizing conjunctive use of surface water and groundwater for irrigation to address human-nature water conflicts: A surrogate modeling approach," Agricultural Water Management, Elsevier, vol. 163(C), pages 380-392.
    11. Rommel Regis & Christine Shoemaker, 2013. "A quasi-multistart framework for global optimization of expensive functions using response surface models," Journal of Global Optimization, Springer, vol. 56(4), pages 1719-1753, August.
    12. Juliane Müller & Christine Shoemaker & Robert Piché, 2014. "SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications," Journal of Global Optimization, Springer, vol. 59(4), pages 865-889, August.
    13. Chen, Mingjie & Tompson, Andrew F.B. & Mellors, Robert J. & Ramirez, Abelardo L. & Dyer, Kathleen M. & Yang, Xianjin & Wagoner, Jeffrey L., 2014. "An efficient Bayesian inversion of a geothermal prospect using a multivariate adaptive regression spline method," Applied Energy, Elsevier, vol. 136(C), pages 619-627.
    14. Nadia Martinez & Hadis Anahideh & Jay M. Rosenberger & Diana Martinez & Victoria C. P. Chen & Bo Ping Wang, 2017. "Global optimization of non-convex piecewise linear regression splines," Journal of Global Optimization, Springer, vol. 68(3), pages 563-586, July.
    15. Liu, Haoxiang & Wang, David Z.W., 2017. "Locating multiple types of charging facilities for battery electric vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 103(C), pages 30-55.
    16. Liu, Haoxiang & Szeto, W.Y. & Long, Jiancheng, 2019. "Bike network design problem with a path-size logit-based equilibrium constraint: Formulation, global optimization, and matheuristic," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 127(C), pages 284-307.
    17. Krityakierne, Tipaluck & Baowan, Duangkamon, 2020. "Aggregated GP-based Optimization for Contaminant Source Localization," Operations Research Perspectives, Elsevier, vol. 7(C).
    18. Logan Mathesen & Giulia Pedrielli & Szu Hui Ng & Zelda B. Zabinsky, 2021. "Stochastic optimization with adaptive restart: a framework for integrated local and global learning," Journal of Global Optimization, Springer, vol. 79(1), pages 87-110, January.
    19. Tipaluck Krityakierne & Taimoor Akhtar & Christine A. Shoemaker, 2016. "SOP: parallel surrogate global optimization with Pareto center selection for computationally expensive single objective problems," Journal of Global Optimization, Springer, vol. 66(3), pages 417-437, November.
    20. Richard T. Lyons & Richard C. Peralta & Partha Majumder, 2020. "Comparing Single-Objective Optimization Protocols for Calibrating the Birds Nest Aquifer Model—A Problem Having Multiple Local Optima," IJERPH, MDPI, vol. 17(3), pages 1-10, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:35:y:2023:i:2:p:318-334. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.