IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v307y2023i1p421-446.html
   My bibliography  Save this article

Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem

Author

Listed:
  • Duro, João A.
  • Ozturk, Umud Esat
  • Oara, Daniel C.
  • Salomon, Shaul
  • Lygoe, Robert J.
  • Burke, Richard
  • Purshouse, Robin C.

Abstract

Engineering design optimization problems increasingly require computationally expensive high-fidelity simulation models to evaluate candidate designs. The evaluation budget may be small, limiting the effectiveness of conventional multi-objective evolutionary algorithms. Bayesian optimization algorithms (BOAs) are an alternative approach for expensive problems but are underdeveloped in terms of support for constraints and non-continuous design variables—both of which are prevalent features of real-world design problems. This study investigates two constraint handling strategies for BOAs and introduces the first BOA for mixed-integer problems, intended for use on a real-world engine design problem. The new BOAs are empirically compared to their closest competitor for this problem—the multi-objective evolutionary algorithm NSGA-II, itself equipped with constraint handling and mixed-integer components. Performance is also analysed on two benchmark problems which have similar features to the engine design problem, but are computationally cheaper to evaluate. The BOAs offer statistically significant convergence improvements of between 5.9% and 31.9% over NSGA-II across the problems on a budget of 500 design evaluations. Of the two constraint handling methods, constrained expected improvement offers better convergence than the penalty function approach. For the engine problem, the BOAs identify improved feasible designs offering 36.4% reductions in nitrogen oxide emissions and 2.0% reductions in fuel consumption when compared to a notional baseline design. The use of constrained mixed-integer BOAs is recommended for expensive engineering design optimization problems.

Suggested Citation

  • Duro, João A. & Ozturk, Umud Esat & Oara, Daniel C. & Salomon, Shaul & Lygoe, Robert J. & Burke, Richard & Purshouse, Robin C., 2023. "Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem," European Journal of Operational Research, Elsevier, vol. 307(1), pages 421-446.
  • Handle: RePEc:eee:ejores:v:307:y:2023:i:1:p:421-446
    DOI: 10.1016/j.ejor.2022.08.032
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722006774
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2022.08.032?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    2. Ivo Couckuyt & Dirk Deschrijver & Tom Dhaene, 2014. "Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization," Journal of Global Optimization, Springer, vol. 60(3), pages 575-594, November.
    3. Millo, Federico & Arya, Pranav & Mallamo, Fabio, 2018. "Optimization of automotive diesel engine calibration using genetic algorithm techniques," Energy, Elsevier, vol. 158(C), pages 807-819.
    4. D'Errico, G. & Cerri, T. & Pertusi, G., 2011. "Multi-objective optimization of internal combustion engine by means of 1D fluid-dynamic models," Applied Energy, Elsevier, vol. 88(3), pages 767-777, March.
    5. Lotfan, S. & Ghiasi, R. Akbarpour & Fallah, M. & Sadeghi, M.H., 2016. "ANN-based modeling and reducing dual-fuel engine’s challenging emissions by multi-objective evolutionary algorithm NSGA-II," Applied Energy, Elsevier, vol. 175(C), pages 91-99.
    6. Tsionas, Mike G., 2019. "Multi-objective optimization using statistical models," European Journal of Operational Research, Elsevier, vol. 276(1), pages 364-378.
    7. Tornatore, Cinzia & Bozza, Fabio & De Bellis, Vincenzo & Teodosio, Luigi & Valentino, Gerardo & Marchitto, Luca, 2019. "Experimental and numerical study on the influence of cooled EGR on knock tendency, performance and emissions of a downsized spark-ignition engine," Energy, Elsevier, vol. 172(C), pages 968-976.
    8. Paul Feliot & Julien Bect & Emmanuel Vazquez, 2017. "A Bayesian approach to constrained single- and multi-objective optimization," Journal of Global Optimization, Springer, vol. 67(1), pages 97-133, January.
    9. Mlakar, Miha & Petelin, Dejan & Tušar, Tea & Filipič, Bogdan, 2015. "GP-DEMO: Differential Evolution for Multiobjective Optimization based on Gaussian Process models," European Journal of Operational Research, Elsevier, vol. 243(2), pages 347-361.
    10. Drake, John H. & Starkey, Andrew & Owusu, Gilbert & Burke, Edmund K., 2020. "Multiobjective evolutionary algorithms for strategic deployment of resources in operational units," European Journal of Operational Research, Elsevier, vol. 282(2), pages 729-740.
    11. Alcaraz, Javier & Landete, Mercedes & Monge, Juan F. & Sainz-Pardo, José L., 2020. "Multi-objective evolutionary algorithms for a reliability location problem," European Journal of Operational Research, Elsevier, vol. 283(1), pages 83-93.
    12. Zhen, Xudong & Wang, Yang & Xu, Shuaiqing & Zhu, Yongsheng & Tao, Chengjun & Xu, Tao & Song, Mingzhi, 2012. "The engine knock analysis – An overview," Applied Energy, Elsevier, vol. 92(C), pages 628-636.
    13. Tadros, M. & Ventura, M. & Guedes Soares, C., 2019. "Optimization procedure to minimize fuel consumption of a four-stroke marine turbocharged diesel engine," Energy, Elsevier, vol. 168(C), pages 897-908.
    14. Togun, Necla & Baysec, Sedat, 2010. "Genetic programming approach to predict torque and brake specific fuel consumption of a gasoline engine," Applied Energy, Elsevier, vol. 87(11), pages 3401-3408, November.
    15. Koziel, Slawomir & Pietrenko-Dabrowska, Anna, 2022. "Constrained multi-objective optimization of compact microwave circuits by design triangulation and pareto front interpolation," European Journal of Operational Research, Elsevier, vol. 299(1), pages 302-312.
    16. Audet, Charles & Bigeon, Jean & Cartier, Dominique & Le Digabel, Sébastien & Salomon, Ludovic, 2021. "Performance indicators in multiobjective optimization," European Journal of Operational Research, Elsevier, vol. 292(2), pages 397-422.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yangtao & Khajepour, Amir & Devaud, Cécile & Liu, Kaimin, 2017. "Power and fuel economy optimizations of gasoline engines using hydraulic variable valve actuation system," Applied Energy, Elsevier, vol. 206(C), pages 577-593.
    2. Tadros, M. & Ventura, M. & Guedes Soares, C., 2019. "Optimization procedure to minimize fuel consumption of a four-stroke marine turbocharged diesel engine," Energy, Elsevier, vol. 168(C), pages 897-908.
    3. Liagkouras, Konstantinos & Metaxiotis, Konstantinos, 2021. "Improving multi-objective algorithms performance by emulating behaviors from the human social analogue in candidate solutions," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1019-1036.
    4. Dawei Zhan & Huanlai Xing, 2020. "Expected improvement for expensive optimization: a review," Journal of Global Optimization, Springer, vol. 78(3), pages 507-544, November.
    5. De Bellis, Vincenzo, 2016. "Performance optimization of a spark-ignition turbocharged VVA engine under knock limited operation," Applied Energy, Elsevier, vol. 164(C), pages 162-174.
    6. Yu, Xunzhao & Zhu, Ling & Wang, Yan & Filev, Dimitar & Yao, Xin, 2022. "Internal combustion engine calibration using optimization algorithms," Applied Energy, Elsevier, vol. 305(C).
    7. Capitanescu, F. & Marvuglia, A. & Benetto, E. & Ahmadi, A. & Tiruta-Barna, L., 2017. "Linear programming-based directed local search for expensive multi-objective optimization problems: Application to drinking water production plants," European Journal of Operational Research, Elsevier, vol. 262(1), pages 322-334.
    8. Haruki Tajima & Takuya Tomidokoro & Takeshi Yokomori, 2022. "Deep Learning for Knock Occurrence Prediction in SI Engines," Energies, MDPI, vol. 15(24), pages 1-14, December.
    9. Koziel, Slawomir & Pietrenko-Dabrowska, Anna, 2022. "Constrained multi-objective optimization of compact microwave circuits by design triangulation and pareto front interpolation," European Journal of Operational Research, Elsevier, vol. 299(1), pages 302-312.
    10. Gharehghani, Ayat & Abbasi, Hamid Reza & Alizadeh, Pouria, 2021. "Application of machine learning tools for constrained multi-objective optimization of an HCCI engine," Energy, Elsevier, vol. 233(C).
    11. Zhen, Xudong & Tian, Zhi & Wang, Yang & Xu, Meng & Liu, Daming & Li, Xiaoyan, 2022. "Knock analysis of bio-butanol in TISI engine based on chemical reaction kinetics," Energy, Elsevier, vol. 239(PC).
    12. Tehseen Johar & Chiu-Fan Hsieh, 2023. "Design Challenges in Hydrogen-Fueled Rotary Engine—A Review," Energies, MDPI, vol. 16(2), pages 1-22, January.
    13. Zhen, Xudong & Wang, Yang, 2013. "Study of ignition in a high compression ratio SI (spark ignition) methanol engine using LES (large eddy simulation) with detailed chemical kinetics," Energy, Elsevier, vol. 59(C), pages 549-558.
    14. Wang, Jinling & Tian, Yebing & Hu, Xintao & Han, Jinguo & Liu, Bing, 2023. "Integrated assessment and optimization of dual environment and production drivers in grinding," Energy, Elsevier, vol. 272(C).
    15. Pasta, Edoardo & Faedo, Nicolás & Mattiazzo, Giuliana & Ringwood, John V., 2023. "Towards data-driven and data-based control of wave energy systems: Classification, overview, and critical assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    16. Xiangang Cao & Pengfei Li & Song Ming, 2021. "Remaining Useful Life Prediction-Based Maintenance Decision Model for Stochastic Deterioration Equipment under Data-Driven," Sustainability, MDPI, vol. 13(15), pages 1-19, July.
    17. Richard Fiifi Turkson & Fuwu Yan & Mohamed Kamal Ahmed Ali & Bo Liu & Jie Hu, 2016. "Modeling and Multi-Objective Optimization of Engine Performance and Hydrocarbon Emissions via the Use of a Computer Aided Engineering Code and the NSGA-II Genetic Algorithm," Sustainability, MDPI, vol. 8(1), pages 1-15, January.
    18. Jixiang Qing & Ivo Couckuyt & Tom Dhaene, 2023. "A robust multi-objective Bayesian optimization framework considering input uncertainty," Journal of Global Optimization, Springer, vol. 86(3), pages 693-711, July.
    19. Pan, Jeng-Shyang & Hu, Pei & Chu, Shu-Chuan, 2021. "Binary fish migration optimization for solving unit commitment," Energy, Elsevier, vol. 226(C).
    20. Mofid, Hossein & Jazayeri-Rad, Hooshang & Shahbazian, Mehdi & Fetanat, Abdolvahhab, 2019. "Enhancing the performance of a parallel nitrogen expansion liquefaction process (NELP) using the multi-objective particle swarm optimization (MOPSO) algorithm," Energy, Elsevier, vol. 172(C), pages 286-303.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:307:y:2023:i:1:p:421-446. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.