IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v36y2024i6p1382-1399.html
   My bibliography  Save this article

Constraint Learning to Define Trust Regions in Optimization over Pre-Trained Predictive Models

Author

Listed:
  • Chenbo Shi

    (Department of Operations and Information Management, University of Connecticut, Storrs, Connecticut 06268)

  • Mohsen Emadikhiav

    (Department of Information Technology and Operations Management, Florida Atlantic University, Boca Raton, Florida 33431)

  • Leonardo Lozano

    (Department of Operations, Business Analytics, and Information Systems, University of Cincinnati, Cincinnati, Ohio 45221)

  • David Bergman

    (Department of Operations and Information Management, University of Connecticut, Storrs, Connecticut 06268)

Abstract

There is a recent proliferation of research on the integration of machine learning and optimization. One expansive area within this research stream is optimization over pre-trained predictive models, which proposes the use of pre-trained predictive models as surrogates for uncertain or highly complex objective functions. In this setting, features of the predictive models become decision variables in the optimization problem. Despite a recent surge in publications in this area, only a few papers note the importance of incorporating trust-region considerations in this decision-making pipeline, that is, enforcing solutions to be similar to the data used to train the predictive models. Without such constraints, the evaluation of the predictive model at solutions obtained from optimization cannot be trusted and the practicality of the solutions may be unreasonable. In this paper, we provide an overview of the approaches appearing in the literature to construct a trust region and propose three alternative approaches. Our numerical evaluation highlights that trust-region constraints learned through our newly proposed approaches compare favorably with previously suggested approaches, both in terms of solution quality and computational time.

Suggested Citation

  • Chenbo Shi & Mohsen Emadikhiav & Leonardo Lozano & David Bergman, 2024. "Constraint Learning to Define Trust Regions in Optimization over Pre-Trained Predictive Models," INFORMS Journal on Computing, INFORMS, vol. 36(6), pages 1382-1399, December.
  • Handle: RePEc:inm:orijoc:v:36:y:2024:i:6:p:1382-1399
    DOI: 10.1287/ijoc.2022.0312
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijoc.2022.0312
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2022.0312?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Keliang Wang & Leonardo Lozano & Carlos Cardonha & David Bergman, 2023. "Optimizing over an Ensemble of Trained Neural Networks," INFORMS Journal on Computing, INFORMS, vol. 35(3), pages 652-674, May.
    2. Sheng Liu & Long He & Zuo-Jun Max Shen, 2021. "On-Time Last-Mile Delivery: Order Assignment with Travel-Time Predictors," Management Science, INFORMS, vol. 67(7), pages 4095-4119, July.
    3. Miten Mistry & Dimitrios Letsios & Gerhard Krennrich & Robert M. Lee & Ruth Misener, 2021. "Mixed-Integer Convex Nonlinear Optimization with Gradient-Boosted Trees Embedded," INFORMS Journal on Computing, INFORMS, vol. 33(3), pages 1103-1119, July.
    4. David Bergman & Teng Huang & Philip Brooks & Andrea Lodi & Arvind U. Raghunathan, 2022. "JANOS: An Integrated Predictive and Prescriptive Modeling Framework," INFORMS Journal on Computing, INFORMS, vol. 34(2), pages 807-816, March.
    5. Max Biggs & Rim Hariss & Georgia Perakis, 2023. "Constrained optimization of objective functions determined from random forests," Production and Operations Management, Production and Operations Management Society, vol. 32(2), pages 397-415, February.
    6. Lennart Baardman & Maxime C. Cohen & Kiran Panchamgam & Georgia Perakis & Danny Segev, 2019. "Scheduling Promotion Vehicles to Boost Profits," Management Science, INFORMS, vol. 65(1), pages 50-70, January.
    7. Dimitris Bertsimas & Allison O’Hair & Stephen Relyea & John Silberholz, 2016. "An Analytics Approach to Designing Combination Chemotherapy Regimens for Cancer," Management Science, INFORMS, vol. 62(5), pages 1511-1531, May.
    8. Kris Johnson Ferreira & Bin Hong Alex Lee & David Simchi-Levi, 2016. "Analytics for an Online Retailer: Demand Forecasting and Price Optimization," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 69-88, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keliang Wang & Leonardo Lozano & Carlos Cardonha & David Bergman, 2023. "Optimizing over an Ensemble of Trained Neural Networks," INFORMS Journal on Computing, INFORMS, vol. 35(3), pages 652-674, May.
    2. Bharadwaj Kadiyala & Özalp Özer & A. Serdar Şimşek, 2021. "Data‐Driven Approaches to Targeting Promotion E‐mails: The Case of Delayed Incentives," Production and Operations Management, Production and Operations Management Society, vol. 30(3), pages 766-782, March.
    3. Wang, Shuaian & Yan, Ran, 2023. "Fundamental challenge and solution methods in prescriptive analytics for freight transportation," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 169(C).
    4. Max Biggs & Rim Hariss & Georgia Perakis, 2023. "Constrained optimization of objective functions determined from random forests," Production and Operations Management, Production and Operations Management Society, vol. 32(2), pages 397-415, February.
    5. Fajemisin, Adejuyigbe O. & Maragno, Donato & den Hertog, Dick, 2024. "Optimization with constraint learning: A framework and survey," European Journal of Operational Research, Elsevier, vol. 314(1), pages 1-14.
    6. Sadana, Utsav & Chenreddy, Abhilash & Delage, Erick & Forel, Alexandre & Frejinger, Emma & Vidal, Thibaut, 2025. "A survey of contextual optimization methods for decision-making under uncertainty," European Journal of Operational Research, Elsevier, vol. 320(2), pages 271-289.
    7. Tao, Jiawei & Dai, Hongyan & Chen, Weiwei & Jiang, Hai, 2023. "The value of personalized dispatch in O2O on-demand delivery services," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1022-1035.
    8. Turgay Ayer & Can Zhang & Anthony Bonifonte & Anne C. Spaulding & Jagpreet Chhatwal, 2019. "Prioritizing Hepatitis C Treatment in U.S. Prisons," Operations Research, INFORMS, vol. 67(3), pages 853-873, May.
    9. Tsao, Yu-Chung & Chen, Yu-Kai & Chiu, Shih-Hao & Lu, Jye-Chyi & Vu, Thuy-Linh, 2022. "An innovative demand forecasting approach for the server industry," Technovation, Elsevier, vol. 110(C).
    10. Wei Chen & Yixin Lu & Liangfei Qiu & Subodha Kumar, 2021. "Designing Personalized Treatment Plans for Breast Cancer," Information Systems Research, INFORMS, vol. 32(3), pages 932-949, September.
    11. Arielle Anderer & Hamsa Bastani & John Silberholz, 2022. "Adaptive Clinical Trial Designs with Surrogates: When Should We Bother?," Management Science, INFORMS, vol. 68(3), pages 1982-2002, March.
    12. Victor Martínez‐de‐Albéniz & Arnau Planas & Stefano Nasini, 2020. "Using Clickstream Data to Improve Flash Sales Effectiveness," Production and Operations Management, Production and Operations Management Society, vol. 29(11), pages 2508-2531, November.
    13. Pédussel Wu, Jennifer & Metzger, Martina & Neira, Ignacio Silva & Farroukh, Arafet, 2023. "What determines demand for digital community currencies? OurVillage in Cameroon," IPE Working Papers 209/2023, Berlin School of Economics and Law, Institute for International Political Economy (IPE).
    14. Ikeda, Shunnosuke & Nishimura, Naoki & Sukegawa, Noriyoshi & Takano, Yuichi, 2023. "Prescriptive price optimization using optimal regression trees," Operations Research Perspectives, Elsevier, vol. 11(C).
    15. Haiqing Hu & Pandu R. Tadikamalla, 2020. "When to launch a sales promotion for online fashion products? An empirical study," Electronic Commerce Research, Springer, vol. 20(4), pages 737-756, December.
    16. Dong Zhang & Chong Wu, 2023. "What online review features really matter? An explainable deep learning approach for hotel demand forecasting," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(9), pages 1100-1117, September.
    17. Mengjia Zhu & Alberto Bemporad, 2025. "Global and Preference-Based Optimization with Mixed Variables Using Piecewise Affine Surrogates," Journal of Optimization Theory and Applications, Springer, vol. 204(2), pages 1-39, February.
    18. Zhang, Zhe & Gong, Xue & Song, Xiaoling & Yin, Yong & Lev, Benjamin & Zhou, Xiaoyang, 2024. "An effective two phase heuristic for synchronized seru production scheduling and 3PL transportation problems," International Journal of Production Economics, Elsevier, vol. 268(C).
    19. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    20. Tsay, Calvin, 2024. "A Quantile Neural Network Framework for Twostage Stochastic Optimization," DES - Working Papers. Statistics and Econometrics. WS 43773, Universidad Carlos III de Madrid. Departamento de Estadística.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:36:y:2024:i:6:p:1382-1399. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.