IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v86y2023i3d10.1007_s10898-023-01281-0.html
   My bibliography  Save this article

General convex relaxations of implicit functions and inverse functions

Author

Listed:
  • Huiyi Cao

    (McMaster University)

  • Kamil A. Khan

    (McMaster University)

Abstract

Convex relaxations of nonconvex functions provide useful bounding information in applications such as deterministic global optimization and reachability analysis. In some situations, the original nonconvex functions may not be known explicitly, but are instead described implicitly by nonlinear equation systems. In these cases, established convex relaxation methods for closed-form functions are not directly applicable. This article presents a new general strategy to construct convex relaxations for such implicit functions. These relaxations are described as convex parametric programs whose constraints are convex relaxations of the original residual function. This relaxation strategy is straightforward to implement, produces tight relaxations in practice, is particularly efficient to carry out when monotonicity properties can be exploited, and does not assume the existence or uniqueness of an implicit function on the entire intended domain. Unlike all previous approaches to the authors’ knowledge, this new approach permits any relaxations of the residual function; it does not require the residual relaxations to be factorable or to be obtained from a McCormick-like traversal of a computational graph. This new convex relaxation strategy is extended to inverse functions, compositions involving implicit functions, feasible-set mappings in constraint satisfaction problems, and solutions of parametric ODEs. Based on a proof-of-concept implementation in Julia, numerical examples are presented to illustrate the convex relaxations produced for various implicit functions and optimal-value functions.

Suggested Citation

  • Huiyi Cao & Kamil A. Khan, 2023. "General convex relaxations of implicit functions and inverse functions," Journal of Global Optimization, Springer, vol. 86(3), pages 545-572, July.
  • Handle: RePEc:spr:jglopt:v:86:y:2023:i:3:d:10.1007_s10898-023-01281-0
    DOI: 10.1007/s10898-023-01281-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-023-01281-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-023-01281-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Arne Stolbjerg Drud, 1994. "CONOPT—A Large-Scale GRG Code," INFORMS Journal on Computing, INFORMS, vol. 6(2), pages 207-216, May.
    2. Yurii Nesterov, 2018. "Lectures on Convex Optimization," Springer Optimization and Its Applications, Springer, edition 2, number 978-3-319-91578-4, June.
    3. Agustín Bompadre & Alexander Mitsos, 2012. "Convergence rate of McCormick relaxations," Journal of Global Optimization, Springer, vol. 52(1), pages 1-28, January.
    4. A. Tsoukalas & A. Mitsos, 2014. "Multivariate McCormick relaxations," Journal of Global Optimization, Springer, vol. 59(2), pages 633-662, July.
    5. Kamil A. Khan & Matthew Wilhelm & Matthew D. Stuber & Huiyi Cao & Harry A. J. Watson & Paul I. Barton, 2018. "Corrections to: Differentiable McCormick relaxations," Journal of Global Optimization, Springer, vol. 70(3), pages 705-706, March.
    6. Joseph Scott & Paul Barton, 2013. "Improved relaxations for the parametric solutions of ODEs using differential inequalities," Journal of Global Optimization, Springer, vol. 57(1), pages 143-176, September.
    7. Joseph Scott & Matthew Stuber & Paul Barton, 2011. "Generalized McCormick relaxations," Journal of Global Optimization, Springer, vol. 51(4), pages 569-606, December.
    8. Kamil A. Khan & Harry A. J. Watson & Paul I. Barton, 2017. "Differentiable McCormick relaxations," Journal of Global Optimization, Springer, vol. 67(4), pages 687-729, April.
    9. Ambros M. Gleixner & Timo Berthold & Benjamin Müller & Stefan Weltge, 2017. "Three enhancements for optimization-based bound tightening," Journal of Global Optimization, Springer, vol. 67(4), pages 731-757, April.
    10. Dimitrios Nerantzis & Claire S. Adjiman, 2019. "Tighter $$\alpha $$ α BB relaxations through a refinement scheme for the scaled Gerschgorin theorem," Journal of Global Optimization, Springer, vol. 73(3), pages 467-483, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Artur M. Schweidtmann & Alexander Mitsos, 2019. "Deterministic Global Optimization with Artificial Neural Networks Embedded," Journal of Optimization Theory and Applications, Springer, vol. 180(3), pages 925-948, March.
    2. Dominik Bongartz & Alexander Mitsos, 2017. "Deterministic global optimization of process flowsheets in a reduced space using McCormick relaxations," Journal of Global Optimization, Springer, vol. 69(4), pages 761-796, December.
    3. Jason Ye & Joseph K. Scott, 2023. "Extended McCormick relaxation rules for handling empty arguments representing infeasibility," Journal of Global Optimization, Springer, vol. 87(1), pages 57-95, September.
    4. Spencer D. Schaber & Joseph K. Scott & Paul I. Barton, 2019. "Convergence-order analysis for differential-inequalities-based bounds and relaxations of the solutions of ODEs," Journal of Global Optimization, Springer, vol. 73(1), pages 113-151, January.
    5. Matthew E. Wilhelm & Matthew D. Stuber, 2023. "Improved Convex and Concave Relaxations of Composite Bilinear Forms," Journal of Optimization Theory and Applications, Springer, vol. 197(1), pages 174-204, April.
    6. Kamil A. Khan & Harry A. J. Watson & Paul I. Barton, 2017. "Differentiable McCormick relaxations," Journal of Global Optimization, Springer, vol. 67(4), pages 687-729, April.
    7. Matthew E. Wilhelm & Chenyu Wang & Matthew D. Stuber, 2023. "Convex and concave envelopes of artificial neural network activation functions for deterministic global optimization," Journal of Global Optimization, Springer, vol. 85(3), pages 569-594, March.
    8. Jaromił Najman & Alexander Mitsos, 2019. "On tightness and anchoring of McCormick and other relaxations," Journal of Global Optimization, Springer, vol. 74(4), pages 677-703, August.
    9. Rohit Kannan & Paul I. Barton, 2018. "Convergence-order analysis of branch-and-bound algorithms for constrained problems," Journal of Global Optimization, Springer, vol. 71(4), pages 753-813, August.
    10. Jaromił Najman & Dominik Bongartz & Alexander Mitsos, 2021. "Linearization of McCormick relaxations and hybridization with the auxiliary variable method," Journal of Global Optimization, Springer, vol. 80(4), pages 731-756, August.
    11. Watson, Harry A.J. & Vikse, Matias & Gundersen, Truls & Barton, Paul I., 2018. "Optimization of single mixed-refrigerant natural gas liquefaction processes described by nondifferentiable models," Energy, Elsevier, vol. 150(C), pages 860-876.
    12. Ligang Wang & Zhiping Yang & Shivom Sharma & Alberto Mian & Tzu-En Lin & George Tsatsaronis & François Maréchal & Yongping Yang, 2018. "A Review of Evaluation, Optimization and Synthesis of Energy Systems: Methodology and Application to Thermal Power Plants," Energies, MDPI, vol. 12(1), pages 1-53, December.
    13. Rohit Kannan & Paul I. Barton, 2017. "The cluster problem in constrained global optimization," Journal of Global Optimization, Springer, vol. 69(3), pages 629-676, November.
    14. Jaromił Najman & Alexander Mitsos, 2016. "Convergence analysis of multivariate McCormick relaxations," Journal of Global Optimization, Springer, vol. 66(4), pages 597-628, December.
    15. Jaromił Najman & Alexander Mitsos, 2019. "Tighter McCormick relaxations through subgradient propagation," Journal of Global Optimization, Springer, vol. 75(3), pages 565-593, November.
    16. Ni, Yuanming & Steinshamn, Stein I. & Kvamsdal, Sturla F., 2022. "Negative shocks in an age-structured bioeconomic model and how to deal with them," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 15-30.
    17. Duarte, Belmiro P.M. & Sagnol, Guillaume & Wong, Weng Kee, 2018. "An algorithm based on semidefinite programming for finding minimax optimal designs," Computational Statistics & Data Analysis, Elsevier, vol. 119(C), pages 99-117.
    18. Santos, Lucas F. & Costa, Caliane B.B. & Caballero, José A. & Ravagnani, Mauro A.S.S., 2022. "Framework for embedding black-box simulation into mathematical programming via kriging surrogate model applied to natural gas liquefaction process optimization," Applied Energy, Elsevier, vol. 310(C).
    19. Jai Rajyaguru & Mario E. Villanueva & Boris Houska & Benoît Chachuat, 2017. "Chebyshev model arithmetic for factorable functions," Journal of Global Optimization, Springer, vol. 68(2), pages 413-438, June.
    20. Chrysoula D. Kappatou & Dominik Bongartz & Jaromił Najman & Susanne Sass & Alexander Mitsos, 2022. "Global dynamic optimization with Hammerstein–Wiener models embedded," Journal of Global Optimization, Springer, vol. 84(2), pages 321-347, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:86:y:2023:i:3:d:10.1007_s10898-023-01281-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.