IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v86y2023i1d10.1007_s10589-023-00486-z.html
   My bibliography  Save this article

A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

Author

Listed:
  • David Ek

    (KTH Royal Institute of Technology)

  • Anders Forsgren

    (KTH Royal Institute of Technology)

Abstract

The focus in this work is on interior-point methods for inequality-constrained quadratic programs, and particularly on the system of nonlinear equations to be solved for each value of the barrier parameter. Newton iterations give high quality solutions, but we are interested in modified Newton systems that are computationally less expensive at the expense of lower quality solutions. We propose a structured modified Newton approach where each modified Jacobian is composed of a previous Jacobian, plus one low-rank update matrix per succeeding iteration. Each update matrix is, for a given rank, chosen such that the distance to the Jacobian at the current iterate is minimized, in both 2-norm and Frobenius norm. The approach is structured in the sense that it preserves the nonzero pattern of the Jacobian. The choice of update matrix is supported by results in an ideal theoretical setting. We also produce numerical results with a basic interior-point implementation to investigate the practical performance within and beyond the theoretical framework. In order to improve performance beyond the theoretical framework, we also motivate and construct two heuristics to be added to the method.

Suggested Citation

  • David Ek & Anders Forsgren, 2023. "A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming," Computational Optimization and Applications, Springer, vol. 86(1), pages 1-48, September.
    • Handle: RePEc:spr:coopap:v:86:y:2023:i:1:d:10.1007_s10589-023-00486-z
    DOI: 10.1007/s10589-023-00486-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-023-00486-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10589-023-00486-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paul Armand & Joël Benoist & Jean-Pierre Dussault, 2012. "Local path-following property of inexact interior methods in nonlinear programming," Computational Optimization and Applications, Springer, vol. 52(1), pages 209-238, May.
    2. Benedetta Morini & Valeria Simoncini & Mattia Tani, 2017. "A comparison of reduced and unreduced KKT systems arising from interior point methods," Computational Optimization and Applications, Springer, vol. 68(1), pages 1-27, September.
    3. Benedetta Morini & Valeria Simoncini, 2017. "Stability and Accuracy of Inexact Interior Point Methods for Convex Quadratic Programming," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 450-477, November.
    4. S. Bellavia, 1998. "Inexact Interior-Point Method," Journal of Optimization Theory and Applications, Springer, vol. 96(1), pages 109-121, January.
    5. J. Gondzio & F. N. C. Sobral, 2019. "Quasi-Newton approaches to interior point methods for quadratic problems," Computational Optimization and Applications, Springer, vol. 74(1), pages 93-120, September.
    6. David Ek & Anders Forsgren, 2021. "Approximate solution of system of equations arising in interior-point methods for bound-constrained optimization," Computational Optimization and Applications, Springer, vol. 79(1), pages 155-191, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benedetta Morini & Valeria Simoncini, 2017. "Stability and Accuracy of Inexact Interior Point Methods for Convex Quadratic Programming," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 450-477, November.
    2. David Ek & Anders Forsgren, 2021. "Approximate solution of system of equations arising in interior-point methods for bound-constrained optimization," Computational Optimization and Applications, Springer, vol. 79(1), pages 155-191, May.
    3. Stefano Cipolla & Jacek Gondzio, 2023. "Proximal Stabilized Interior Point Methods and Low-Frequency-Update Preconditioning Techniques," Journal of Optimization Theory and Applications, Springer, vol. 197(3), pages 1061-1103, June.
    4. Benedetta Morini & Valeria Simoncini & Mattia Tani, 2017. "A comparison of reduced and unreduced KKT systems arising from interior point methods," Computational Optimization and Applications, Springer, vol. 68(1), pages 1-27, September.
    5. Stefania Bellavia & Valentina De Simone & Daniela di Serafino & Benedetta Morini, 2016. "On the update of constraint preconditioners for regularized KKT systems," Computational Optimization and Applications, Springer, vol. 65(2), pages 339-360, November.
    6. Zhi-Long Dong & Fengmin Xu & Yu-Hong Dai, 2020. "Fast algorithms for sparse portfolio selection considering industries and investment styles," Journal of Global Optimization, Springer, vol. 78(4), pages 763-789, December.
    7. C. Durazzi, 2000. "On the Newton Interior-Point Method for Nonlinear Programming Problems," Journal of Optimization Theory and Applications, Springer, vol. 104(1), pages 73-90, January.
    8. Gondzio, Jacek, 2012. "Interior point methods 25 years later," European Journal of Operational Research, Elsevier, vol. 218(3), pages 587-601.
    9. Paul Armand & Ngoc Nguyen Tran, 2021. "Local Convergence Analysis of a Primal–Dual Method for Bound-Constrained Optimization Without SOSC," Journal of Optimization Theory and Applications, Springer, vol. 189(1), pages 96-116, April.
    10. Dominik Garmatter & Margherita Porcelli & Francesco Rinaldi & Martin Stoll, 2023. "An improved penalty algorithm using model order reduction for MIPDECO problems with partial observations," Computational Optimization and Applications, Springer, vol. 84(1), pages 191-223, January.
    11. Gondzio, Jacek, 2016. "Crash start of interior point methods," European Journal of Operational Research, Elsevier, vol. 255(1), pages 308-314.
    12. Mohammadhossein Mohammadisiahroudi & Ramin Fakhimi & Tamás Terlaky, 2024. "Efficient Use of Quantum Linear System Algorithms in Inexact Infeasible IPMs for Linear Optimization," Journal of Optimization Theory and Applications, Springer, vol. 202(1), pages 146-183, July.
    13. Kirschner, Felix, 2023. "Conic optimization with applications in finance and approximation theory," Other publications TiSEM e9bef4a5-ee46-45be-90d7-9, Tilburg University, School of Economics and Management.
    14. G. Al-Jeiroudi & J. Gondzio, 2009. "Convergence Analysis of the Inexact Infeasible Interior-Point Method for Linear Optimization," Journal of Optimization Theory and Applications, Springer, vol. 141(2), pages 231-247, May.
    15. Paul Armand & Joël Benoist & Jean-Pierre Dussault, 2012. "Local path-following property of inexact interior methods in nonlinear programming," Computational Optimization and Applications, Springer, vol. 52(1), pages 209-238, May.
    16. C. Durazzi & V. Ruggiero & G. Zanghirati, 2001. "Parallel Interior-Point Method for Linear and Quadratic Programs with Special Structure," Journal of Optimization Theory and Applications, Springer, vol. 110(2), pages 289-313, August.
    17. J. Gondzio & F. N. C. Sobral, 2019. "Quasi-Newton approaches to interior point methods for quadratic problems," Computational Optimization and Applications, Springer, vol. 74(1), pages 93-120, September.
    18. Md Sarowar Morshed & Md Saiful Islam & Md. Noor-E-Alam, 2020. "Accelerated sampling Kaczmarz Motzkin algorithm for the linear feasibility problem," Journal of Global Optimization, Springer, vol. 77(2), pages 361-382, June.
    19. Jacek Gondzio, 2012. "Matrix-free interior point method," Computational Optimization and Applications, Springer, vol. 51(2), pages 457-480, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:86:y:2023:i:1:d:10.1007_s10589-023-00486-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.