IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v73y2019i3d10.1007_s10589-019-00096-8.html
   My bibliography  Save this article

Convergence of a stabilized SQP method for equality constrained optimization

Author

Listed:
  • Songqiang Qiu

    (China University of Mining and Technology)

Abstract

We herein present a stabilized sequential programming method for equality constrained programming. The proposed method uses the concepts of proximal point methods and primal-dual regularization. A sequence of regularized problems are approximately solved with the regularization parameter approaching zero. At each iteration, a regularized QP subproblem is solved to obtain a primal-dual search direction. Further, a trust-funnel-like line search scheme is used to globalize the algorithm, and a global convergence under the weak assumption of cone-continuity property is shown. To achieve a fast local convergence, a specially designed second-order correction (SOC) technique is adopted near a solution. Under the second-order sufficient condition and some weak conditions (among which no constraint qualification is involved), the regularized QP subproblem transits to a stabilized QP subproblem in the limit. By possibly combining with the SOC step, the full step will be accepted in the limit and hence the superlinearly local convergence is achieved. Preliminary numerical results are reported, which are encouraging.

Suggested Citation

  • Songqiang Qiu, 2019. "Convergence of a stabilized SQP method for equality constrained optimization," Computational Optimization and Applications, Springer, vol. 73(3), pages 957-996, July.
    • Handle: RePEc:spr:coopap:v:73:y:2019:i:3:d:10.1007_s10589-019-00096-8
    DOI: 10.1007/s10589-019-00096-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-019-00096-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10589-019-00096-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D. Fernández & E. Pilotta & G. Torres, 2013. "An inexact restoration strategy for the globalization of the sSQP method," Computational Optimization and Applications, Springer, vol. 54(3), pages 595-617, April.
    2. R. T. Rockafellar, 1976. "Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming," Mathematics of Operations Research, INFORMS, vol. 1(2), pages 97-116, May.
    3. A. F. Izmailov & E. I. Uskov, 2017. "Subspace-stabilized sequential quadratic programming," Computational Optimization and Applications, Springer, vol. 67(1), pages 129-154, May.
    4. Chungen Shen & Lei-Hong Zhang & Wei Liu, 2016. "A stabilized filter SQP algorithm for nonlinear programming," Journal of Global Optimization, Springer, vol. 65(4), pages 677-708, August.
    5. A. F. Izmailov & M. V. Solodov & E. I. Uskov, 2016. "Globalizing Stabilized Sequential Quadratic Programming Method by Smooth Primal-Dual Exact Penalty Function," Journal of Optimization Theory and Applications, Springer, vol. 169(1), pages 148-178, April.
    6. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, July.
    7. Jacek Gondzio, 2012. "Matrix-free interior point method," Computational Optimization and Applications, Springer, vol. 51(2), pages 457-480, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. F. Izmailov & M. V. Solodov & E. I. Uskov, 2019. "A globally convergent Levenberg–Marquardt method for equality-constrained optimization," Computational Optimization and Applications, Springer, vol. 72(1), pages 215-239, January.
    2. A. F. Izmailov & E. I. Uskov, 2017. "Subspace-stabilized sequential quadratic programming," Computational Optimization and Applications, Springer, vol. 67(1), pages 129-154, May.
    3. Stefano Cipolla & Jacek Gondzio, 2023. "Proximal Stabilized Interior Point Methods and Low-Frequency-Update Preconditioning Techniques," Journal of Optimization Theory and Applications, Springer, vol. 197(3), pages 1061-1103, June.
    4. Jean-Pierre Crouzeix & Abdelhak Hassouni & Eladio Ocaña, 2023. "A Short Note on the Twice Differentiability of the Marginal Function of a Convex Function," Journal of Optimization Theory and Applications, Springer, vol. 198(2), pages 857-867, August.
    5. Yasushi Narushima & Shummin Nakayama & Masashi Takemura & Hiroshi Yabe, 2023. "Memoryless Quasi-Newton Methods Based on the Spectral-Scaling Broyden Family for Riemannian Optimization," Journal of Optimization Theory and Applications, Springer, vol. 197(2), pages 639-664, May.
    6. Saha, Tanay & Rakshit, Suman & Khare, Swanand R., 2023. "Linearly structured quadratic model updating using partial incomplete eigendata," Applied Mathematics and Computation, Elsevier, vol. 446(C).
    7. Bingsheng He & Li-Zhi Liao & Xiang Wang, 2012. "Proximal-like contraction methods for monotone variational inequalities in a unified framework I: Effective quadruplet and primary methods," Computational Optimization and Applications, Springer, vol. 51(2), pages 649-679, March.
    8. Zheng, Sanpeng & Feng, Renzhong, 2023. "A variable projection method for the general radial basis function neural network," Applied Mathematics and Computation, Elsevier, vol. 451(C).
    9. Xiaoming Yuan, 2011. "An improved proximal alternating direction method for monotone variational inequalities with separable structure," Computational Optimization and Applications, Springer, vol. 49(1), pages 17-29, May.
    10. Zhu, Daoli & Marcotte, Patrice, 1995. "Coupling the auxiliary problem principle with descent methods of pseudoconvex programming," European Journal of Operational Research, Elsevier, vol. 83(3), pages 670-685, June.
    11. Hai-Jun Wang & Qin Ni, 2010. "A Convex Approximation Method For Large Scale Linear Inequality Constrained Minimization," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 27(01), pages 85-101.
    12. Guo, Zhaomiao & Fan, Yueyue, 2017. "A Stochastic Multi-Agent Optimization Model for Energy Infrastructure Planning Under Uncertainty and Competition," Institute of Transportation Studies, Working Paper Series qt89s5s8hn, Institute of Transportation Studies, UC Davis.
    13. Chen, Liang, 2016. "A high-order modified Levenberg–Marquardt method for systems of nonlinear equations with fourth-order convergence," Applied Mathematics and Computation, Elsevier, vol. 285(C), pages 79-93.
    14. Ji, Li-Qun, 2015. "An assessment of agricultural residue resources for liquid biofuel production in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 561-575.
    15. Babaie-Kafaki, Saman & Ghanbari, Reza, 2014. "The Dai–Liao nonlinear conjugate gradient method with optimal parameter choices," European Journal of Operational Research, Elsevier, vol. 234(3), pages 625-630.
    16. Stefania Bellavia & Valentina De Simone & Daniela di Serafino & Benedetta Morini, 2016. "On the update of constraint preconditioners for regularized KKT systems," Computational Optimization and Applications, Springer, vol. 65(2), pages 339-360, November.
    17. Yutao Zheng & Bing Zheng, 2017. "Two New Dai–Liao-Type Conjugate Gradient Methods for Unconstrained Optimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 502-509, November.
    18. R. S. Burachik & S. Scheimberg & B. F. Svaiter, 2001. "Robustness of the Hybrid Extragradient Proximal-Point Algorithm," Journal of Optimization Theory and Applications, Springer, vol. 111(1), pages 117-136, October.
    19. A. F. Izmailov & M. V. Solodov, 2022. "Perturbed Augmented Lagrangian Method Framework with Applications to Proximal and Smoothed Variants," Journal of Optimization Theory and Applications, Springer, vol. 193(1), pages 491-522, June.
    20. Xiaojing Zhu & Hiroyuki Sato, 2020. "Riemannian conjugate gradient methods with inverse retraction," Computational Optimization and Applications, Springer, vol. 77(3), pages 779-810, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:73:y:2019:i:3:d:10.1007_s10589-019-00096-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.