IDEAS home Printed from https://ideas.repec.org/a/spr/coopap/v74y2019i2d10.1007_s10589-019-00111-y.html
   My bibliography  Save this article

Modified inexact Levenberg–Marquardt methods for solving nonlinear least squares problems

Author

Listed:
  • Jifeng Bao

    (Zhejiang Ocean University
    Key Laboratory of Oceanographic Big Data Mining and Application of Zhejiang Province)

  • Carisa Kwok Wai Yu

    (The Hang Seng University of Hong Kong)

  • Jinhua Wang

    (Zhejiang University of Technology
    Hangzhou Normal University)

  • Yaohua Hu

    (Shenzhen University)

  • Jen-Chih Yao

    (China Medical University)

Abstract

In the present paper, we propose a modified inexact Levenberg–Marquardt method (LMM) and its global version by virtue of Armijo, Wolfe or Goldstein line-search schemes to solve nonlinear least squares problems (NLSP), especially for the underdetermined case. Under a local error bound condition, we show that a sequence generated by the modified inexact LMM converges to a solution superlinearly and even quadratically for some special parameters, which improves the corresponding results of the classical inexact LMM in Dan et al. (Optim Methods Softw 17:605–626, 2002). Furthermore, the quadratical convergence of the global version of the modified inexact LMM is also established. Finally, preliminary numerical experiments on some medium/large scale underdetermined NLSP show that our proposed algorithm outperforms the classical inexact LMM.

Suggested Citation

  • Jifeng Bao & Carisa Kwok Wai Yu & Jinhua Wang & Yaohua Hu & Jen-Chih Yao, 2019. "Modified inexact Levenberg–Marquardt methods for solving nonlinear least squares problems," Computational Optimization and Applications, Springer, vol. 74(2), pages 547-582, November.
    • Handle: RePEc:spr:coopap:v:74:y:2019:i:2:d:10.1007_s10589-019-00111-y
    DOI: 10.1007/s10589-019-00111-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10589-019-00111-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10589-019-00111-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lei Guo & Gui-Hua Lin & Jane J. Ye, 2015. "Solving Mathematical Programs with Equilibrium Constraints," Journal of Optimization Theory and Applications, Springer, vol. 166(1), pages 234-256, July.
    2. R. Behling & A. Fischer & M. Herrich & A. Iusem & Y. Ye, 2014. "A Levenberg-Marquardt method with approximate projections," Computational Optimization and Applications, Springer, vol. 59(1), pages 5-26, October.
    3. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, June.
    4. Hu, Yaohua & Yang, Xiaoqi & Sim, Chee-Khian, 2015. "Inexact subgradient methods for quasi-convex optimization problems," European Journal of Operational Research, Elsevier, vol. 240(2), pages 315-327.
    5. Joseph Frédéric Bonnans & Alexander Ioffe, 1995. "Second-order Sufficiency and Quadratic Growth for Nonisolated Minima," Mathematics of Operations Research, INFORMS, vol. 20(4), pages 801-817, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yaohua Hu & Jiawen Li & Carisa Kwok Wai Yu, 2020. "Convergence rates of subgradient methods for quasi-convex optimization problems," Computational Optimization and Applications, Springer, vol. 77(1), pages 183-212, September.
    2. Andreas Fischer & Alexey F. Izmailov & Mikhail V. Solodov, 2024. "The Levenberg–Marquardt method: an overview of modern convergence theories and more," Computational Optimization and Applications, Springer, vol. 89(1), pages 33-67, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shinji Yamada & Akiko Takeda, 2018. "Successive Lagrangian relaxation algorithm for nonconvex quadratic optimization," Journal of Global Optimization, Springer, vol. 71(2), pages 313-339, June.
    2. Regina S. Burachik & Yaohua Hu & Xiaoqi Yang, 2022. "Interior quasi-subgradient method with non-Euclidean distances for constrained quasi-convex optimization problems in hilbert spaces," Journal of Global Optimization, Springer, vol. 83(2), pages 249-271, June.
    3. Yasushi Narushima & Shummin Nakayama & Masashi Takemura & Hiroshi Yabe, 2023. "Memoryless Quasi-Newton Methods Based on the Spectral-Scaling Broyden Family for Riemannian Optimization," Journal of Optimization Theory and Applications, Springer, vol. 197(2), pages 639-664, May.
    4. Saha, Tanay & Rakshit, Suman & Khare, Swanand R., 2023. "Linearly structured quadratic model updating using partial incomplete eigendata," Applied Mathematics and Computation, Elsevier, vol. 446(C).
    5. Guang Li & Paat Rusmevichientong & Huseyin Topaloglu, 2015. "The d -Level Nested Logit Model: Assortment and Price Optimization Problems," Operations Research, INFORMS, vol. 63(2), pages 325-342, April.
    6. Zheng, Sanpeng & Feng, Renzhong, 2023. "A variable projection method for the general radial basis function neural network," Applied Mathematics and Computation, Elsevier, vol. 451(C).
    7. Giorgio, 2019. "On Second-Order Optimality Conditions in Smooth Nonlinear Programming Problems," DEM Working Papers Series 171, University of Pavia, Department of Economics and Management.
    8. Yaohua Hu & Carisa Kwok Wai Yu & Xiaoqi Yang, 2019. "Incremental quasi-subgradient methods for minimizing the sum of quasi-convex functions," Journal of Global Optimization, Springer, vol. 75(4), pages 1003-1028, December.
    9. Jörg Fliege & Andrey Tin & Alain Zemkoho, 2021. "Gauss–Newton-type methods for bilevel optimization," Computational Optimization and Applications, Springer, vol. 78(3), pages 793-824, April.
    10. Fabiana R. Oliveira & Orizon P. Ferreira & Gilson N. Silva, 2019. "Newton’s method with feasible inexact projections for solving constrained generalized equations," Computational Optimization and Applications, Springer, vol. 72(1), pages 159-177, January.
    11. Hai-Jun Wang & Qin Ni, 2010. "A Convex Approximation Method For Large Scale Linear Inequality Constrained Minimization," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 27(01), pages 85-101.
    12. Chen, Liang, 2016. "A high-order modified Levenberg–Marquardt method for systems of nonlinear equations with fourth-order convergence," Applied Mathematics and Computation, Elsevier, vol. 285(C), pages 79-93.
    13. Ji, Li-Qun, 2015. "An assessment of agricultural residue resources for liquid biofuel production in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 561-575.
    14. Babaie-Kafaki, Saman & Ghanbari, Reza, 2014. "The Dai–Liao nonlinear conjugate gradient method with optimal parameter choices," European Journal of Operational Research, Elsevier, vol. 234(3), pages 625-630.
    15. Chungen Shen & Lei-Hong Zhang & Wei Liu, 2016. "A stabilized filter SQP algorithm for nonlinear programming," Journal of Global Optimization, Springer, vol. 65(4), pages 677-708, August.
    16. Marko Miladinović & Predrag Stanimirović & Sladjana Miljković, 2011. "Scalar Correction Method for Solving Large Scale Unconstrained Minimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 151(2), pages 304-320, November.
    17. Wei Bian & Xiaojun Chen, 2017. "Optimality and Complexity for Constrained Optimization Problems with Nonconvex Regularization," Mathematics of Operations Research, INFORMS, vol. 42(4), pages 1063-1084, November.
    18. Yutao Zheng & Bing Zheng, 2017. "Two New Dai–Liao-Type Conjugate Gradient Methods for Unconstrained Optimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 502-509, November.
    19. Chungen Shen & Lei-Hong Zhang & Bo Wang & Wenqiong Shao, 2014. "Global and local convergence of a nonmonotone SQP method for constrained nonlinear optimization," Computational Optimization and Applications, Springer, vol. 59(3), pages 435-473, December.
    20. Xiaojing Zhu & Hiroyuki Sato, 2020. "Riemannian conjugate gradient methods with inverse retraction," Computational Optimization and Applications, Springer, vol. 77(3), pages 779-810, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:coopap:v:74:y:2019:i:2:d:10.1007_s10589-019-00111-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.