IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v170y2016i1d10.1007_s10957-016-0940-z.html
   My bibliography  Save this article

Scaling Damped Limited-Memory Updates for Unconstrained Optimization

Author

Listed:
  • Fahimeh Biglari

    (Urmia University of Technology)

  • Farideh Mahmoodpur

    (Urmia University of Technology)

Abstract

This paper investigates scaling a modified limited-memory algorithm to solve unconstrained optimization problems. The basic idea was to combine the damped techniques for the limited-memory update and the technique of equilibrating the inverse Hessian matrix. Enhanced curvature information about the objective function is stored in the form of a diagonal matrix and plays the dual roles of providing an initial matrix and equilibrating for damped limited-memory iterations. Numerical experiments indicated that the new algorithm is very effective.

Suggested Citation

  • Fahimeh Biglari & Farideh Mahmoodpur, 2016. "Scaling Damped Limited-Memory Updates for Unconstrained Optimization," Journal of Optimization Theory and Applications, Springer, vol. 170(1), pages 177-188, July.
    • Handle: RePEc:spr:joptap:v:170:y:2016:i:1:d:10.1007_s10957-016-0940-z
    DOI: 10.1007/s10957-016-0940-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10957-016-0940-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10957-016-0940-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. Z. Zhang & N. Y. Deng & L. H. Chen, 1999. "New Quasi-Newton Equation and Related Methods for Unconstrained Optimization," Journal of Optimization Theory and Applications, Springer, vol. 102(1), pages 147-167, July.
    2. Shmuel S. Oren, 1974. "Self-Scaling Variable Metric (SSVM) Algorithms," Management Science, INFORMS, vol. 20(5), pages 863-874, January.
    3. Chengxian Xu & Jianzhong Zhang, 2001. "A Survey of Quasi-Newton Equations and Quasi-Newton Methods for Optimization," Annals of Operations Research, Springer, vol. 103(1), pages 213-234, March.
    4. Michael H. Schneider & Stavros A. Zenios, 1990. "A Comparative Study of Algorithms for Matrix Balancing," Operations Research, INFORMS, vol. 38(3), pages 439-455, June.
    5. Shmuel S. Oren & David G. Luenberger, 1974. "Self-Scaling Variable Metric (SSVM) Algorithms," Management Science, INFORMS, vol. 20(5), pages 845-862, January.
    6. Mehiddin Al-Baali & Lucio Grandinetti & Ornella Pisacane, 2014. "Damped Techniques for the Limited Memory BFGS Method for Large-Scale Optimization," Journal of Optimization Theory and Applications, Springer, vol. 161(2), pages 688-699, May.
    7. Biglari, Fahimeh, 2015. "Dynamic scaling on the limited memory BFGS method," European Journal of Operational Research, Elsevier, vol. 243(3), pages 697-702.
    8. Mehiddin Al-Baali & Humaid Khalfan, 2012. "A combined class of self-scaling and modified quasi-Newton methods," Computational Optimization and Applications, Springer, vol. 52(2), pages 393-408, June.
    9. Fahimeh Biglari & Ali Ebadian, 2015. "Limited memory BFGS method based on a high-order tensor model," Computational Optimization and Applications, Springer, vol. 60(2), pages 413-422, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. S. Bojari & M. R. Eslahchi, 2020. "Global convergence of a family of modified BFGS methods under a modified weak-Wolfe–Powell line search for nonconvex functions," 4OR, Springer, vol. 18(2), pages 219-244, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Bojari & M. R. Eslahchi, 2020. "Global convergence of a family of modified BFGS methods under a modified weak-Wolfe–Powell line search for nonconvex functions," 4OR, Springer, vol. 18(2), pages 219-244, June.
    2. C. X. Kou & Y. H. Dai, 2015. "A Modified Self-Scaling Memoryless Broyden–Fletcher–Goldfarb–Shanno Method for Unconstrained Optimization," Journal of Optimization Theory and Applications, Springer, vol. 165(1), pages 209-224, April.
    3. Saman Babaie-Kafaki, 2015. "On Optimality of the Parameters of Self-Scaling Memoryless Quasi-Newton Updating Formulae," Journal of Optimization Theory and Applications, Springer, vol. 167(1), pages 91-101, October.
    4. Nataj, Sarah & Lui, S.H., 2020. "Superlinear convergence of nonlinear conjugate gradient method and scaled memoryless BFGS method based on assumptions about the initial point," Applied Mathematics and Computation, Elsevier, vol. 369(C).
    5. Martin Buhmann & Dirk Siegel, 2021. "Implementing and modifying Broyden class updates for large scale optimization," Computational Optimization and Applications, Springer, vol. 78(1), pages 181-203, January.
    6. M. Al-Baali, 1998. "Numerical Experience with a Class of Self-Scaling Quasi-Newton Algorithms," Journal of Optimization Theory and Applications, Springer, vol. 96(3), pages 533-553, March.
    7. Yong Li & Gonglin Yuan & Zhou Sheng, 2018. "An active-set algorithm for solving large-scale nonsmooth optimization models with box constraints," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-16, January.
    8. Mehiddin Al-Baali & Humaid Khalfan, 2012. "A combined class of self-scaling and modified quasi-Newton methods," Computational Optimization and Applications, Springer, vol. 52(2), pages 393-408, June.
    9. D. Tarzanagh & M. Peyghami, 2015. "A new regularized limited memory BFGS-type method based on modified secant conditions for unconstrained optimization problems," Journal of Global Optimization, Springer, vol. 63(4), pages 709-728, December.
    10. Zhanwen Shi & Guanyu Yang & Yunhai Xiao, 2016. "A limited memory BFGS algorithm for non-convex minimization with applications in matrix largest eigenvalue problem," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(2), pages 243-264, April.
    11. S. Cipolla & C. Di Fiore & P. Zellini, 2020. "A variation of Broyden class methods using Householder adaptive transforms," Computational Optimization and Applications, Springer, vol. 77(2), pages 433-463, November.
    12. Yueting, Yang & Chengxian, Xu, 2007. "A compact limited memory method for large scale unconstrained optimization," European Journal of Operational Research, Elsevier, vol. 180(1), pages 48-56, July.
    13. Saman Babaie-Kafaki & Reza Ghanbari, 2017. "A class of adaptive Dai–Liao conjugate gradient methods based on the scaled memoryless BFGS update," 4OR, Springer, vol. 15(1), pages 85-92, March.
    14. Mingyuan Cao & Qingdao Huang & Chaoqian Li & Yueting Yang, 2020. "A Subspace Modified Broyden–Fletcher–Goldfarb–Shanno Method for $$\mathcal {B}$$B-eigenvalues of Symmetric Tensors," Journal of Optimization Theory and Applications, Springer, vol. 184(2), pages 419-432, February.
    15. Amos Golan & Stephen Vogel, 2000. "Estimation of Non-Stationary Social Accounting Matrix Coefficients with Supply-Side Information," Economic Systems Research, Taylor & Francis Journals, vol. 12(4), pages 447-471.
    16. Siddig, Khalid H.A. & Flaig, Dorothee & Luckmann, Jonas & Grethe, Harald, 2011. "A 2004 Social Accounting Matrix for Israel: Documentation of an Economy-Wide Database with a Focus on Agriculture, the Labour Market, and Income Distribution," Working Papers 110156, Universitaet Hohenheim, Institute of Agricultural Policy and Agricultural Markets.
    17. Kaori Sugiki & Yasushi Narushima & Hiroshi Yabe, 2012. "Globally Convergent Three-Term Conjugate Gradient Methods that Use Secant Conditions and Generate Descent Search Directions for Unconstrained Optimization," Journal of Optimization Theory and Applications, Springer, vol. 153(3), pages 733-757, June.
    18. Dissou, Yazid & Karnizova, Lilia, 2016. "Emissions cap or emissions tax? A multi-sector business cycle analysis," Journal of Environmental Economics and Management, Elsevier, vol. 79(C), pages 169-188.
    19. Babaie-Kafaki, Saman & Ghanbari, Reza, 2014. "The Dai–Liao nonlinear conjugate gradient method with optimal parameter choices," European Journal of Operational Research, Elsevier, vol. 234(3), pages 625-630.
    20. Sherman Robinson & Andrea Cattaneo & Moataz El-Said, 2001. "Updating and Estimating a Social Accounting Matrix Using Cross Entropy Methods," Economic Systems Research, Taylor & Francis Journals, vol. 13(1), pages 47-64.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:170:y:2016:i:1:d:10.1007_s10957-016-0940-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.