IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v37y2010i3p477-495.html
   My bibliography  Save this article

Weak Convergence of the Regularization Path in Penalized M‐Estimation

Author

Listed:
  • JEAN‐FRANCOIS GERMAIN
  • FRANCOIS ROUEFF

Abstract

. We consider a function defined as the pointwise minimization of a doubly index random process. We are interested in the weak convergence of the minimizer in the space of bounded functions. Such convergence results can be applied in the context of penalized M‐estimation, that is, when the random process to minimize is expressed as a goodness‐of‐fit term plus a penalty term multiplied by a penalty weight. This weight is called the regularization parameter and the minimizing function the regularization path. The regularization path can be seen as a collection of estimators indexed by the regularization parameter. We obtain a consistency result and a central limit theorem for the regularization path in a functional sense. Various examples are provided, including the ℓ1‐regularization path for general linear models, the ℓ1‐ or ℓ2‐regularization path of the least absolute deviation regression and the Akaike information criterion.

Suggested Citation

  • Jean‐Francois Germain & Francois Roueff, 2010. "Weak Convergence of the Regularization Path in Penalized M‐Estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(3), pages 477-495, September.
  • Handle: RePEc:bla:scjsta:v:37:y:2010:i:3:p:477-495
    DOI: 10.1111/j.1467-9469.2009.00682.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9469.2009.00682.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9469.2009.00682.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(3), pages 295-313, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ban Zheng & Eric Moulines & Fr'ed'eric Abergel, 2012. "Price Jump Prediction in Limit Order Book," Papers 1204.1381, arXiv.org.
    2. repec:hal:wpaper:hal-00684716 is not listed on IDEAS
    3. Ban Zheng & Eric Moulines & Frédéric Abergel, 2013. "Price jump prediction in a limit order book," Post-Print hal-00684716, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    2. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    3. Xiaohong Chen & Roger Koenker & Zhijie Xiao, 2009. "Copula-based nonlinear quantile autoregression," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 50-67, January.
    4. Salim Bouzebda & Issam Elhattab & Anouar Abdeldjaoued Ferfache, 2022. "General M-Estimator Processes and their m out of n Bootstrap with Functional Nuisance Parameters," Methodology and Computing in Applied Probability, Springer, vol. 24(4), pages 2961-3005, December.
    5. Andrews, Donald W K, 2001. "Testing When a Parameter Is on the Boundary of the Maintained Hypothesis," Econometrica, Econometric Society, vol. 69(3), pages 683-734, May.
    6. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    7. Komunjer, Ivana, 2005. "Quasi-maximum likelihood estimation for conditional quantiles," Journal of Econometrics, Elsevier, vol. 128(1), pages 137-164, September.
    8. Kristi Kuljus & Bo Ranneby, 2020. "Asymptotic normality of generalized maximum spacing estimators for multivariate observations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(3), pages 968-989, September.
    9. Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, September.
    10. Subbotin, Viktor, 2007. "Asymptotic and bootstrap properties of rank regressions," MPRA Paper 9030, University Library of Munich, Germany, revised 20 Mar 2008.
    11. Zhu, Ke & Ling, Shiqing, 2013. "Global self-weighted and local quasi-maximum exponential likelihood estimators for ARMA-GARCH/IGARCH models," MPRA Paper 51509, University Library of Munich, Germany.
    12. Edvard Bakhitov, 2020. "Frequentist Shrinkage under Inequality Constraints," Papers 2001.10586, arXiv.org.
    13. Otávio Bartalotti, 2013. "GMM Efficiency and IPW Estimation for Nonsmooth Functions," Working Papers 1301, Tulane University, Department of Economics.
    14. Minxian Yang, 2014. "Normality of Posterior Distribution Under Misspecification and Nonsmoothness, and Bayes Factor for Davies' Problem," Econometric Reviews, Taylor & Francis Journals, vol. 33(1-4), pages 305-336, June.
    15. Ketz, Philipp, 2018. "Subvector inference when the true parameter vector may be near or at the boundary," Journal of Econometrics, Elsevier, vol. 207(2), pages 285-306.
    16. Jungsik Noh & Sangyeol Lee, 2016. "Quantile Regression for Location-Scale Time Series Models with Conditional Heteroscedasticity," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(3), pages 700-720, September.
    17. Sakata, Shinichi, 2007. "Instrumental variable estimation based on conditional median restriction," Journal of Econometrics, Elsevier, vol. 141(2), pages 350-382, December.
    18. Rebafka Tabea & Roueff François & Souloumiac Antoine, 2010. "A Corrected Likelihood Approach for the Nonlinear Transformation Model with Application to Fluorescence Lifetime Measurements Using Exponential Mixtures," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-34, March.
    19. Tae-Hwan Kim & Halbert White, 2003. "Estimation, Inference, And Specification Testing For Possibly Misspecified Quantile Regression," Advances in Econometrics, in: Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later, pages 107-132, Emerald Group Publishing Limited.
    20. Xiaohong Chen & Zhijie Xiao & Bo Wang, 2020. "Copula-Based Time Series With Filtered Nonstationarity," Cowles Foundation Discussion Papers 2242R, Cowles Foundation for Research in Economics, Yale University, revised Oct 2020.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:37:y:2010:i:3:p:477-495. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.