IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2015-06.html
   My bibliography  Save this paper

Optimal bounds for aggregation of affine estimators

Author

Listed:
  • Pierre Bellec

    (CREST, ENSAE, UMR CNRS 9194)

Abstract

This paper deals with aggregation of estimators in the context fixed design regression, with heteroscedastic and subgaussian noise. We derive sharp oracle inequalities in deviation for model selection type aggregation of affine estimators when the noise is subgaussian. Explicit numerical constants are given for Gaussian noise and the procedure is robust to variance misspecification. Then we present a new concentration result that is sharper than the Hanson-Wright inequality under the Bernstein condition on the noise. This allows us to improve the sharp oracle inequality obtained in the subgaussian case. Finally, we show that up to numerical constants, the optimal sparsity oracle inequality previously obtained for Gaussian noise holds in the subgaussian case. The exact knowledge of the variance of the noise is not needed to construct the estimator that satisfies the sparsity oracle inequality.

Suggested Citation

  • Pierre Bellec, 2015. "Optimal bounds for aggregation of affine estimators," Working Papers 2015-06, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2015-06
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2015-06.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Axel Munk & Nicolai Bissantz & Thorsten Wagner & Gudrun Freitag, 2005. "On difference‐based variance estimation in nonparametric regression when the covariate is high dimensional," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 19-41, February.
    2. Tingni Sun & Cun-Hui Zhang, 2012. "Scaled sparse linear regression," Biometrika, Biometrika Trust, vol. 99(4), pages 879-898.
    3. H. Dette & A. Munk & T. Wagner, 1998. "Estimating the variance in nonparametric regression—what is a reasonable choice?," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(4), pages 751-764.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Hall & Joel L. Horowitz, 2013. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 29/13, Institute for Fiscal Studies.
    2. Peter Hall & Joel L. Horowitz, 2012. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 14/12, Institute for Fiscal Studies.
    3. Ieva Axt & Roland Fried, 2020. "On variance estimation under shifts in the mean," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(3), pages 417-457, September.
    4. Seunghwan Lee & Sang Cheol Kim & Donghyeon Yu, 2023. "An efficient GPU-parallel coordinate descent algorithm for sparse precision matrix estimation via scaled lasso," Computational Statistics, Springer, vol. 38(1), pages 217-242, March.
    5. Zemin Zheng & Jie Zhang & Yang Li, 2022. "L 0 -Regularized Learning for High-Dimensional Additive Hazards Regression," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2762-2775, September.
    6. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    7. Peter Bühlmann & Jacopo Mandozzi, 2014. "High-dimensional variable screening and bias in subsequent inference, with an empirical comparison," Computational Statistics, Springer, vol. 29(3), pages 407-430, June.
    8. Victor Chernozhukov & Christian Hansen & Yuan Liao, 2015. "A lava attack on the recovery of sums of dense and sparse signals," CeMMAP working papers CWP56/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Zeyu Wu & Cheng Wang & Weidong Liu, 2023. "A unified precision matrix estimation framework via sparse column-wise inverse operator under weak sparsity," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(4), pages 619-648, August.
    10. Luo, Shan & Chen, Zehua, 2014. "Edge detection in sparse Gaussian graphical models," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 138-152.
    11. Alexandre Belloni & Victor Chernozhukov & Lie Wang, 2013. "Pivotal estimation via square-root lasso in nonparametric regression," CeMMAP working papers CWP62/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Anindya Bhadra & Jyotishka Datta & Nicholas G. Polson & Brandon T. Willard, 2020. "Global-Local Mixtures: A Unifying Framework," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 82(2), pages 426-447, August.
    13. Kou Fujimori, 2019. "The Dantzig selector for a linear model of diffusion processes," Statistical Inference for Stochastic Processes, Springer, vol. 22(3), pages 475-498, October.
    14. He, Yong & Zhang, Liang & Ji, Jiadong & Zhang, Xinsheng, 2019. "Robust feature screening for elliptical copula regression model," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 568-582.
    15. Levine, Michael, 2015. "Minimax rate of convergence for an estimator of the functional component in a semiparametric multivariate partially linear model," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 283-290.
    16. Einmahl, J.H.J. & van Keilegom, I., 2004. "Goodness-of-fit Tests in Nonparametric Regression," Discussion Paper 2004-12, Tilburg University, Center for Economic Research.
    17. Sai Li & T. Tony Cai & Hongzhe Li, 2022. "Transfer learning for high‐dimensional linear regression: Prediction, estimation and minimax optimality," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 149-173, February.
    18. Lucas Janson & Rina Foygel Barber & Emmanuel Candès, 2017. "EigenPrism: inference for high dimensional signal-to-noise ratios," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1037-1065, September.
    19. repec:hum:wpaper:sfb649dp2016-033 is not listed on IDEAS
    20. Georgios Sermpinis & Serafeim Tsoukas & Ping Zhang, 2019. "What influences a bank's decision to go public?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 24(4), pages 1464-1485, October.
    21. Alexis Derumigny, 2017. "Improved bounds for Square-Root Lasso and Square-Root Slope," Working Papers 2017-53, Center for Research in Economics and Statistics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2015-06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.