IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v152y2009i1p19-27.html
   My bibliography  Save this article

Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators

Author

Listed:
  • Andrews, Donald W.K.
  • Guggenberger, Patrik

Abstract

Subsampling and the m out of n bootstrap have been suggested in the literature as methods for carrying out inference based on post-model selection estimators and shrinkage estimators. In this paper we consider a subsampling confidence interval (CI) that is based on an estimator that can be viewed either as a post-model selection estimator that employs a consistent model selection procedure or as a super-efficient estimator. We show that the subsampling CI (of nominal level 1-[alpha] for any [alpha][set membership, variant](0,1)) has asymptotic confidence size (defined to be the limit of finite-sample size) equal to zero in a very simple regular model. The same result holds for the m out of n bootstrap provided m2/n-->0 and the observations are i.i.d. Similar zero-asymptotic-confidence-size results hold in more complicated models that are covered by the general results given in the paper and for super-efficient and shrinkage estimators that are not post-model selection estimators. Based on these results, subsampling and the m out of n bootstrap are not recommended for obtaining inference based on post-consistent model selection or shrinkage estimators.

Suggested Citation

  • Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators," Journal of Econometrics, Elsevier, vol. 152(1), pages 19-27, September.
  • Handle: RePEc:eee:econom:v:152:y:2009:i:1:p:19-27
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304-4076(09)00051-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Validity Of Subsampling And “Plug-In Asymptotic” Inference For Parameters Defined By Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 25(3), pages 669-709, June.
    2. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    3. Leeb, Hannes & Pötscher, Benedikt M., 2006. "Performance Limits For Estimators Of The Risk Or Distribution Of Shrinkage-Type Estimators, And Some General Lower Risk-Bound Results," Econometric Theory, Cambridge University Press, vol. 22(1), pages 69-97, February.
    4. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    5. Politis, Dimitris N. & Romano, Joseph P. & Wolf, Michael, 1999. "On the asymptotic theory of subsampling," DES - Working Papers. Statistics and Econometrics. WS 6334, Universidad Carlos III de Madrid. Departamento de Estadística.
    6. Richard Samworth, 2003. "A note on methods of restoring consistency to the bootstrap," Biometrika, Biometrika Trust, vol. 90(4), pages 985-990, December.
    7. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(2), pages 426-468, April.
    8. Pötscher, Benedikt M., 2007. "Confidence Sets Based on Sparse Estimators Are Necessarily Large," MPRA Paper 5677, University Library of Munich, Germany.
    9. Kabaila, Paul, 1995. "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, Cambridge University Press, vol. 11(3), pages 537-549, June.
    10. Patrik Guggenberger, 2008. "The Impact of a Hausman Pretest on the Size of Hypothesis Tests," Cowles Foundation Discussion Papers 1651, Cowles Foundation for Research in Economics, Yale University.
    11. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, May.
    12. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    2. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    3. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    4. Sukjin Han & Adam McCloskey, 2024. "Inference for Interval-Identified Parameters Selected from an Estimated Set," Papers 2403.00422, arXiv.org.
    5. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    6. Farrell, Max H., 2015. "Robust inference on average treatment effects with possibly more covariates than observations," Journal of Econometrics, Elsevier, vol. 189(1), pages 1-23.
    7. Krasnokutskaya, Elena & Song, Kyungchul & Tang, Xun, 2022. "Estimating unobserved individual heterogeneity using pairwise comparisons," Journal of Econometrics, Elsevier, vol. 226(2), pages 477-497.
    8. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    9. Doko Tchatoka, Firmin & Wang, Wenjie, 2020. "Uniform Inference after Pretesting for Exogeneity," MPRA Paper 99243, University Library of Munich, Germany.
    10. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    11. Canepa Alessandra, 2022. "Small Sample Adjustment for Hypotheses Testing on Cointegrating Vectors," Journal of Time Series Econometrics, De Gruyter, vol. 14(1), pages 51-85, January.
    12. Camponovo, Lorenzo & Scaillet, Olivier & Trojani, Fabio, 2012. "Robust subsampling," Journal of Econometrics, Elsevier, vol. 167(1), pages 197-210.
    13. Adrian O’Hagan & Thomas Brendan Murphy & Luca Scrucca & Isobel Claire Gormley, 2019. "Investigation of parameter uncertainty in clustering using a Gaussian mixture model via jackknife, bootstrap and weighted likelihood bootstrap," Computational Statistics, Springer, vol. 34(4), pages 1779-1813, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    2. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    3. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    4. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    5. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," School of Economics and Public Policy Working Papers 2020-05, University of Adelaide, School of Economics and Public Policy.
    6. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    7. Camponovo, Lorenzo & Scaillet, Olivier & Trojani, Fabio, 2012. "Robust subsampling," Journal of Econometrics, Elsevier, vol. 167(1), pages 197-210.
    8. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    9. Matei Demetrescu & Uwe Hassler & Vladimir Kuzin, 2011. "Pitfalls of post-model-selection testing: experimental quantification," Empirical Economics, Springer, vol. 40(2), pages 359-372, April.
    10. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    11. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    12. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    13. Cheng, Xu, 2015. "Robust inference in nonlinear models with mixed identification strength," Journal of Econometrics, Elsevier, vol. 189(1), pages 207-228.
    14. Andrews, Donald W.K. & Guggenberger, Patrik, 2012. "Asymptotics for LS, GLS, and feasible GLS statistics in an AR(1) model with conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 169(2), pages 196-210.
    15. Leeb, Hannes & Potscher, Benedikt M., 2008. "Sparse estimators and the oracle property, or the return of Hodges' estimator," Journal of Econometrics, Elsevier, vol. 142(1), pages 201-211, January.
    16. Pötscher, Benedikt M. & Schneider, Ulrike, 2007. "On the distribution of the adaptive LASSO estimator," MPRA Paper 6913, University Library of Munich, Germany.
    17. Elliott, Graham & Müller, Ulrich K., 2014. "Pre and post break parameter inference," Journal of Econometrics, Elsevier, vol. 180(2), pages 141-157.
    18. Donald W.K. Andrews & Sukjin Han, 2008. "Invalidity of the Bootstrap and the m Out of n Bootstrap for Interval Endpoints Defined by Moment Inequalities," Cowles Foundation Discussion Papers 1671, Cowles Foundation for Research in Economics, Yale University.
    19. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    20. Chunlin Wang & Paul Marriott & Pengfei Li, 2022. "A note on the coverage behaviour of bootstrap percentile confidence intervals for constrained parameters," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(7), pages 809-831, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:152:y:2009:i:1:p:19-27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.