IDEAS home Printed from https://ideas.repec.org/p/shr/wpaper/14-06.html
   My bibliography  Save this paper

Bootstrap tests in linear models with many regressors

Author

Listed:
  • Patrick Richard

    (Département d'Économique, Université de Sherbrooke)

Abstract

This paper is concerned with bootstrap hypothesis testing in high dimensional linear regression models. Using a theoretical framework recently introduced by Anatolyev (2012), we show that bootstrap F, LR and LM tests are asymptotically valid even when the numbers of estimated parameters and tested restrictions are not asymptotically negligible fractions of the sample size. These results are derived for models with iid error terms, but Monte Carlo evidence suggests that they extend to the wild bootstrap in the presence of heteroskedasticity and to bootstrap methods for heavy tailed data.

Suggested Citation

  • Patrick Richard, 2014. "Bootstrap tests in linear models with many regressors," Cahiers de recherche 14-06, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    • Handle: RePEc:shr:wpaper:14-06
    as

    Download full text from publisher

    File URL: http://gredi.recherche.usherbrooke.ca/wpapers/GREDI-1406.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    2. Koenker, Roger & Machado, Jose A. F., 1999. "GMM inference when the number of moment conditions is large," Journal of Econometrics, Elsevier, vol. 93(2), pages 327-344, December.
    3. Giacomini, Raffaella & Politis, Dimitris N. & White, Halbert, 2013. "A Warp-Speed Method For Conducting Monte Carlo Experiments Involving Bootstrap Estimators," Econometric Theory, Cambridge University Press, vol. 29(3), pages 567-589, June.
    4. Rothenberg, Thomas J., 1984. "Approximating the distributions of econometric estimators and test statistics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 15, pages 881-935, Elsevier.
    5. Anatolyev, Stanislav, 2012. "Inference in regression models with many regressors," Journal of Econometrics, Elsevier, vol. 170(2), pages 368-382.
    6. Davidson, Russell & Flachaire, Emmanuel, 2007. "Asymptotic and bootstrap inference for inequality and poverty measures," Journal of Econometrics, Elsevier, vol. 141(1), pages 141-166, November.
    7. Snigdhansu Chatterjee & Arup Bose, 2002. "Dimension Asymptotics for Generalised Bootstrap in Linear Regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 54(2), pages 367-381, June.
    8. Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
    9. H. Kelejian, Harry & Prucha, Ingmar R., 2001. "On the asymptotic distribution of the Moran I test statistic with applications," Journal of Econometrics, Elsevier, vol. 104(2), pages 219-257, September.
    10. Xiaohong Chen & Norman R. Swanson (ed.), 2013. "Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis," Springer Books, Springer, edition 127, number 978-1-4614-1653-1, January.
    11. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 419-429.
    12. Evans, G B A & Savin, N E, 1982. "Conflict among the Criteria Revisited: The W, LR and LM Tests," Econometrica, Econometric Society, vol. 50(3), pages 737-748, May.
    13. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    14. Chesher, Andrew & Jewitt, Ian, 1987. "The Bias of a Heteroskedasticity Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 55(5), pages 1217-1222, September.
    15. Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
    16. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard, Patrick, 2019. "Residual bootstrap tests in linear models with many regressors," Journal of Econometrics, Elsevier, vol. 208(2), pages 367-394.
    2. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 107420, University Library of Munich, Germany.
    3. Pötscher, Benedikt M. & Preinerstorfer, David, 2023. "How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?," Econometric Theory, Cambridge University Press, vol. 39(4), pages 789-847, August.
    4. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    5. Davidson, Russell & Trokić, Mirza, 2020. "The fast iterated bootstrap," Journal of Econometrics, Elsevier, vol. 218(2), pages 451-475.
    6. Anatolyev, Stanislav, 2012. "Inference in regression models with many regressors," Journal of Econometrics, Elsevier, vol. 170(2), pages 368-382.
    7. Romano, Joseph P. & Wolf, Michael, 2017. "Resurrecting weighted least squares," Journal of Econometrics, Elsevier, vol. 197(1), pages 1-19.
    8. José Murteira & Esmeralda Ramalho & Joaquim Ramalho, 2013. "Heteroskedasticity testing through a comparison of Wald statistics," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 12(2), pages 131-160, August.
    9. Kenneth W. Clements & H. Y. Izan & Yihui Lan, 2009. "A Stochastic Measure of International Competitiveness," International Review of Finance, International Review of Finance Ltd., vol. 9(1‐2), pages 51-81, March.
    10. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    11. Flachaire, Emmanuel, 2005. "Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 361-376, April.
    12. Ou Bianling & Long Zhihe & Li Wenqian, 2019. "Bootstrap LM Tests for Spatial Dependence in Panel Data Models with Fixed Effects," Journal of Systems Science and Information, De Gruyter, vol. 7(4), pages 330-343, August.
    13. Emmanuel Flachaire, 2005. "More Efficient Tests Robust to Heteroskedasticity of Unknown Form," Econometric Reviews, Taylor & Francis Journals, vol. 24(2), pages 219-241.
    14. Sin, C.Y. (Chor-yiu) & Lee, Cheng-Few, 2021. "Using heteroscedasticity-non-consistent or heteroscedasticity-consistent variances in linear regression," Econometrics and Statistics, Elsevier, vol. 18(C), pages 117-142.
    15. Han, Xiaoyi & Lee, Lung-fei, 2013. "Model selection using J-test for the spatial autoregressive model vs. the matrix exponential spatial model," Regional Science and Urban Economics, Elsevier, vol. 43(2), pages 250-271.
    16. Jianghao Chu & Tae-Hwy Lee & Aman Ullah & Haifeng Xu, 2020. "Exact Distribution of the F-statistic under Heteroskedasticity of Unknown Form for Improved Inference," Working Papers 202027, University of California at Riverside, Department of Economics.
    17. Seojeong Lee, 2018. "Asymptotic Refinements of a Misspecification-Robust Bootstrap for Generalized Empirical Likelihood Estimators," Papers 1806.00953, arXiv.org, revised Jun 2018.
    18. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    19. Emmanuel Flachaire, 2005. "Propriétés en échantillon fini des tests robustes à l'hétéroscédasticité de forme inconnue," Annals of Economics and Statistics, GENES, issue 77, pages 187-199.
    20. Joel L. Horowitz, 2018. "Bootstrap Methods in Econometrics," Papers 1809.04016, arXiv.org.

    More about this item

    Keywords

    bootstrap; linear regressions; high dimension.;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:shr:wpaper:14-06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jean-François Rouillard (email available below). General contact details of provider: https://edirc.repec.org/data/deushca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.