IDEAS home Printed from https://ideas.repec.org/p/bro/econwp/2012-16.html
   My bibliography  Save this paper

Bonferroni-Based Size-Correction for Nonstandard Testing Problems

Author

Abstract

We develop powerful new size-correction procedures for nonstandard hypothesis testing environments in which the asymptotic distribution of a test statistic is discontinuous in a parameter under the null hypothesis. Examples of this form of testing problem are pervasive in econometrics and complicate inference by making size di- cult to control. This paper introduces two sets of new size-correction methods that correspond to two di erent general hypothesis testing frameworks. The new methods are designed to maximize the power of the underlying test while maintaining correct asymptotic size uniformly over the parameter space speci ed by the null hypothesis. They involve the construction of critical values that make use of reasoning derived from Bonferroni bounds. The rst set of new methods provides complementary alternatives to existing size-correction methods, entailing substantially higher power for many testing problems. The second set of new methods provides the rst available asymptotically size-correct tests for the general class of testing problems to which it applies. This class includes hypothesis tests on parameters after consistent model selection and tests on super-ecient/hard-thresholding estimators. We detail the construction and performance of the new tests in three speci c examples: testing after conservative model selection, testing when a nuisance parameter may be on a boundary and testing after consistent model selection.

Suggested Citation

  • Adam McCloskey, 2012. "Bonferroni-Based Size-Correction for Nonstandard Testing Problems," Working Papers 2012-16, Brown University, Department of Economics.
  • Handle: RePEc:bro:econwp:2012-16
    as

    Download full text from publisher

    File URL: https://economics.brown.edu/sites/g/files/dprerj726/files/papers/2012-16_paper.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bruce E. Hansen, 1999. "The Grid Bootstrap And The Autoregressive Model," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 594-607, November.
    2. Massimo Franchi & Søren Johansen, 2017. "Improved Inference on Cointegrating Vectors in the Presence of a near Unit Root Using Adjusted Quantiles," Econometrics, MDPI, vol. 5(2), pages 1-20, June.
    3. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    4. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    5. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    6. Leeb, Hannes & Pötscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(2), pages 338-376, April.
    7. Chaudhuri, Saraswata & Zivot, Eric, 2011. "A new method of projection-based inference in GMM with weakly identified nuisance parameters," Journal of Econometrics, Elsevier, vol. 164(2), pages 239-251, October.
    8. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    9. Andrews, Donald W K, 2001. "Testing When a Parameter Is on the Boundary of the Maintained Hypothesis," Econometrica, Econometric Society, vol. 69(3), pages 683-734, May.
    10. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    11. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82(5), pages 1979-2002, September.
    12. Pötscher, Benedikt M. & Schneider, Ulrike, 2008. "Confidence sets based on penalized maximum likelihood estimators," MPRA Paper 9062, University Library of Munich, Germany.
    13. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    14. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    15. Nelson, Charles R & Startz, Richard, 1990. "Some Further Results on the Exact Small Sample Properties of the Instrumental Variable Estimator," Econometrica, Econometric Society, vol. 58(4), pages 967-976, July.
    16. Kabaila, Paul, 1998. "Valid Confidence Intervals In Regression After Variable Selection," Econometric Theory, Cambridge University Press, vol. 14(4), pages 463-482, August.
    17. Elliott, Graham & Stock, James H., 1994. "Inference in Time Series Regression When the Order of Integration of a Regressor is Unknown," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 672-700, August.
    18. Graham Elliott & Ulrich K. Müller & Mark W. Watson, 2015. "Nearly Optimal Tests When a Nuisance Parameter Is Present Under the Null Hypothesis," Econometrica, Econometric Society, vol. 83, pages 771-811, March.
    19. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    20. Stock, James H., 1991. "Confidence intervals for the largest autoregressive root in U.S. macroeconomic time series," Journal of Monetary Economics, Elsevier, vol. 28(3), pages 435-459, December.
    21. Elliott, Graham & Müller, Ulrich K., 2014. "Pre and post break parameter inference," Journal of Econometrics, Elsevier, vol. 180(2), pages 141-157.
    22. Cheng, Xu, 2015. "Robust inference in nonlinear models with mixed identification strength," Journal of Econometrics, Elsevier, vol. 189(1), pages 207-228.
    23. Pötscher, Benedikt M. & Leeb, Hannes, 2009. "On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2065-2082, October.
    24. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    25. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    26. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    27. Guggenberger, Patrik, 2010. "The Impact Of A Hausman Pretest On The Asymptotic Size Of A Hypothesis Test," Econometric Theory, Cambridge University Press, vol. 26(2), pages 369-382, April.
    28. Leeb, Hannes & Pötscher, Benedikt M., 2012. "Testing in the Presence of Nuisance Parameters: Some Comments on Tests Post-Model-Selection and Random Critical Values," MPRA Paper 41459, University Library of Munich, Germany.
    29. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, May.
    30. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    31. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Validity Of Subsampling And “Plug-In Asymptotic” Inference For Parameters Defined By Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 25(3), pages 669-709, June.
    32. Hansen, Bruce E., 2016. "Efficient shrinkage in parametric models," Journal of Econometrics, Elsevier, vol. 190(1), pages 115-132.
    33. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    34. Hannes Leeb, 2006. "The distribution of a linear predictor after model selection: Unconditional finite-sample distributions and asymptotic approximations," Papers math/0611186, arXiv.org.
    35. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    36. Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, September.
    37. Xiaoxia Shi, 2015. "A nondegenerate Vuong test," Quantitative Economics, Econometric Society, vol. 6(1), pages 85-121, March.
    38. Frank Kleibergen, 2002. "Pivotal Statistics for Testing Structural Parameters in Instrumental Variables Regression," Econometrica, Econometric Society, vol. 70(5), pages 1781-1803, September.
    39. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    40. Graham Elliott, 1998. "On the Robustness of Cointegration Methods when Regressors Almost Have Unit Roots," Econometrica, Econometric Society, vol. 66(1), pages 149-158, January.
    41. Patrik Guggenberger & Frank Kleibergen & Sophocles Mavroeidis & Linchun Chen, 2012. "On the Asymptotic Sizes of Subset Anderson–Rubin and Lagrange Multiplier Tests in Linear Instrumental Variables Regression," Econometrica, Econometric Society, vol. 80(6), pages 2649-2666, November.
    42. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(1), pages 60-68, February.
    43. Peter C. B. Phillips, 2014. "On Confidence Intervals for Autoregressive Roots and Predictive Regression," Econometrica, Econometric Society, vol. 82(3), pages 1177-1195, May.
    44. Bruce E. Hansen, 2014. "Model averaging, asymptotic risk, and regressor groups," Quantitative Economics, Econometric Society, vol. 5(3), pages 495-530, November.
    45. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    46. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
    47. Sukjin Han & Adam McCloskey, 2019. "Estimation and inference with a (nearly) singular Jacobian," Quantitative Economics, Econometric Society, vol. 10(3), pages 1019-1068, July.
    48. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    49. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(2), pages 426-468, April.
    50. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators," Journal of Econometrics, Elsevier, vol. 152(1), pages 19-27, September.
    51. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    2. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    3. Cheng, Xu, 2015. "Robust inference in nonlinear models with mixed identification strength," Journal of Econometrics, Elsevier, vol. 189(1), pages 207-228.
    4. Gregory Fletcher Cox, 2024. "A Simple and Adaptive Confidence Interval when Nuisance Parameters Satisfy an Inequality," Papers 2409.09962, arXiv.org.
    5. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    6. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," School of Economics and Public Policy Working Papers 2020-05, University of Adelaide, School of Economics and Public Policy.
    7. Xu Cheng, 2014. "Uniform Inference in Nonlinear Models with Mixed Identification Strength," PIER Working Paper Archive 14-018, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    8. Tetsuya Kaji, 2019. "Theory of Weak Identification in Semiparametric Models," Papers 1908.10478, arXiv.org, revised Aug 2020.
    9. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    10. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    11. Fan, Yanqin & Shi, Xuetao, 2023. "Wald, QLR, and score tests when parameters are subject to linear inequality constraints," Journal of Econometrics, Elsevier, vol. 235(2), pages 2005-2026.
    12. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    13. Gregory Cox, 2020. "Weak Identification with Bounds in a Class of Minimum Distance Models," Papers 2012.11222, arXiv.org, revised Dec 2022.
    14. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "Applications of subsampling, hybrid, and size-correction methods," Journal of Econometrics, Elsevier, vol. 158(2), pages 285-305, October.
    15. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    16. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    17. Andrews, Donald W.K. & Cheng, Xu, 2014. "Gmm Estimation And Uniform Subvector Inference With Possible Identification Failure," Econometric Theory, Cambridge University Press, vol. 30(2), pages 287-333, April.
    18. Mikusheva, Anna, 2013. "Survey on statistical inferences in weakly-identified instrumental variable models," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 29(1), pages 117-131.
    19. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    20. Donald W.K. Andrews & Patrik Guggenberger, 2007. "Hybrid and Size-Corrected Subsample Methods," Cowles Foundation Discussion Papers 1606, Cowles Foundation for Research in Economics, Yale University.
    21. Chen, Heng & Fan, Yanqin & Liu, Ruixuan, 2016. "Inference for the correlation coefficient between potential outcomes in the Gaussian switching regime model," Journal of Econometrics, Elsevier, vol. 195(2), pages 255-270.

    More about this item

    Keywords

    Hypothesis testing; uniform inference; asymptotic size; exact size; power; size-correction; model selection; boundary problems; local asymptotics;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bro:econwp:2012-16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brown Economics Webmaster (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.