IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v40y2011i2p359-372.html
   My bibliography  Save this article

Pitfalls of post-model-selection testing: experimental quantification

Author

Listed:
  • Matei Demetrescu
  • Uwe Hassler
  • Vladimir Kuzin

Abstract

No abstract is available for this item.

Suggested Citation

  • Matei Demetrescu & Uwe Hassler & Vladimir Kuzin, 2011. "Pitfalls of post-model-selection testing: experimental quantification," Empirical Economics, Springer, vol. 40(2), pages 359-372, April.
    • Handle: RePEc:spr:empeco:v:40:y:2011:i:2:p:359-372
    DOI: 10.1007/s00181-009-0334-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00181-009-0334-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00181-009-0334-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Leeb, Hannes & Potscher, Benedikt M., 2008. "Sparse estimators and the oracle property, or the return of Hodges' estimator," Journal of Econometrics, Elsevier, vol. 142(1), pages 201-211, January.
    3. King, M.L. & Giles, D.E.A., 1984. "Autocorrelation pre-testing in the linear model: Estimation, testing and prediction," Journal of Econometrics, Elsevier, vol. 25(1-2), pages 35-48.
    4. Breitung, Jorg & Hassler, Uwe, 2002. "Inference on the cointegration rank in fractionally integrated processes," Journal of Econometrics, Elsevier, vol. 110(2), pages 167-185, October.
    5. Demetrescu, Matei & Kuzin, Vladimir & Hassler, Uwe, 2008. "Long Memory Testing In The Time Domain," Econometric Theory, Cambridge University Press, vol. 24(1), pages 176-215, February.
    6. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    7. Pötscher, Benedikt M. & Schneider, Ulrike, 2008. "Confidence sets based on penalized maximum likelihood estimators," MPRA Paper 9062, University Library of Munich, Germany.
    8. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    9. Lovell, Michael C, 1983. "Data Mining," The Review of Economics and Statistics, MIT Press, vol. 65(1), pages 1-12, February.
    10. Giles, Judith A & Giles, David E A, 1993. "Pre-test Estimation and Testing in Econometrics: Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 7(2), pages 145-197, June.
    11. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(2), pages 426-468, April.
    12. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, May.
    13. Danilov, Dmitry & Magnus, J.R.Jan R., 2004. "On the harm that ignoring pretesting can cause," Journal of Econometrics, Elsevier, vol. 122(1), pages 27-46, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Uwe Hassler & Matei Demetrescu & Adina Tarcolea, 2011. "Asymptotic normal tests for integration in panels with cross-dependent units," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(2), pages 187-204, June.
    2. Uwe Hassler & Paulo M.M. Rodrigues & Antonio Rubia, 2016. "Quantile Regression for Long Memory Testing: A Case of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 14(4), pages 693-724.
    3. Paulo M.M. Rodrigues & Matei Demetrescu, 2018. "Testing the fractionally integrated hypothesis using M estimation: With an application to stock market volatility," Working Papers w201817, Banco de Portugal, Economics and Research Department.
    4. Mense, Andreas & Wirth, Benjamin, 2014. "Flat Prices, Cell Phone Base Stations, and Network Structure: An Instrumental Variable Approach to Endogenous Locations," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100618, Verein für Socialpolitik / German Economic Association.
    5. Hassler, Uwe & Rodrigues, Paulo M.M. & Rubia, Antonio, 2014. "Persistence in the banking industry: Fractional integration and breaks in memory," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 95-112.
    6. Francis J. DiTraglia, 2011. "Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM, Second Version," PIER Working Paper Archive 14-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Dec 2014.
    7. Uwe Hassler & Barbara Meller, 2014. "Detecting multiple breaks in long memory the case of U.S. inflation," Empirical Economics, Springer, vol. 46(2), pages 653-680, March.
    8. Benjamin Wirth & Andreas Mense, 2014. "Flat Prices, Cell Phone Base Stations, and Network Structure," ERSA conference papers ersa14p1552, European Regional Science Association.
    9. Hassler, Uwe, 2010. "Testing regression coefficients after model selection through sign restrictions," Economics Letters, Elsevier, vol. 107(2), pages 220-223, May.
    10. DiTraglia, Francis J., 2016. "Using invalid instruments on purpose: Focused moment selection and averaging for GMM," Journal of Econometrics, Elsevier, vol. 195(2), pages 187-208.
    11. Kruse, Robinson & Wegener, Christoph, 2020. "Time-varying persistence in real oil prices and its determinant," Energy Economics, Elsevier, vol. 85(C).
    12. Deckers, Thomas & Hanck, Christoph, 2009. "Multiple Testing Techniques in Growth Econometrics," MPRA Paper 17843, University Library of Munich, Germany.
    13. Francis DiTraglia, 2011. "Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM, Second Version," PIER Working Paper Archive 15-027, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 10 Aug 2015.
    14. Demetrescu, Matei & Kusin, Vladimir & Salish, Nazarii, 2022. "Testing for no cointegration in vector autoregressions with estimated degree of fractional integration," Economic Modelling, Elsevier, vol. 108(C).
    15. Staszewska-Bystrova, Anna & Winker, Peter, 2013. "Constructing narrowest pathwise bootstrap prediction bands using threshold accepting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 221-233.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    2. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    3. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    4. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2013. "Uniform post selection inference for LAD regression and other z-estimation problems," CeMMAP working papers CWP74/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators," Journal of Econometrics, Elsevier, vol. 152(1), pages 19-27, September.
    6. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    7. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    8. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    9. Danilov, D.L. & Magnus, J.R., 2001. "On the Harm that Pretesting Does," Other publications TiSEM f131c709-4db4-468d-9ae8-9, Tilburg University, School of Economics and Management.
    10. Doko Tchatoka, Firmin & Wang, Wenjie, 2024. "Weak-Identification-Robust Bootstrap Tests after Pretesting for Exogeneity," MPRA Paper 123060, University Library of Munich, Germany.
    11. Leeb, Hannes & Pötscher, Benedikt M. & Ewald, Karl, 2014. "On various confidence intervals post-model-selection," MPRA Paper 52858, University Library of Munich, Germany.
    12. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    13. Uwe Hassler & Barbara Meller, 2014. "Detecting multiple breaks in long memory the case of U.S. inflation," Empirical Economics, Springer, vol. 46(2), pages 653-680, March.
    14. Demetrescu, Matei & Kusin, Vladimir & Salish, Nazarii, 2022. "Testing for no cointegration in vector autoregressions with estimated degree of fractional integration," Economic Modelling, Elsevier, vol. 108(C).
    15. Phillips, Peter C.B., 2005. "Automated Discovery In Econometrics," Econometric Theory, Cambridge University Press, vol. 21(1), pages 3-20, February.
    16. Guggenberger, Patrik, 2010. "The impact of a Hausman pretest on the size of a hypothesis test: The panel data case," Journal of Econometrics, Elsevier, vol. 156(2), pages 337-343, June.
    17. Yang, Haisheng & He, Jie & Chen, Shaoling, 2015. "The fragility of the Environmental Kuznets Curve: Revisiting the hypothesis with Chinese data via an “Extreme Bound Analysis”," Ecological Economics, Elsevier, vol. 109(C), pages 41-58.
    18. Firmin Doko Tchatoka & Wenjie Wang, 2020. "Uniform Inference after Pretesting for Exogeneity," School of Economics and Public Policy Working Papers 2020-05, University of Adelaide, School of Economics and Public Policy.
    19. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    20. Gregory Fletcher Cox, 2024. "A Simple and Adaptive Confidence Interval when Nuisance Parameters Satisfy an Inequality," Papers 2409.09962, arXiv.org.

    More about this item

    Keywords

    Pre-test estimator; Model selection; Empirical size; C12; C51; C52;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:40:y:2011:i:2:p:359-372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.