IDEAS home Printed from https://ideas.repec.org/p/ags/queddp/273372.html
   My bibliography  Save this paper

The Power of Bootstrap Tests

Author

Listed:
  • Davidson, Russell
  • MacKinnon, James G.

Abstract

Bootstrap tests are tests for which the signicance level is calculated using some variant of the bootstrap which may be parametric or nonparametric We show that the power of a bootstrap test will generally be very close to the power of the asymptotic test on which it is based provided that both tests are properly adjusted to have the correct size We also discuss the loss of power that can occur when the number of bootstrap samples is relatively small Some Monte Carlo results for two forms of omitted variable test in logit models are presented These illustrate the theoretical results of the paper and demonstrate that the sizeadjusted power of asymptotic tests can vary greatly depending on the method used for size adjustment

Suggested Citation

  • Davidson, Russell & MacKinnon, James G., 1996. "The Power of Bootstrap Tests," Queen's Institute for Economic Research Discussion Papers 273372, Queen's University - Department of Economics.
    • Handle: RePEc:ags:queddp:273372
    DOI: 10.22004/ag.econ.273372
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/273372/files/qed_wp_937.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.273372?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. F. H. C. Marriott, 1979. "Barnard's Monte Carlo Tests: How Many Simulations?," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 28(1), pages 75-77, March.
    2. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    3. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    4. Horowitz, Joel L., 1994. "Bootstrap-based critical values for the information matrix test," Journal of Econometrics, Elsevier, vol. 61(2), pages 395-411, April.
    5. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    6. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    7. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    8. Davidson, Russell & MacKinnon, James G., 1984. "Convenient specification tests for logit and probit models," Journal of Econometrics, Elsevier, vol. 25(3), pages 241-262, July.
    9. Horowitz, J. L., 1995. "Bootstrap Methods In Econometrics: Theory And Numerical Performance," SFB 373 Discussion Papers 1995,63, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    10. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andersson, Michael K. & Gredenhoff, Mikael P., 1998. "Robust Testing for Fractional Integration Using the Bootstrap," SSE/EFI Working Paper Series in Economics and Finance 218, Stockholm School of Economics.
    2. Flachaire, Emmanuel, 1999. "A better way to bootstrap pairs," Economics Letters, Elsevier, vol. 64(3), pages 257-262, September.
    3. Alessandra Canepa & Raymond O'Brien, 2000. "The Size and Power of Bootstrap Tests for Linear Restrictions in Misspecified Cointegrating Relationships," Econometric Society World Congress 2000 Contributed Papers 1807, Econometric Society.
    4. L. G. Godfrey & C. D. Orme, 1999. "The robustness, reliabiligy and power of heteroskedasticity tests," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 169-194.
    5. Coakley, Jerry & Fuertes, Ana-Maria, 2006. "Testing for sign and amplitude asymmetries using threshold autoregressions," Journal of Economic Dynamics and Control, Elsevier, vol. 30(4), pages 623-654, April.
    6. Michael K. Andersson & Sune Karlsson, 2001. "Bootstrapping Error Component Models," Computational Statistics, Springer, vol. 16(2), pages 221-231, July.
    7. Harris, R. I. D. & Judge, G., 1998. "Small sample testing for cointegration using the bootstrap approach," Economics Letters, Elsevier, vol. 58(1), pages 31-37, January.
    8. Tor Jacobson & Johan Lyhagen & Rolf Larsson & Marianne Nessén, 2008. "Inflation, exchange rates and PPP in a multivariate panel cointegration model," Econometrics Journal, Royal Economic Society, vol. 11(1), pages 58-79, March.
    9. Christian Peretti, 2007. "Long Memory and Hysteresis," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 363-389, Springer.
    10. Andersson, Michael K. & Gredenhoff, Mikael P., 1997. "Bootstrap Testing for Fractional Integration," SSE/EFI Working Paper Series in Economics and Finance 188, Stockholm School of Economics.
    11. Ramses H. Abul Naga & Christopher Stapenhurst & Gaston Yalonetzky, 2024. "Inferring inequality: Testing for median-preserving spreads in ordinal data," Econometric Reviews, Taylor & Francis Journals, vol. 43(2-4), pages 156-174, April.
    12. Jeong, Jinook & Chung, Seoung, 2001. "Bootstrap tests for autocorrelation," Computational Statistics & Data Analysis, Elsevier, vol. 38(1), pages 49-69, November.
    13. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    14. Pinkse, Joris & Slade, Margaret E., 1998. "Contracting in space: An application of spatial statistics to discrete-choice models," Journal of Econometrics, Elsevier, vol. 85(1), pages 125-154, July.
    15. Siani, Carole & de Peretti, Christian, 2007. "Analysing the performance of bootstrap neural tests for conditional heteroskedasticity in ARCH-M models," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2442-2460, February.
    16. Christian de Peretti, 2003. "Bilateral Bootstrap Tests for Long Memory: An Application to the Silver Market," Computational Economics, Springer;Society for Computational Economics, vol. 22(2), pages 187-212, October.
    17. Li, Hongyi & Xiao, Zhijie, 2000. "On bootstrapping regressions with unit root processes," Statistics & Probability Letters, Elsevier, vol. 48(3), pages 261-267, July.
    18. Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
    19. Dirk Hoorelbeke, 2004. "Bootstrap correcting the score test," Econometric Society 2004 North American Summer Meetings 228, Econometric Society.
    20. Monfardini, Chiara, 2003. "An illustration of Cox's non-nested testing procedure for logit and probit models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 425-444, March.
    21. Beck, Tobias, 2021. "How the honesty oath works: Quick, intuitive truth telling under oath," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davidson, Russell & MacKinnon, James G., 1997. "Bootstrap Testing How Many Bootstraps," Queen's Institute for Economic Research Discussion Papers 273385, Queen's University - Department of Economics.
    2. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    3. Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
    4. Joel L. Horowitz, 2018. "Bootstrap Methods in Econometrics," Papers 1809.04016, arXiv.org.
    5. Bergström, Pål, 1999. "Bootstrap Methods and Applications in Econometrics - A Brief Survey," Working Paper Series 1999:2, Uppsala University, Department of Economics.
    6. Yang, Zhenlin, 2015. "LM tests of spatial dependence based on bootstrap critical values," Journal of Econometrics, Elsevier, vol. 185(1), pages 33-59.
    7. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    8. Ilaria Piatti & Fabio Trojani, 2020. "Dividend Growth Predictability and the Price–Dividend Ratio," Management Science, INFORMS, vol. 66(1), pages 130-158, January.
    9. Yazid Dissou & Reza Ghazal, 2010. "Energy Substitutability in Canadian Manufacturing Econometric Estimation with Bootstrap Confidence Intervals," The Energy Journal, , vol. 31(1), pages 121-148, January.
    10. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    11. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    12. Wolfgang Härdle & Joel Horowitz & Jens‐Peter Kreiss, 2003. "Bootstrap Methods for Time Series," International Statistical Review, International Statistical Institute, vol. 71(2), pages 435-459, August.
    13. George Kapetanios, 2005. "Tests for Deterministic Parametric Structural Change in Regression Models," Working Papers 539, Queen Mary University of London, School of Economics and Finance.
    14. Christian de Peretti, 2003. "Bilateral Bootstrap Tests for Long Memory: An Application to the Silver Market," Computational Economics, Springer;Society for Computational Economics, vol. 22(2), pages 187-212, October.
    15. Zhenlin Yang, 2018. "Bootstrap LM tests for higher-order spatial effects in spatial linear regression models," Empirical Economics, Springer, vol. 55(1), pages 35-68, August.
    16. James G. MacKinnon & Russell Davidson, 2000. "Improving The Reliability Of Bootstrap Tests," Working Paper 995, Economics Department, Queen's University.
    17. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    18. Davidson, Russell & Flachaire, Emmanuel, 2007. "Asymptotic and bootstrap inference for inequality and poverty measures," Journal of Econometrics, Elsevier, vol. 141(1), pages 141-166, November.
    19. Groneck, Max & Ludwig, Alexander & Zimper, Alexander, 2016. "A life-cycle model with ambiguous survival beliefs," Journal of Economic Theory, Elsevier, vol. 162(C), pages 137-180.
    20. Christian Peretti, 2007. "Long Memory and Hysteresis," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 363-389, Springer.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:queddp:273372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.