IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/1141r.html
   My bibliography  Save this paper

On the Number of Bootstrap Repetitions for Bootstrap Standard Errors, Confidence Intervals, and Tests

Author

Abstract

This paper considers the problem of choosing the number of bootstrap repetitions B for bootstrap standard errors, confidence intervals, and tests. For each of these problems, the paper provides a three-step method for choosing B to achieve a desired level of accuracy. Accuracy is measured by the percentage deviation of the bootstrap standard error estimate, confidence interval endpoint(s), test's critical value, or test's p-value based on B bootstrap simulations from the corresponding ideal bootstrap quantities for which B = infinity. Monte Carlo simulations show that the proposed methods work quite well. The results apply quite generally to parametric, semiparametric, and nonparametric models with independent and dependent data. The results apply to the standard nonparametric iid bootstrap, moving block bootstraps for time series data, parametric and semiparametric bootstraps, and bootstraps for regression models based on bootstrapping residuals.

Suggested Citation

  • Donald W.K. Andrews & Moshe Buchinsky, 1997. "On the Number of Bootstrap Repetitions for Bootstrap Standard Errors, Confidence Intervals, and Tests," Cowles Foundation Discussion Papers 1141R, Cowles Foundation for Research in Economics, Yale University.
    • Handle: RePEc:cwl:cwldpp:1141r
    Note: CFP 1069.
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/files/pub/d11/d1141-r.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    2. Hall, Peter & Martin, Michael A., 1991. "On the error incurred using the bootstrap variance estimate when constructing confidence intervals for quantiles," Journal of Multivariate Analysis, Elsevier, vol. 38(1), pages 70-81, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Econometrics > Econometric Theory > Bootstrap Methods

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
    2. Jafry, Yusuf & Schuermann, Til, 2004. "Measurement, estimation and comparison of credit migration matrices," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2603-2639, November.
    3. Chwila Adam & Żądło Tomasz, 2020. "On the choice of the number of Monte Carlo iterations and bootstrap replicates in Empirical Best Prediction," Statistics in Transition New Series, Statistics Poland, vol. 21(2), pages 35-60, June.
    4. Paul EHLING & Sofia B. RAMOS, 2003. "Geographical versus Industrial Diversification: A Mean Variance Spanning Approach," FAME Research Paper Series rp80, International Center for Financial Asset Management and Engineering.
    5. Giannopoulos, Kostas & Tunaru, Radu, 2005. "Coherent risk measures under filtered historical simulation," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 979-996, April.
    6. Adam Chwila & Tomasz Żądło, 2020. "On the choice of the number of Monte Carlo iterations and bootstrap replicates in Empirical Best Prediction," Statistics in Transition New Series, Polish Statistical Association, vol. 21(2), pages 35-60, June.
    7. de Peretti Christian & Siani Carole, 2004. "Neural Tests for Conditional Heteroskedasticity in ARCH-M Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 8(3), pages 1-24, September.
    8. Hanson, Samuel & Schuermann, Til, 2006. "Confidence intervals for probabilities of default," Journal of Banking & Finance, Elsevier, vol. 30(8), pages 2281-2301, August.
    9. Leonardo Gasparini & Walter Sosa, 2001. "Assessing Aggregate Welfare: Growth and Inequality in Argentina," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 38(113), pages 49-71.
    10. Carole Siani & Christian de Peretti, 2006. "Bootstrapping Neural tests for conditional heteroskedasticity," Computing in Economics and Finance 2006 301, Society for Computational Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    2. Thomas George & Chuan-Yang Hwang & Tavy Ronen, 2010. "Bootstrap refinements in tests of microstructure frictions," Review of Quantitative Finance and Accounting, Springer, vol. 35(1), pages 47-70, July.
    3. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    4. Joachim Inkmann, 2000. "Finite Sample Properties of One-Step, Two-Step and Bootstrap Empirical Likelihood Approaches to Efficient GMM Estimation," Econometric Society World Congress 2000 Contributed Papers 0332, Econometric Society.
    5. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    6. Groneck, Max & Ludwig, Alexander & Zimper, Alexander, 2016. "A life-cycle model with ambiguous survival beliefs," Journal of Economic Theory, Elsevier, vol. 162(C), pages 137-180.
    7. Temel, Tugrul T., 2001. "A Nonparametric Hypothesis Test Via The Bootstrap Resampling," 2001 Annual meeting, August 5-8, Chicago, IL 20600, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    8. Alain Guay, 2020. "Identification of Structural Vector Autoregressions Through Higher Unconditional Moments," Working Papers 20-19, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management.
    9. Frank Kleibergen, 2004. "Expansions of GMM statistics that indicate their properties under weak and/or many instruments and the bootstrap," Econometric Society 2004 North American Summer Meetings 408, Econometric Society.
    10. repec:cep:stiecm:/2014/572 is not listed on IDEAS
    11. Oliver Linton & Pedro Gozalo, 1996. "Conditional Independence Restrictions: Testing and Estimation," Cowles Foundation Discussion Papers 1140, Cowles Foundation for Research in Economics, Yale University.
    12. Badi H. Baltagi & Zhenlin Yang, 2013. "Standardized LM tests for spatial error dependence in linear or panel regressions," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 103-134, February.
    13. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.
    14. Stewart, Mark B., 2011. "Quantile estimates of counterfactual distribution shifts and the impact of minimum wage increases on the wage distribution," Economic Research Papers 270766, University of Warwick - Department of Economics.
    15. Jinyong Hahn & David W. Hughes & Guido Kuersteiner & Whitney K. Newey, 2024. "Efficient bias correction for cross‐section and panel data," Quantitative Economics, Econometric Society, vol. 15(3), pages 783-816, July.
    16. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    17. Nicolas Roys, 2016. "Persistence of Shocks and the Reallocation of Labor," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 22, pages 109-130, October.
    18. Ilaria Piatti & Fabio Trojani, 2020. "Dividend Growth Predictability and the Price–Dividend Ratio," Management Science, INFORMS, vol. 66(1), pages 130-158, January.
    19. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    20. Lô, Serigne N. & Ronchetti, Elvezio, 2012. "Robust small sample accurate inference in moment condition models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3182-3197.
    21. Corradi, Valentina & Swanson, Norman R., 2005. "Bootstrap specification tests for diffusion processes," Journal of Econometrics, Elsevier, vol. 124(1), pages 117-148, January.

    More about this item

    Keywords

    Bootstrap; bootstrap repetitions; coefficient of excess kurtosis; confidence interval; density estimation; hypothesis test; p-value; quantile; simulation; standard error estimate;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:1141r. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.