IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/1999-04.html
   My bibliography  Save this paper

On the finite-sample accuracy of nonparametric resampling algorithms for economic time series

Author

Listed:
  • Jeremy Berkowitz
  • Ionel Birgean
  • Lutz Kilian

Abstract

In recent years, there has been increasing interest in nonparametric bootstrap inference for economic time series. Nonparametric resampling techniques help protect against overly optimistic inference in time series models of unknown structure. They are particularly useful for evaluating the fit of dynamic economic models in terms of their spectra, impulse responses, and related statistics, because they do not require a correctly specified economic model. Notwithstanding the potential advantages of nonparametric bootstrap methods, their reliability in small samples is questionable. In this paper, we provide a benchmark for the relative accuracy of several nonparametric resampling algorithms based on ARMA representations of four macroeconomic time series. For each algorithm, we evaluate the effective coverage accuracy of impulse response and spectral density bootstrap confidence intervals for standard sample sizes. We find that the autoregressive sieve approach based on the encompassing model is most accurate. However, care must be exercised in selecting the lag order of the autoregressive approximation.

Suggested Citation

  • Jeremy Berkowitz & Ionel Birgean & Lutz Kilian, 1999. "On the finite-sample accuracy of nonparametric resampling algorithms for economic time series," Finance and Economics Discussion Series 1999-04, Board of Governors of the Federal Reserve System (U.S.).
  • Handle: RePEc:fip:fedgfe:1999-04
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/feds/1999/199904/199904abs.html
    Download Restriction: no

    File URL: http://www.federalreserve.gov/pubs/feds/1999/199904/199904pap.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kilian, L., 1998. "Pitfalls in Constructing Bootstrap Confidence Intervals for Asymptotically Pivotal Statistics," Papers 98-04, Michigan - Center for Research on Economic & Social Theory.
    2. Ionel Birgean & Lutz Kilian, 2002. "Data-Driven Nonparametric Spectral Density Estimators For Economic Time Series: A Monte Carlo Study," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 449-476.
    3. Atsushi Inoue & Lutz Kilian, 2002. "Bootstrapping Smooth Functions of Slope Parameters and Innovation Variances in VAR (∞) Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 43(2), pages 309-332, May.
    4. Hirotugu Akaike, 1969. "Power spectrum estimation through autoregressive model fitting," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 407-419, December.
    5. Francis X. Diebold & Lutz Kilian, 2001. "Measuring predictability: theory and macroeconomic applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(6), pages 657-669.
    6. Cogley, Timothy & Nason, James M, 1995. "Output Dynamics in Real-Business-Cycle Models," American Economic Review, American Economic Association, vol. 85(3), pages 492-511, June.
    7. Francis X. Diebold & Lee E. Ohanian & Jeremy Berkowitz, 1998. "Dynamic Equilibrium Economies: A Framework for Comparing Models and Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 433-451.
    8. King, Robert G & Watson, Mark W, 1996. "Money, Prices, Interest Rates and the Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 35-53, February.
    9. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    10. Julio J. Rotemberg & Michael Woodford, 1997. "An Optimization-Based Econometric Framework for the Evaluation of Monetary Policy," NBER Chapters, in: NBER Macroeconomics Annual 1997, Volume 12, pages 297-361, National Bureau of Economic Research, Inc.
    11. Lawrence J. Christiano & Martin S. Eichenbaum & Charles L. Evans, 1997. "Modeling money," Working Paper Series, Macroeconomic Issues WP-97-17, Federal Reserve Bank of Chicago.
    12. Diebold, F.X. & Kilian, L. & Nerlove, Marc, 2006. "Time Series Analysis," Working Papers 28556, University of Maryland, Department of Agricultural and Resource Economics.
    13. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    14. Kilian, Lutz, 2001. "Impulse Response Analysis in Vector Autoregressions with Unknown Lag Order," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(3), pages 161-179, April.
    15. Bühlmann, Peter, 1995. "The blockwise bootstrap for general empirical processes of stationary sequences," Stochastic Processes and their Applications, Elsevier, vol. 58(2), pages 247-265, August.
    16. Julio J. Rotemberg & Michael Woodford, 1998. "An Optimization-Based Econometric Framework for the Evaluation of Monetary Policy: Expanded Version," NBER Technical Working Papers 0233, National Bureau of Economic Research, Inc.
    17. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    18. Li, Hongyi & Maddala, G. S., 1997. "Bootstrapping cointegrating regressions," Journal of Econometrics, Elsevier, vol. 80(2), pages 297-318, October.
    19. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    20. Paparoditis, Efstathios, 1996. "Bootstrapping Autoregressive and Moving Average Parameter Estimates of Infinite Order Vector Autoregressive Processes," Journal of Multivariate Analysis, Elsevier, vol. 57(2), pages 277-296, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    2. Ionel Birgean & Lutz Kilian, 2002. "Data-Driven Nonparametric Spectral Density Estimators For Economic Time Series: A Monte Carlo Study," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 449-476.
    3. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    4. Kilian, Lutz & Rebucci, Alessandro & Spatafora, Nikola, 2009. "Oil shocks and external balances," Journal of International Economics, Elsevier, vol. 77(2), pages 181-194, April.
    5. Bottazzi, G. & Sapio, S. & Secchi, A., 2005. "Some statistical investigations on the nature and dynamics of electricity prices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 54-61.
    6. Pierluigi Balduzzi & Emanuele Brancati & Marco Brianti & Fabio Schiantarelli, 2019. "Populism, Political Risk and the Economy: Lessons from Italy," Boston College Working Papers in Economics 989, Boston College Department of Economics, revised 28 Apr 2020.
    7. J. David López-Salido & Francesca Loria, 2020. "Inflation at Risk," Finance and Economics Discussion Series 2020-013, Board of Governors of the Federal Reserve System (U.S.).
    8. Lusompa, Amaze, 2019. "Local Projections, Autocorrelation, and Efficiency," MPRA Paper 99856, University Library of Munich, Germany, revised 11 Apr 2020.
    9. Ludger Linnemann & Roland Winkler, 2016. "Estimating nonlinear effects of fiscal policy using quantile regression methods," Oxford Economic Papers, Oxford University Press, vol. 68(4), pages 1120-1145.
    10. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    11. Kilian, Lutz & Kim, Yun Jung, 2009. "Do Local Projections Solve the Bias Problem in Impulse Response Inference?," CEPR Discussion Papers 7266, C.E.P.R. Discussion Papers.
    12. Brianti, Marco & Cormun, Vito, 2023. "Expectation-Driven Boom-Bust Cycles," Working Papers 2023-4, University of Alberta, Department of Economics.
    13. Lutz Kilian & Bruce Hicks, 2013. "Did Unexpectedly Strong Economic Growth Cause the Oil Price Shock of 2003–2008?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(5), pages 385-394, August.
    14. Yao Axel Ehouman, 2020. "Do oil-market shocks drive global liquidity?," EconomiX Working Papers 2020-33, University of Paris Nanterre, EconomiX.
    15. López-Salido, J David & Loria, Francesca, 2019. "Inflation at Risk," CEPR Discussion Papers 14074, C.E.P.R. Discussion Papers.
    16. International Monetary Fund, 2007. "Oil Shocks and External Balances," IMF Working Papers 2007/110, International Monetary Fund.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis X. Diebold & Lutz Kilian, 2001. "Measuring predictability: theory and macroeconomic applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(6), pages 657-669.
    2. Ionel Birgean & Lutz Kilian, 2002. "Data-Driven Nonparametric Spectral Density Estimators For Economic Time Series: A Monte Carlo Study," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 449-476.
    3. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    4. Dufour, Jean-Marie & Taamouti, Abderrahim, 2010. "Short and long run causality measures: Theory and inference," Journal of Econometrics, Elsevier, vol. 154(1), pages 42-58, January.
    5. Kilian, Lutz & Kim, Yun Jung, 2009. "Do Local Projections Solve the Bias Problem in Impulse Response Inference?," CEPR Discussion Papers 7266, C.E.P.R. Discussion Papers.
    6. M. Marzo, 2001. "Evaluating Monetary Policy Regimes: the Role of Nominal Rigidities," Working Papers 411, Dipartimento Scienze Economiche, Universita' di Bologna.
    7. Daniel Grabowski & Anna Staszewska-Bystrova & Peter Winker, 2020. "Skewness-adjusted bootstrap confidence intervals and confidence bands for impulse response functions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 5-32, March.
    8. DUFOUR, Jean-Marie & JOUINI, Tarek, 2005. "Finite-Sample Simulation-Based Inference in VAR Models with Applications to Order Selection and Causality Testing," Cahiers de recherche 2005-12, Universite de Montreal, Departement de sciences economiques.
    9. André Kurmann, 2003. "Quantifying the Uncertainty about the Fit of a New Keynesian Pricing Model: Extended Version," Cahiers de recherche 0344, CIRPEE.
    10. Dufour, Jean-Marie & Jouini, Tarek, 2006. "Finite-sample simulation-based inference in VAR models with application to Granger causality testing," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 229-254.
    11. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    12. Elmar Mertens, 2005. "Puzzling Comovements between Output and Interest Rates? Multiple Shocks are the Answer," Working Papers 05.05, Swiss National Bank, Study Center Gerzensee.
    13. Monika Blaszkiewicz-Schwartzman, 2007. "Explaining Exchange Rate Movements in New Member States of the European Union: Nominal and Real Convergence," Money Macro and Finance (MMF) Research Group Conference 2006 144, Money Macro and Finance Research Group.
    14. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
    15. Marian Vavra, 2015. "On a Bootstrap Test for Forecast Evaluations," Working and Discussion Papers WP 5/2015, Research Department, National Bank of Slovakia.
    16. Helmut Lütkepohl, 2013. "Vector autoregressive models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 6, pages 139-164, Edward Elgar Publishing.
    17. Mertens, Elmar, 2012. "Are spectral estimators useful for long-run restrictions in SVARs?," Journal of Economic Dynamics and Control, Elsevier, vol. 36(12), pages 1831-1844.
    18. Jaime Casassus & Freddy Higuera, 2011. "Stock Return Predictability and Oil Prices," Documentos de Trabajo 406, Instituto de Economia. Pontificia Universidad Católica de Chile..
    19. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    20. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.

    More about this item

    Keywords

    time series analysis; Sampling (Statistics);

    JEL classification:

    • C30 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:1999-04. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.