IDEAS home Printed from https://ideas.repec.org/p/fip/fedmem/52.html
   My bibliography  Save this paper

Comparing predictive accuracy I: an asymptotic test

Author

Listed:
  • Francis X. Diebold
  • Roberto S. Mariano

Abstract

We propose and evaluate an explicit test of the null hypothesis of no difference in the accuracy of two competing forecasts. In contrast to previously developed tests, a wide variety of accuracy measures can be used (in particular, the loss function need not be quadratic, and need not even be symmetric), and forecast errors can be non-Gaussian, nonzero mean, serially correlated and contemporaneously correlated.

Suggested Citation

  • Francis X. Diebold & Roberto S. Mariano, 1991. "Comparing predictive accuracy I: an asymptotic test," Discussion Paper / Institute for Empirical Macroeconomics 52, Federal Reserve Bank of Minneapolis.
    • Handle: RePEc:fip:fedmem:52
    as

    Download full text from publisher

    File URL: http://www.minneapolisfed.org/research/common/pub_detail.cfm?pb_autonum_id=50
    Download Restriction: no
    File URL: http://www.minneapolisfed.org/research/DP/DP52.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Toda, Hiro Y & Phillips, Peter C B, 1993. "Vector Autoregressions and Causality," Econometrica, Econometric Society, vol. 61(6), pages 1367-1393, November.
    2. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    3. Christiano, Lawrence J. & Eichenbaum, Martin, 1990. "Unit roots in real GNP: Do we know, and do we care?," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 32(1), pages 7-61, January.
    4. Fair, Ray C & Shiller, Robert J, 1990. "Comparing Information in Forecasts from Econometric Models," American Economic Review, American Economic Association, vol. 80(3), pages 375-389, June.
    5. Young, William E, 1971. "Random Walk of Stock Prices: A Test of the Variance-Time Function," Econometrica, Econometric Society, vol. 39(5), pages 797-812, September.
    6. Rudebusch, Glenn D, 1992. "Trends and Random Walks in Macroeconomic Time Series: A Re-examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 661-680, August.
    7. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    8. Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
    9. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    10. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    11. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592.
    12. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    13. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    14. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    15. Howrey, E Philip & Klein, Lawrence R & McCarthy, Michael D, 1974. "Notes on Testing the Predictive Performance of Econometric Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 15(2), pages 366-383, June.
    16. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. West, Kenneth D. & Cho, Dongchul, 1995. "The predictive ability of several models of exchange rate volatility," Journal of Econometrics, Elsevier, vol. 69(2), pages 367-391, October.
    2. Chan Guk Huh, 1998. "Forecasting industrial production using models with business cycle asymmetry," Economic Review, Federal Reserve Bank of San Francisco, pages 29-41.
    3. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    4. Tazwell S. Rowe & Roy H. Webb, 1995. "An index of leading indicators for inflation," Economic Quarterly, Federal Reserve Bank of Richmond, issue Spr, pages 75-96.
    5. Meyer-Gohde, Alexander & Shabalina, Ekaterina, 2022. "Estimation and forecasting using mixed-frequency DSGE models," IMFS Working Paper Series 175, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).
    6. Tomas Havranek & Ayaz Zeynalov, 2021. "Forecasting tourist arrivals: Google Trends meets mixed-frequency data," Tourism Economics, , vol. 27(1), pages 129-148, February.
    7. Lin, Wen-Ling, 1995. "Market closure and predictability of intradaily stock returns in the United States and Japan," Journal of Empirical Finance, Elsevier, vol. 2(1), pages 19-44, March.
    8. Gerdesmeier Dieter & Roffia Barbara & Reimers Hans-Eggert, 2017. "Forecasting Euro Area Inflation Using Single-Equation and Multivariate VAR–Models," Folia Oeconomica Stetinensia, Sciendo, vol. 17(2), pages 19-34, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    2. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    3. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    4. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    5. repec:lan:wpaper:470 is not listed on IDEAS
    6. West, Kenneth D., 2001. "Encompassing tests when no model is encompassing," Journal of Econometrics, Elsevier, vol. 105(1), pages 287-308, November.
    7. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    8. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    9. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    10. Abhyankar, Abhay & Sarno, Lucio & Valente, Giorgio, 2005. "Exchange rates and fundamentals: evidence on the economic value of predictability," Journal of International Economics, Elsevier, vol. 66(2), pages 325-348, July.
    11. repec:lan:wpaper:425 is not listed on IDEAS
    12. repec:lan:wpaper:539557 is not listed on IDEAS
    13. repec:lan:wpaper:413 is not listed on IDEAS
    14. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2010. "Exchange rate forecasting, order flow and macroeconomic information," Journal of International Economics, Elsevier, vol. 80(1), pages 72-88, January.
    15. Carlo Altavilla & Paul De Grauwe, 2010. "Forecasting and combining competing models of exchange rate determination," Applied Economics, Taylor & Francis Journals, vol. 42(27), pages 3455-3480.
    16. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    17. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    18. Preminger, Arie & Franck, Raphael, 2007. "Forecasting exchange rates: A robust regression approach," International Journal of Forecasting, Elsevier, vol. 23(1), pages 71-84.
    19. Moosa, Imad & Burns, Kelly, 2014. "The unbeatable random walk in exchange rate forecasting: Reality or myth?," Journal of Macroeconomics, Elsevier, vol. 40(C), pages 69-81.
    20. Yin-Wong Cheung & Menzie D. Chinn & Antonio I. Garcia Pascual, 2003. "What Do We Know about Recent Exchange Rate Models? In-Sample Fit and Out-of-Sample Performance Evaluated," CESifo Working Paper Series 902, CESifo.
    21. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
    22. Wu, Jyh-Lin & Hu, Yu-Hau, 2009. "New evidence on nominal exchange rate predictability," Journal of International Money and Finance, Elsevier, vol. 28(6), pages 1045-1063, October.
    23. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    24. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.

    More about this item

    Keywords

    Econometrics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedmem:52. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jannelle Ruswick (email available below). General contact details of provider: https://edirc.repec.org/data/cfrbmus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.