IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v207y2021ics0165176521003062.html
   My bibliography  Save this article

A modified Diebold–Mariano test for equal forecast accuracy with clustered dependence

Author

Listed:
  • Zhou, Jin
  • Li, Haiqi
  • Zhong, Wanling

Abstract

This study proposes a modified Diebold–Mariano (DM) test for equal forecast accuracy with clustered dependence. A novel consistent long-run variance estimator is developed to account for the clustered dependence. The modified DM test statistic asymptotically follows a normal distribution. The moving block bootstrap is employed to improve the size and power performance of the newly proposed test. A Monte Carlo simulation shows that the modified DM test has a better finite sample performance than the conventional DM test.

Suggested Citation

  • Zhou, Jin & Li, Haiqi & Zhong, Wanling, 2021. "A modified Diebold–Mariano test for equal forecast accuracy with clustered dependence," Economics Letters, Elsevier, vol. 207(C).
    • Handle: RePEc:eee:ecolet:v:207:y:2021:i:c:s0165176521003062
    DOI: 10.1016/j.econlet.2021.110029
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176521003062
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2021.110029?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    2. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    3. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    4. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    5. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    6. Harvey, David I. & Leybourne, Stephen J. & Whitehouse, Emily J., 2017. "Forecast evaluation tests and negative long-run variance estimates in small samples," International Journal of Forecasting, Elsevier, vol. 33(4), pages 833-847.
    7. Rho, Seunghwa & Vogelsang, Timothy J., 2021. "Inference in time series models using smoothed-clustered standard errors," Journal of Econometrics, Elsevier, vol. 224(1), pages 113-133.
    8. Moulton, Brent R., 1986. "Random group effects and the precision of regression estimates," Journal of Econometrics, Elsevier, vol. 32(3), pages 385-397, August.
    9. Khalaf, Lynda & Saunders, Charles J., 2017. "Monte Carlo forecast evaluation with persistent data," International Journal of Forecasting, Elsevier, vol. 33(1), pages 1-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Haider A. Khan & Shahryar Ghorbani & Elham Shabani & Shahab S. Band, 2024. "Enhancement of Neural Networks Model’s Predictions of Currencies Exchange Rates by Phase Space Reconstruction and Harris Hawks’ Optimization," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 835-860, February.
    2. Suryo Adi Rakhmawan & Tahir Mahmood & Nasir Abbas & Muhammad Riaz, 2024. "Unifying mortality forecasting model: an investigation of the COM–Poisson distribution in the GAS model for improved projections," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 30(4), pages 800-826, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Timo Dimitriadis & iaochun Liu & Julie Schnaitmann, 2023. "Encompassing Tests for Value at Risk and Expected Shortfall Multistep Forecasts Based on Inference on the Boundary," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 412-444.
    2. Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2018. "On The Sources Of Uncertainty In Exchange Rate Predictability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(1), pages 329-357, February.
    3. Gibbs, Christopher G. & Vasnev, Andrey L., 2024. "Conditionally optimal weights and forward-looking approaches to combining forecasts," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1734-1751.
    4. Costantini, Mauro & Kunst, Robert M., 2021. "On using predictive-ability tests in the selection of time-series prediction models: A Monte Carlo evaluation," International Journal of Forecasting, Elsevier, vol. 37(2), pages 445-460.
    5. Tuhkuri, Joonas, 2016. "Forecasting Unemployment with Google Searches," ETLA Working Papers 35, The Research Institute of the Finnish Economy.
    6. Kruse, Robinson & Leschinski, Christian & Will, Michael, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," Hannover Economic Papers (HEP) dp-571, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    7. Laura Coroneo & Fabrizio Iacone, 2020. "Comparing predictive accuracy in small samples using fixed‐smoothing asymptotics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 391-409, June.
    8. Håvard Hungnes, 2020. "Equal predictability test for multi-step-ahead system forecasts invariant to linear transformations," Discussion Papers 931, Statistics Norway, Research Department.
    9. Stephen Snudden, 2024. "Don’t Ruin the Surprise: Temporal Aggregation Bias in Structural Innovations," LCERPA Working Papers jc0149, Laurier Centre for Economic Research and Policy Analysis, revised Nov 2024.
    10. Jamali, Ibrahim & Yamani, Ehab, 2019. "Out-of-sample exchange rate predictability in emerging markets: Fundamentals versus technical analysis," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 61(C), pages 241-263.
    11. Byrne, Joseph P. & Korobilis, Dimitris & Ribeiro, Pinho J., 2014. "On the Sources of Uncertainty in Exchange Rate Predictability," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-24, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    12. João C. Claudio & Katja Heinisch & Oliver Holtemöller, 2020. "Nowcasting East German GDP growth: a MIDAS approach," Empirical Economics, Springer, vol. 58(1), pages 29-54, January.
    13. Cavit Pakel & Neil Shephard & Kevin Sheppard, 2009. "Nuisance parameters, composite likelihoods and a panel of GARCH models," Economics Papers 2009-W12, Economics Group, Nuffield College, University of Oxford.
    14. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    15. Richard H. Clarida & Lucio Sarno & Mark P. Taylor & Giorgio Valente, 2006. "The Role of Asymmetries and Regime Shifts in the Term Structure of Interest Rates," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1193-1224, May.
    16. Corradi, Valentina & Swanson, Norman R., 2004. "Some recent developments in predictive accuracy testing with nested models and (generic) nonlinear alternatives," International Journal of Forecasting, Elsevier, vol. 20(2), pages 185-199.
    17. Diaa Noureldin & Neil Shephard & Kevin Sheppard, 2012. "Multivariate high‐frequency‐based volatility (HEAVY) models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 907-933, September.
    18. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    19. Reus, Lorenzo & Carrasco, José A. & Pincheira, Pablo, 2020. "Do it with a smile: Forecasting volatility with currency options," Finance Research Letters, Elsevier, vol. 34(C).
    20. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.

    More about this item

    Keywords

    Clustered dependence; Diebold–Mariano test; Moving block bootstrap;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • F31 - International Economics - - International Finance - - - Foreign Exchange

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:207:y:2021:i:c:s0165176521003062. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.