IDEAS home Printed from https://ideas.repec.org/a/taf/emetrv/v36y2017i6-9p588-598.html
   My bibliography  Save this article

Assessing point forecast accuracy by stochastic error distance

Author

Listed:
  • Francis X. Diebold
  • Minchul Shin

Abstract

We propose point forecast accuracy measures based directly on distance of the forecast-error c.d.f. from the unit step function at 0 (“stochastic error distance,” or SED). We provide a precise characterization of the relationship between SED and standard predictive loss functions, and we show that all such loss functions can be written as weighted SEDs. The leading case is absolute error loss. Among other things, this suggests shifting attention away from conditional-mean forecasts and toward conditional-median forecasts.

Suggested Citation

  • Francis X. Diebold & Minchul Shin, 2017. "Assessing point forecast accuracy by stochastic error distance," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 588-598, October.
    • Handle: RePEc:taf:emetrv:v:36:y:2017:i:6-9:p:588-598
    DOI: 10.1080/07474938.2017.1307247
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07474938.2017.1307247
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/07474938.2017.1307247?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    2. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    3. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, September.
    4. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    5. Valentina Corradi & Norman Swanson, 2013. "A Survey of Recent Advances in Forecast Accuracy Comparison Testing, with an Extension to Stochastic Dominance," Departmental Working Papers 201309, Rutgers University, Department of Economics.
    6. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    7. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    8. Lee, Tae-Hwy & Tu, Yundong & Ullah, Aman, 2014. "Nonparametric and semiparametric regressions subject to monotonicity constraints: Estimation and forecasting," Journal of Econometrics, Elsevier, vol. 182(1), pages 196-210.
    9. Xiaohong Chen & Norman R. Swanson (ed.), 2013. "Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis," Springer Books, Springer, edition 127, number 978-1-4614-1653-1, June.
    10. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    11. Jin, Sainan & Corradi, Valentina & Swanson, Norman R., 2017. "Robust Forecast Comparison," Econometric Theory, Cambridge University Press, vol. 33(6), pages 1306-1351, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Borgonovo, Emanuele & Hazen, Gordon B. & Jose, Victor Richmond R. & Plischke, Elmar, 2021. "Probabilistic sensitivity measures as information value," European Journal of Operational Research, Elsevier, vol. 289(2), pages 595-610.
    2. Diebold, Francis X. & Shin, Minchul & Zhang, Boyuan, 2023. "On the aggregation of probability assessments: Regularized mixtures of predictive densities for Eurozone inflation and real interest rates," Journal of Econometrics, Elsevier, vol. 237(2).
    3. Diebold, Francis X. & Shin, Minchul, 2015. "Assessing point forecast accuracy by stochastic loss distance," Economics Letters, Elsevier, vol. 130(C), pages 37-38.
    4. Emilian Dobrescu, 2014. "Attempting to Quantify the Accuracy of Complex Macroeconomic Forecasts," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(4), pages 5-21, December.
    5. Tomás Marinozzi, 2023. "Forecasting Inflation in Argentina: A Probabilistic Approach," Ensayos Económicos, Central Bank of Argentina, Economic Research Department, vol. 1(81), pages 81-110, May.
    6. Jin, Sainan & Corradi, Valentina & Swanson, Norman R., 2017. "Robust Forecast Comparison," Econometric Theory, Cambridge University Press, vol. 33(6), pages 1306-1351, December.
    7. Valentina Corradi & Sainan Jin & Norman R. Swanson, 2023. "Robust forecast superiority testing with an application to assessing pools of expert forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 596-622, June.
    8. Hiroyuki Kawakatsu, 2020. "Recovering Yield Curves from Dynamic Term Structure Models with Time-Varying Factors," Stats, MDPI, vol. 3(3), pages 1-46, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:pen:papers:14-011 is not listed on IDEAS
    2. Valentina Corradi & Sainan Jin & Norman R. Swanson, 2023. "Robust forecast superiority testing with an application to assessing pools of expert forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 596-622, June.
    3. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    4. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Bruzda, Joanna, 2019. "Quantile smoothing in supply chain and logistics forecasting," International Journal of Production Economics, Elsevier, vol. 208(C), pages 122-139.
    7. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    8. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    9. Souhaib Ben Taieb & Raphael Huser & Rob J. Hyndman & Marc G. Genton, 2015. "Probabilistic time series forecasting with boosted additive models: an application to smart meter data," Monash Econometrics and Business Statistics Working Papers 12/15, Monash University, Department of Econometrics and Business Statistics.
    10. Emilio Zanetti Chini, 2018. "Forecaster’s utility and forecasts coherence," DEM Working Papers Series 145, University of Pavia, Department of Economics and Management.
    11. Veiga, Helena, 2015. "Model uncertainty and the forecast accuracy of ARMA models: A survey," DES - Working Papers. Statistics and Econometrics. WS ws1508, Universidad Carlos III de Madrid. Departamento de Estadística.
    12. Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
    13. Lieli, Robert P. & Stinchcombe, Maxwell B. & Grolmusz, Viola M., 2019. "Unrestricted and controlled identification of loss functions: Possibility and impossibility results," International Journal of Forecasting, Elsevier, vol. 35(3), pages 878-890.
    14. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    15. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    16. Sgouropoulos, Nikolaos & Yao, Qiwei & Yastremiz, Claudia, 2015. "Matching a distribution by matching quantiles estimation," LSE Research Online Documents on Economics 57221, London School of Economics and Political Science, LSE Library.
    17. Antonio Bracale & Pasquale De Falco, 2015. "An Advanced Bayesian Method for Short-Term Probabilistic Forecasting of the Generation of Wind Power," Energies, MDPI, vol. 8(9), pages 1-22, September.
    18. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2022. "Stochastic dominance spanning and augmenting the human development index with institutional quality," Annals of Operations Research, Springer, vol. 315(1), pages 341-369, August.
    19. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    20. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    21. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.

    More about this item

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:36:y:2017:i:6-9:p:588-598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.tandfonline.com/LECR20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.