IDEAS home Printed from https://ideas.repec.org/a/eee/ecanpo/v73y2022icp321-330.html
   My bibliography  Save this article

Evaluating the European Central Bank’s uncertainty forecasts

Author

Listed:
  • Tsuchiya, Yoichi

Abstract

While several studies have examined the point forecasts by central banks, few have focused on interval forecasts. This study examines the interval forecasts for inflation and growth made by the European Central Bank (ECB). The ECB states that each of its interval forecasts will cover the corresponding realization with a probability of 57.5%. I show that their actual coverage is always larger, and that the differences from the nominal coverage of 57.5% often turn out to be significant. Yet, tests concerning the dynamics of the actual coverage do not reject the null hypothesis of independence, such that correct conditional coverage cannot be rejected in most cases. Moreover, I find that, in general, the actual coverage of the interval forecasts cannot be predicted by the state of economic uncertainty, but the actual coverage of the 7-month-ahead interval forecast for growth declines if financial market uncertainty increases.

Suggested Citation

  • Tsuchiya, Yoichi, 2022. "Evaluating the European Central Bank’s uncertainty forecasts," Economic Analysis and Policy, Elsevier, vol. 73(C), pages 321-330.
    • Handle: RePEc:eee:ecanpo:v:73:y:2022:i:c:p:321-330
    DOI: 10.1016/j.eap.2021.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0313592621001752
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.eap.2021.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    2. Alan S. Blinder & Michael Ehrmann & Marcel Fratzscher & Jakob De Haan & David-Jan Jansen, 2008. "Central Bank Communication and Monetary Policy: A Survey of Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 46(4), pages 910-945, December.
    3. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    4. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    5. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    6. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    7. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    8. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    9. Yoichi Tsuchiya, 2021. "The predictive power of ECB’s interval forecasts over point forecasts," Applied Economics Letters, Taylor & Francis Journals, vol. 28(16), pages 1413-1418, September.
    10. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    11. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    12. Scott H. Irwin & Darrel L. Good, 2004. "Evaluation of USDA Interval Forecasts of Corn and Soybean Prices," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(4), pages 990-1004.
    13. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    14. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    15. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    16. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    17. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    18. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    19. Kenneth F. Wallis, 2004. "An Assessment of Bank of England and National Institute Inflation Forecast Uncertainties," National Institute Economic Review, National Institute of Economic and Social Research, vol. 189(1), pages 64-71, July.
    20. Alan S. Blinder & Michael Ehrmann & Marcel Fratzscher & Jakob De Haan & David-Jan Jansen, 2008. "Central Bank Communication and Monetary Policy: A Survey of Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 46(4), pages 910-945, December.
    21. Wallis, Kenneth F., 2004. "An Assessment of Bank of England and National Institute Inflation Forecast Uncertainties," National Institute Economic Review, National Institute of Economic and Social Research, vol. 189, pages 64-71, July.
    22. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    23. repec:pri:cepsud:161blinder is not listed on IDEAS
    24. Olga Isengildina‐Massa & Julia L. Sharp, 2012. "Evaluation of USDA Interval Forecasts Revisited: Asymmetry and Accuracy of Corn, Soybean, and Wheat Prices," Agribusiness, John Wiley & Sons, Ltd., vol. 28(3), pages 310-323, June.
    25. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    26. Dowd, Kevin, 2007. "Too good to be true? The (In)credibility of the UK inflation fan charts," Journal of Macroeconomics, Elsevier, vol. 29(1), pages 91-102, March.
    27. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    2. Galvao, Ana Beatriz & Mitchell, James, 2019. "Measuring Data Uncertainty : An Application using the Bank of England’s “Fan Charts” for Historical GDP Growth," EMF Research Papers 24, Economic Modelling and Forecasting Group.
    3. Ana Beatriz Galvão & James Mitchell, 2023. "Real‐Time Perceptions of Historical GDP Data Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 457-481, June.
    4. Yoichi Tsuchiya, 2021. "The value added of the Bank of Japan's range forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 817-833, August.
    5. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    6. Victor Lopez-Perez, 2016. "Macroeconomic Forecast Uncertainty In The Euro Area," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 11(1), pages 9-41, March.
    7. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    8. Tatjana Dahlhaus & Tatevik Sekhposyan, 2018. "Monetary Policy Uncertainty: A Tale of Two Tails," Staff Working Papers 18-50, Bank of Canada.
    9. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    10. Herman O. Stekler, 2008. "What Do We Know About G-7 Macro Forecasts?," Working Papers 2008-009, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    11. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    12. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    13. Beckmann, Joscha & Czudaj, Robert L., 2023. "Perceived monetary policy uncertainty," Journal of International Money and Finance, Elsevier, vol. 130(C).
    14. repec:zbw:bofrdp:037 is not listed on IDEAS
    15. Hansen, Stephen & McMahon, Michael & Tong, Matthew, 2019. "The long-run information effect of central bank communication," Journal of Monetary Economics, Elsevier, vol. 108(C), pages 185-202.
    16. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Tinbergen Institute Discussion Papers 08-050/4, Tinbergen Institute.
    17. repec:zbw:bofrdp:2022_005 is not listed on IDEAS
    18. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    19. Wojciech Charemza & Carlos Diaz Vela & Svetlana Makarova, 2013. "Inflation fan charts, monetary policy and skew normal distribution," Discussion Papers in Economics 13/06, Division of Economics, School of Business, University of Leicester.
    20. Stefan Sauer & Klaus Wohlrabe, 2020. "ifo Handbuch der Konjunkturumfragen," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 88.
    21. Ambrocio, Gene, 2020. "Inflationary household uncertainty shocks," Bank of Finland Research Discussion Papers 5/2020, Bank of Finland.
    22. Carlos Díaz, 2018. "Extracting information shocks from the Bank of England inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(3), pages 316-326, April.

    More about this item

    Keywords

    Inflation; Monetary policy; Interval forecasts; Forecast evaluation; Uncertainty index;
    All these keywords.

    JEL classification:

    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecanpo:v:73:y:2022:i:c:p:321-330. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/economic-analysis-and-policy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.