IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v102y2020i1p17-33.html
   My bibliography  Save this article

Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors

Author

Listed:
  • Todd E. Clark

    (Federal Reserve Bank of Cleveland)

  • Michael W. McCracken

    (Federal Reserve Bank of St. Louis)

  • Elmar Mertens

    (Deutsche Bundesbank)

Abstract

We estimate uncertainty measures for point forecasts obtained from survey data, pooling information embedded in observed forecast errors for different forecast horizons. To track time-varying uncertainty in the associated forecast errors, we derive a multiple-horizon specification of stochastic volatility. We apply our method to forecasts for various macroeconomic variables from the Survey of Professional Forecasters. Compared to simple variance approaches, our stochastic volatility model improves the accuracy of uncertainty measures for survey forecasts.

Suggested Citation

  • Todd E. Clark & Michael W. McCracken & Elmar Mertens, 2020. "Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 17-33, March.
    • Handle: RePEc:tpr:restat:v:102:y:2020:i:1:p:17-33
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/rest_a_00809
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Knüppel, Malte, 2014. "Efficient estimation of forecast uncertainty based on recent forecast errors," International Journal of Forecasting, Elsevier, vol. 30(2), pages 257-267.
    2. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    3. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    4. Vasco Cúrdia & Marco Del Negro & Daniel L. Greenwald, 2014. "Rare Shocks, Great Recessions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1031-1052, November.
    5. Diebold, Francis X. & Schorfheide, Frank & Shin, Minchul, 2017. "Real-time forecast evaluation of DSGE models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 201(2), pages 322-332.
    6. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    7. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    8. Alejandro Justiniano & Giorgio E. Primiceri, 2008. "The Time-Varying Volatility of Macroeconomic Fluctuations," American Economic Review, American Economic Association, vol. 98(3), pages 604-641, June.
    9. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    10. Chiu, Ching-Wai (Jeremy) & Mumtaz, Haroon & Pintér, Gábor, 2017. "Forecasting with VAR models: Fat tails and stochastic volatility," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1124-1143.
    11. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    12. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    13. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    14. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    15. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    16. Christopher A. Sims, 2007. "Monetary Policy Models," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 38(2), pages 75-90.
    17. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    18. James H. Stock & Mark W. Watson, 2016. "Core Inflation and Trend Inflation," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 770-784, October.
    19. Cogley, Timothy & Morozov, Sergei & Sargent, Thomas J., 2005. "Bayesian fan charts for U.K. inflation: Forecasting and sources of uncertainty in an evolving monetary system," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1893-1925, November.
    20. Soojin Jo & Rodrigo Sekkel, 2019. "Macroeconomic Uncertainty Through the Lens of Professional Forecasters," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 436-446, July.
    21. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    22. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    23. Todd E. Clark & Francesco Ravazzolo, 2015. "Macroeconomic Forecasting Performance under Alternative Specifications of Time‐Varying Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 551-575, June.
    24. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    25. Rossi, Barbara & Sekhposyan, Tatevik, 2014. "Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set," International Journal of Forecasting, Elsevier, vol. 30(3), pages 662-682.
    26. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    27. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    28. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    29. Christopher A. Sims, 2007. "Monetary Policy Models," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 38(2), pages 75-90.
    30. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    31. Croushore Dean, 2010. "An Evaluation of Inflation Forecasts from Surveys Using Real-Time Data," The B.E. Journal of Macroeconomics, De Gruyter, vol. 10(1), pages 1-32, May.
    32. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    33. Jacquier, Eric & Polson, Nicholas G. & Rossi, P.E.Peter E., 2004. "Bayesian analysis of stochastic volatility models with fat-tails and correlated errors," Journal of Econometrics, Elsevier, vol. 122(1), pages 185-212, September.
    34. Geoff Kenny & Thomas Kostka & Federico Masera, 2014. "How Informative are the Subjective Density Forecasts of Macroeconomists?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(3), pages 163-185, April.
    35. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    36. Kenneth F. Wallis, 2005. "Combining Density and Interval Forecasts: A Modest Proposal," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 983-994, December.
    37. Marco Del Negro & Giorgio E. Primiceri, 2015. "Time Varying Structural Vector Autoregressions and Monetary Policy: A Corrigendum," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1342-1345.
    38. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    39. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    40. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    41. repec:pri:cepsud:155sims is not listed on IDEAS
    42. James H. Stock & Mark W. Watson, 2007. "Erratum to “Why Has U.S. Inflation Become Harder to Forecast?”," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    43. Omori, Yasuhiro & Chib, Siddhartha & Shephard, Neil & Nakajima, Jouchi, 2007. "Stochastic volatility with leverage: Fast and efficient likelihood inference," Journal of Econometrics, Elsevier, vol. 140(2), pages 425-449, October.
    44. Giordani, Paolo & Villani, Mattias, 2010. "Forecasting macroeconomic time series with locally adaptive signal extraction," International Journal of Forecasting, Elsevier, vol. 26(2), pages 312-325, April.
    45. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    46. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd E. Clark & Francesco Ravazzolo, 2012. "The macroeconomic forecasting performance of autoregressive models with alternative specifications of time-varying volatility," Working Paper 2012/09, Norges Bank.
    2. Fabian Krüger & Todd E. Clark & Francesco Ravazzolo, 2017. "Using Entropic Tilting to Combine BVAR Forecasts With External Nowcasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 470-485, July.
    3. Knut Are Aastveit & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2017. "Have Standard VARS Remained Stable Since the Crisis?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 931-951, August.
    4. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    5. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    6. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    7. Markus Heinrich & Magnus Reif, 2018. "Forecasting using mixed-frequency VARs with time-varying parameters," ifo Working Paper Series 273, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    8. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    9. Malte Knüppel & Fabian Krüger, 2022. "Forecast uncertainty, disagreement, and the linear pool," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 23-41, January.
    10. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    11. Tamás Kiss & Stepan Mazur & Hoang Nguyen & Pär Österholm, 2023. "Modeling the relation between the US real economy and the corporate bond‐yield spread in Bayesian VARs with non‐Gaussian innovations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(2), pages 347-368, March.
    12. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    13. David L. Reifschneider & Peter Tulip, 2017. "Gauging the Uncertainty of the Economic Outlook Using Historical Forecasting Errors : The Federal Reserve's Approach," Finance and Economics Discussion Series 2017-020, Board of Governors of the Federal Reserve System (U.S.).
    14. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino & Elmar Mertens, 2021. "Addressing COVID-19 Outliers in BVARs with Stochastic Volatility," Working Papers 21-02R, Federal Reserve Bank of Cleveland, revised 09 Aug 2021.
    15. Todd E. Clark & Gergely Ganics & Elmar Mertens, 2022. "What is the Predictive Value of SPF Point and Density Forecasts?," Working Papers 22-37, Federal Reserve Bank of Cleveland.
    16. Markus Heinrich & Magnus Reif, 2020. "Real-Time Forecasting Using Mixed-Frequency VARS with Time-Varying Parameters," CESifo Working Paper Series 8054, CESifo.
    17. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino & Elmar Mertens, 2024. "Addressing COVID-19 Outliers in BVARs with Stochastic Volatility," The Review of Economics and Statistics, MIT Press, vol. 106(5), pages 1403-1417, September.
    18. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    19. Pfarrhofer, Michael, 2022. "Modeling tail risks of inflation using unobserved component quantile regressions," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    20. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2022. "The global component of inflation volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 700-721, June.

    More about this item

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:102:y:2020:i:1:p:17-33. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.