IDEAS home Printed from https://ideas.repec.org/p/awi/wpaper/0611.html
   My bibliography  Save this paper

Forecast Performance, Disagreement, and Heterogeneous Signal-to-Noise Ratios

Author

Listed:
  • Dovern, Jonas
  • Hartmann, Matthias

Abstract

We propose an imperfect information model for the expectations of macroeconomic forecasters that explains differences in average disagreement levels across forecasters by means of cross sectional heterogeneity in the variance of private noise signals. We show that the forecaster-specific signal-to-noise ratios determine both the average individual disagreement level and an individuals' forecast performance: forecasters with very noisy signals deviate strongly from the average forecasts and report forecasts with low accuracy. We take the model to the data by empirically testing for this implied correlation. Evidence based on data from the Surveys of Professional Forecasters for the US and for the Euro Area supports the model for short- and medium-run forecasts but rejects it based on its implications for long-run forecasts.

Suggested Citation

  • Dovern, Jonas & Hartmann, Matthias, 2016. "Forecast Performance, Disagreement, and Heterogeneous Signal-to-Noise Ratios," Working Papers 0611, University of Heidelberg, Department of Economics.
    • Handle: RePEc:awi:wpaper:0611
    Note: This paper is part of http://archiv.ub.uni-heidelberg.de/volltextserver/view/schriftenreihen/sr-3.html
    as

    Download full text from publisher

    File URL: http://nbn-resolving.de/urn/resolver.pl?urn=urn:nbn:de:bsz:16-heidok-204291
    File Function: Frontdoor page on HeiDOK
    Download Restriction: no
    File URL: https://archiv.ub.uni-heidelberg.de/volltextserver/20429/1/dovern_hartmann_2016_dp611.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    2. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    3. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    4. William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, July.
    5. Kristoffer P. Nimark, 2014. "Man-Bites-Dog Business Cycles," American Economic Review, American Economic Association, vol. 104(8), pages 2320-2367, August.
    6. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    7. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    8. Kajal Lahiri & Antony Davies & Xuguang Sheng, 2010. "Analyzing Three-Dimensional Panel Data of Forecasts," Discussion Papers 10-07, University at Albany, SUNY, Department of Economics.
    9. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    10. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    11. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    12. Guido Lorenzoni, 2009. "A Theory of Demand Shocks," American Economic Review, American Economic Association, vol. 99(5), pages 2050-2084, December.
    13. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    14. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    15. Fushang Liu & Kajal Lahiri, 2006. "Modelling multi-period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219.
    16. Dovern, Jonas, 2015. "A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data," European Economic Review, Elsevier, vol. 80(C), pages 16-35.
    17. Davies, Anthony & Lahiri, Kajal, 1995. "A new framework for analyzing survey forecasts using three-dimensional panel data," Journal of Econometrics, Elsevier, vol. 68(1), pages 205-227, July.
    18. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    19. Dovern, Jonas, 2013. "When are GDP forecasts updated? Evidence from a large international panel," Economics Letters, Elsevier, vol. 120(3), pages 521-524.
    20. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    21. Lahiri, Kajal & Sheng, Xuguang, 2010. "Learning and heterogeneity in GDP and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 26(2), pages 265-292, April.
    22. Leonardo Melosi, 2014. "Estimating Models with Dispersed Information," American Economic Journal: Macroeconomics, American Economic Association, vol. 6(1), pages 1-31, January.
    23. Harris, Milton & Raviv, Artur, 1993. "Differences of Opinion Make a Horse Race," The Review of Financial Studies, Society for Financial Studies, vol. 6(3), pages 473-506.
    24. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ahrens, Steffen & Lustenhouwer, Joep & Tettamanzi, Michele, 2017. "The Stabilizing Role of Forward Guidance: A Macro Experiment," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168063, Verein für Socialpolitik / German Economic Association.
    2. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    3. Monique Reid & Pierre Siklos, 2024. "Firm Level Expectations and Macroeconomic Conditions: Underpinnings and Disagreement," CAMA Working Papers 2024-05, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    4. Ruttachai Seelajaroen & Pornanong Budsaratragoon & Boonlert Jitmaneeroj, 2020. "Do monetary policy transparency and central bank communication reduce interest rate disagreement?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(3), pages 368-393, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    2. Dovern, Jonas, 2015. "A multivariate analysis of forecast disagreement: Confronting models of disagreement with survey data," European Economic Review, Elsevier, vol. 80(C), pages 16-35.
    3. An, Zidong & Zheng, Xinye, 2023. "Diligent forecasters can make accurate predictions despite disagreeing with the consensus," Economic Modelling, Elsevier, vol. 125(C).
    4. Czudaj, Robert L., 2022. "Heterogeneity of beliefs and information rigidity in the crude oil market: Evidence from survey data," European Economic Review, Elsevier, vol. 143(C).
    5. Raffaella Giacomini & Vasiliki Skreta & Javier Turen, 2015. "Models, Inattention and Expectation Updates," Discussion Papers 1602, Centre for Macroeconomics (CFM).
    6. Andrade, Philippe & Crump, Richard K. & Eusepi, Stefano & Moench, Emanuel, 2016. "Fundamental disagreement," Journal of Monetary Economics, Elsevier, vol. 83(C), pages 106-128.
    7. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    8. Michael Clements, 2016. "Are Macro-Forecasters Essentially The Same? An Analysis of Disagreement, Accuracy and Efficiency," ICMA Centre Discussion Papers in Finance icma-dp2016-08, Henley Business School, University of Reading.
    9. Cole, Stephen J. & Milani, Fabio, 2021. "Heterogeneity in individual expectations, sentiment, and constant-gain learning," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 627-650.
    10. de Mendonça, Helder Ferreira & Vereda, Luciano & Araujo, Mateus de Azevedo, 2022. "What type of information calls the attention of forecasters? Evidence from survey data in an emerging market," Journal of International Money and Finance, Elsevier, vol. 129(C).
    11. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    12. Clements, Michael P., 2012. "Do professional forecasters pay attention to data releases?," International Journal of Forecasting, Elsevier, vol. 28(2), pages 297-308.
    13. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    14. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    15. Stefano Eusepi & Richard Crump & Emanuel Moench & Philippe Andrade, 2014. "Noisy Information and Fundamental Disagreement," 2014 Meeting Papers 797, Society for Economic Dynamics.
    16. Gaurav Kumar Singh & Tathagata Bandyopadhyay, 2024. "Determinants of disagreement: Learning from inflation expectations survey of households," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 326-343, March.
    17. George-Marios Angeletos & Chen Lian, 2016. "Incomplete Information in Macroeconomics: Accommodating Frictions in Coordination," NBER Working Papers 22297, National Bureau of Economic Research, Inc.
    18. Tsiaplias, Sarantis, 2020. "Time-Varying Consumer Disagreement and Future Inflation," Journal of Economic Dynamics and Control, Elsevier, vol. 116(C).
    19. Esady, Vania, 2022. "Real and nominal effects of monetary shocks under time-varying disagreement," Bank of England working papers 1007, Bank of England.
    20. Manzan, Sebastiano, 2021. "Are professional forecasters Bayesian?," Journal of Economic Dynamics and Control, Elsevier, vol. 123(C).

    More about this item

    Keywords

    disagreement; expectations; imperfect information; signal-to-noise ratio.;
    All these keywords.

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • D80 - Microeconomics - - Information, Knowledge, and Uncertainty - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:awi:wpaper:0611. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabi Rauscher (email available below). General contact details of provider: https://edirc.repec.org/data/awheide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.