IDEAS home Printed from https://ideas.repec.org/p/wrk/warwec/772.html
   My bibliography  Save this paper

Internal consistency of survey respondents.forecasts : Evidence based on the Survey of Professional Forecasters

Author

Listed:
  • Clements, Michael P

    (Department of Economics, University of Warwick)

Abstract

We ask whether the different types of forecasts made by individual survey respondents are mutually consistent, using the SPF survey data. We compare the point forecasts and central tendencies of probability distributions matched by individual respondent, and compare the forecast probabilities of declines in output with the probabilities implied by the probability distributions. When the expected associations between these different types of forecasts do not hold for some idividuals, we consider whether the discrepancies we observe are consistent with rational behaviour by agents with asymmetric loss functions.

Suggested Citation

  • Clements, Michael P, 2006. "Internal consistency of survey respondents.forecasts : Evidence based on the Survey of Professional Forecasters," The Warwick Economics Research Paper Series (TWERPS) 772, University of Warwick, Department of Economics.
    • Handle: RePEc:wrk:warwec:772
    as

    Download full text from publisher

    File URL: https://warwick.ac.uk/fac/soc/economics/research/workingpapers/2006/twerp_772.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ottaviani, Marco & Sorensen, Peter Norman, 2006. "The strategy of professional forecasting," Journal of Financial Economics, Elsevier, vol. 81(2), pages 441-466, August.
    2. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    3. Pesaran, M. Hashem & Weale, Martin, 2006. "Survey Expectations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 14, pages 715-776, Elsevier.
    4. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    5. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    6. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    7. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    8. Kajal Lahiri, 2005. "Analysis of Panel Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(4), pages 1093-1095.
    9. Robert W. Rich & Joseph Tracy, 2003. "Modeling uncertainty: predictive accuracy as a proxy for predictive confidence," Staff Reports 161, Federal Reserve Bank of New York.
    10. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    11. Rich, Robert W & Butler, J S, 1998. "Disagreement as a Measure of Uncertainty: A Comment on Bomberger," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 30(3), pages 411-419, August.
    12. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    13. Baillie, Richard T. & Bollerslev, Tim, 1992. "Prediction in dynamic models with time-dependent conditional variances," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 91-113.
    14. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    15. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    16. Patterson, K. D., 2003. "Exploiting information in vintages of time-series data," International Journal of Forecasting, Elsevier, vol. 19(2), pages 177-197.
    17. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-419, June.
    18. Bomberger, William A, 1996. "Disagreement as a Measure of Uncertainty," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 28(3), pages 381-392, August.
    19. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    20. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    21. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    22. Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
    23. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    24. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    25. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    26. Zarnowitz, Victor, 1985. "Rational Expectations and Macroeconomic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(4), pages 293-311, October.
    27. Michael Clements, 2006. "Evaluating the survey of professional forecasters probability distributions of expected inflation based on derived event probability forecasts," Empirical Economics, Springer, vol. 31(1), pages 49-64, March.
    28. Faust, Jon & Rogers, John H. & H. Wright, Jonathan, 2003. "Exchange rate forecasting: the errors we've really made," Journal of International Economics, Elsevier, vol. 60(1), pages 35-59, May.
    29. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    30. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    31. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    32. Granger, C.W.J. & Pesaran, M. H., 1999. "Economic and Statistical Measures of Forecast Accuracy," Cambridge Working Papers in Economics 9910, Faculty of Economics, University of Cambridge.
    33. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    34. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    35. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    36. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    37. Hsiao,Cheng & Pesaran,M. Hashem & Lahiri,Kajal & Lee,Lung Fei (ed.), 1999. "Analysis of Panels and Limited Dependent Variable Models," Cambridge Books, Cambridge University Press, number 9780521631693, September.
    38. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
    39. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    40. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    41. Davies, Anthony & Lahiri, Kajal, 1995. "A new framework for analyzing survey forecasts using three-dimensional panel data," Journal of Econometrics, Elsevier, vol. 68(1), pages 205-227, July.
    42. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    43. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    44. Tilman Ehrbeck & Robert Waldmann, 1996. "Why Are Professional Forecasters Biased? Agency versus Behavioral Explanations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(1), pages 21-40.
    45. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
    46. Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
    47. Patterson, K D, 1995. "An Integrated Model of the Data Measurement and Data Generation Processes with an Application to Consumers' Expenditure," Economic Journal, Royal Economic Society, vol. 105(428), pages 54-76, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    2. Clements, Michael P., 2008. "Rounding of probability forecasts : The SPF forecast probabilities of negative output growth," The Warwick Economics Research Paper Series (TWERPS) 869, University of Warwick, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    2. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.
    3. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Clements, Michael P., 2008. "Rounding of probability forecasts : The SPF forecast probabilities of negative output growth," The Warwick Economics Research Paper Series (TWERPS) 869, University of Warwick, Department of Economics.
    6. Kajal Lahiri & Fushang Liu, 2006. "ARCH Models for Multi-period Forecast Uncertainty: A Reality Check Using a Panel of Density Forecasts," Advances in Econometrics, in: Econometric Analysis of Financial and Economic Time Series, pages 321-363, Emerald Group Publishing Limited.
    7. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    8. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    9. Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
    10. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    11. Clements, Michael P., 2019. "Do forecasters target first or later releases of national accounts data?," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1240-1249.
    12. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    13. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    14. Kajal Lahiri & Fushang Liu, 2006. "Modelling multi‐period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219, December.
    15. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    16. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    17. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    18. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    19. Clements, Michael P., 2008. "Consensus and uncertainty: Using forecast probabilities of output declines," International Journal of Forecasting, Elsevier, vol. 24(1), pages 76-86.
    20. Croushore Dean, 2010. "An Evaluation of Inflation Forecasts from Surveys Using Real-Time Data," The B.E. Journal of Macroeconomics, De Gruyter, vol. 10(1), pages 1-32, May.

    More about this item

    Keywords

    Rationality ; probability forecasts ; probability distributions;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wrk:warwec:772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Margaret Nash (email available below). General contact details of provider: https://edirc.repec.org/data/dewaruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.