IDEAS home Printed from https://ideas.repec.org/p/fip/fedawp/2002-8.html
   My bibliography  Save this paper

Evaluating Wall Street Journal survey forecasters: a multivariate approach

Author

Listed:
  • Robert A. Eisenbeis
  • Daniel F. Waggoner
  • Tao Zha

Abstract

This paper proposes a methodology for assessing the joint performance of multivariate forecasts of economic variables. The methodology is illustrated by comparing the rankings of forecasters by the Wall Street Journal with the authors? alternative rankings. The results show that the methodology can provide useful insights as to the certainty of forecasts as well as the extent to which various forecasts are similar or different.

Suggested Citation

  • Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2002. "Evaluating Wall Street Journal survey forecasters: a multivariate approach," FRB Atlanta Working Paper 2002-8, Federal Reserve Bank of Atlanta.
    • Handle: RePEc:fip:fedawp:2002-8
    as

    Download full text from publisher

    File URL: https://www.frbatlanta.org/-/media/documents/research/publications/wp/2002/wp0208a.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
    2. John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, vol. 84(Q1), pages 4-18.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sinclair, Tara M. & Gamber, Edward N. & Stekler, Herman & Reid, Elizabeth, 2012. "Jointly evaluating the Federal Reserve’s forecasts of GDP growth and inflation," International Journal of Forecasting, Elsevier, vol. 28(2), pages 309-314.
    2. Filip Novotný & Marie Raková, 2011. "Assessment of Consensus Forecasts Accuracy: The Czech National Bank Perspective," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 61(4), pages 348-366, August.
    3. Hans Christian Müller-Dröge & Tara M. Sinclair & H.O. Stekler, 2014. "Evaluating Forecasts of a Vector of Variables: a German Forecasting Competition," CAMA Working Papers 2014-55, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    4. Carvalho, Fabia A. & Minella, André, 2012. "Survey forecasts in Brazil: A prismatic assessment of epidemiology, performance, and determinants," Journal of International Money and Finance, Elsevier, vol. 31(6), pages 1371-1391.
    5. Karlyn Mitchell & Douglas Pearce, 2010. "Do Wall Street economists believe in Okun’s Law and the Taylor Rule?," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 34(2), pages 196-217, April.
    6. Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2006. "Transparency, expectations and forecasts," Economic Review, Federal Reserve Bank of Atlanta, vol. 91(Q 1), pages 1-25.
    7. Rolando F. Peláez, 2015. "A recession‐and‐state forecasting model," Southern Economic Journal, John Wiley & Sons, vol. 81(4), pages 1025-1039, April.
    8. Pierdzioch, Christian & Rülke, Jan Christoph & Stadtmann, Georg, 2012. "House price forecasts in times of crisis: Do forecasters herd?," Discussion Papers 318, European University Viadrina Frankfurt (Oder), Department of Business Administration and Economics.
    9. Koske, Isabell & Stadtmann, Georg, 2009. "Exchange rate expectations: The role of person specific forward looking variables," Economics Letters, Elsevier, vol. 105(3), pages 221-223, December.
    10. Jan Christoph Ruelke & Ralf Fendel & Michael Frenkel, 2011. "Do Professional Forecasters Trust in Taylor-Type Rules? - Evidence from the Wall Street Journal Poll," Post-Print hal-00743770, HAL.
    11. Audretsch, David B. & Stadtmann, Georg, 2005. "Biases in FX-forecasts: Evidence from panel data," Global Finance Journal, Elsevier, vol. 16(1), pages 99-111, August.
    12. Andrew Bauer & Robert A. Eisenbeis & Daniel F. Waggoner & Tao Zha, 2003. "Forecast evaluation with cross-sectional data: The Blue Chip Surveys," Economic Review, Federal Reserve Bank of Atlanta, vol. 88(Q2), pages 17-31.
    13. Sinclair, Tara M. & Stekler, H.O. & Carnow, Warren, 2015. "Evaluating a vector of the Fed’s forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 157-164.
    14. Mitchell, Karlyn & Pearce, Douglas K., 2007. "Professional forecasts of interest rates and exchange rates: Evidence from the Wall Street Journal's panel of economists," Journal of Macroeconomics, Elsevier, vol. 29(4), pages 840-854, December.
    15. Ruelke, Jan C. & Frenkel, Michael R. & Stadtmann, Georg, 2010. "Expectations on the yen/dollar exchange rate - Evidence from the Wall Street Journal forecast poll," Journal of the Japanese and International Economies, Elsevier, vol. 24(3), pages 355-368, September.
    16. Dovern, Jonas & Feldkircher, Martin & Huber, Florian, 2016. "Does joint modelling of the world economy pay off? Evaluating global forecasts from a Bayesian GVAR," Journal of Economic Dynamics and Control, Elsevier, vol. 70(C), pages 86-100.
    17. Christian Pierdzioch & Jan Christoph Rülke & Georg Stadtmann, 2012. "House Price Forecasts, Forecaster Herding, and the Recent Crisis," IJFS, MDPI, vol. 1(1), pages 1-14, November.
    18. Frenkel, Michael & Rülke, Jan-Christoph & Stadtmann, Georg, 2009. "Two currencies, one model? Evidence from the Wall Street Journal forecast poll," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 19(4), pages 588-596, October.
    19. Christian Dreger & Georg Stadtmann, 2008. "What drives heterogeneity in foreign exchange rate expectations: insights from a new survey," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 13(4), pages 360-367.
    20. Herman O. Stekler & Raj M. Talwar, 2011. "Economic Forecasting in the Great Recession," Working Papers 2011-005, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    21. Christian Dreger & Georg Stadtmann, 2006. "What Drives Heterogeneity in Foreign Exchange Rate Expectations: Deep Insights from a New Survey," Discussion Papers of DIW Berlin 624, DIW Berlin, German Institute for Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Summers, Peter M., 2001. "Forecasting Australia's economic performance during the Asian crisis," International Journal of Forecasting, Elsevier, vol. 17(3), pages 499-515.
    2. Giannone, Domenico & Lenza, Michele & Momferatou, Daphne & Onorante, Luca, 2014. "Short-term inflation projections: A Bayesian vector autoregressive approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 635-644.
    3. Miranda-Agrippino, Silvia & Ricco, Giovanni, 2018. "Bayesian Vector Autoregressions," The Warwick Economics Research Paper Series (TWERPS) 1159, University of Warwick, Department of Economics.
    4. Hanck, Christoph & Prüser, Jan, 2016. "House prices and interest rates: Bayesian evidence from Germany," Ruhr Economic Papers 620, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    5. Bloor, Chris & Matheson, Troy, 2011. "Real-time conditional forecasts with Bayesian VARs: An application to New Zealand," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 26-42, January.
    6. Knotek, Edward S. & Zaman, Saeed, 2019. "Financial nowcasts and their usefulness in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1708-1724.
    7. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    8. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2021. "No‐arbitrage priors, drifting volatilities, and the term structure of interest rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 495-516, August.
    9. Andrew Blake & Haroon Mumtaz, 2015. "Applied Bayesian Econometrics for central bankers," Handbooks, Centre for Central Banking Studies, Bank of England, number 36, April.
    10. John C. Robertson & Ellis W. Tallman, 1999. "Prior parameter uncertainty: Some implications for forecasting and policy analysis with VAR models," FRB Atlanta Working Paper 99-13, Federal Reserve Bank of Atlanta.
    11. Heather Anderson & Giovanni Caggiano & Farshid Vahid & Benjamin Wong, 2020. "Sectoral Employment Dynamics in Australia," Monash Econometrics and Business Statistics Working Papers 20/20, Monash University, Department of Econometrics and Business Statistics.
    12. Higgins, Patrick & Zha, Tao & Zhong, Wenna, 2016. "Forecasting China's economic growth and inflation," China Economic Review, Elsevier, vol. 41(C), pages 46-61.
    13. Heather Anderson & Giovanni Caggiano & Farshid Vahid & Benjamin Wong, 2020. "Sectoral Employment Dynamics in Australia and the COVID‐19 Pandemic," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 53(3), pages 402-414, September.
    14. Robertson, John C & Tallman, Ellis W & Whiteman, Charles H, 2005. "Forecasting Using Relative Entropy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 383-401, June.
    15. John C. Robertson & Ellis W. Tallman, 1999. "Improving forecasts of the federal funds rate in a policy model," FRB Atlanta Working Paper 99-3, Federal Reserve Bank of Atlanta.
    16. Daniel F. Waggoner & Tao Zha, 2000. "A Gibbs simulator for restricted VAR models," FRB Atlanta Working Paper 2000-3, Federal Reserve Bank of Atlanta.
    17. Andersson, Malin & Maurin, Laurent & Rusinova, Desislava, 2021. "Market finance as a spare tyre? Corporate investment and access to bank credit in Europe," Working Paper Series 2606, European Central Bank.
    18. Tino Berger & Tore Dubbert, 2022. "Government spending effects on the business cycle in times of crisis," CQE Working Papers 10022, Center for Quantitative Economics (CQE), University of Muenster.
    19. Camba-Mendez, Gonzalo, 2012. "Conditional forecasts on SVAR models using the Kalman filter," Economics Letters, Elsevier, vol. 115(3), pages 376-378.
    20. Leeper, Eric M. & Zha, Tao, 2003. "Modest policy interventions," Journal of Monetary Economics, Elsevier, vol. 50(8), pages 1673-1700, November.

    More about this item

    Keywords

    Forecasting;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedawp:2002-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rob Sarwark (email available below). General contact details of provider: https://edirc.repec.org/data/frbatus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.