IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i1p431-449.html
   My bibliography  Save this article

The accuracy of IMF crises nowcasts

Author

Listed:
  • Eicher, Theo S.
  • Rollinson, Yuan Gao

Abstract

The International Monetary Fund (IMF) provides loans to countries in economic crises as a lender of last resort. IMF loan approvals are tied to policy reforms and quantitative targets that reflect the IMF’s crisis assessment. An extensive literature scrutinizes the efficacy of IMF loan programs, instead, we examine the accuracy of the IMF’s crisis assessments (nowcasts) that predicate program designs. Analyzing an unprecedented 602 IMF loan programs from 1992 to 2019, we contradict previous findings that IMF nowcasts are generally optimistic. Disentangling the structure of the IMF’s nowcast bias, we find the IMF systematically overestimates high-growth recoveries GDPs, while low-growth recoveries for low-income countries (LICs) are underestimated. In contrast, non-LICs’ nowcasts exhibit no statistically significant optimistic and pessimistic bias. Interestingly, shorter nowcast horizons do not improve accuracy, and GDP growth nowcasts improved substantially since 2013, while inflation nowcasts remain inefficient. We also isolate the sources of IMF nowcast inefficiencies according to ((i) program objectives, ((ii) program conditionality type, ((iii) geographic regions, ((iv) global crises, and ((v) geopolitics (elections, conflicts, and disasters).

Suggested Citation

  • Eicher, Theo S. & Rollinson, Yuan Gao, 2023. "The accuracy of IMF crises nowcasts," International Journal of Forecasting, Elsevier, vol. 39(1), pages 431-449.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:431-449
    DOI: 10.1016/j.ijforecast.2021.12.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207021002132
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2021.12.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sinclair, Tara M. & Joutz, Fred & Stekler, H.O., 2010. "Can the Fed predict the state of the economy?," Economics Letters, Elsevier, vol. 108(1), pages 28-32, July.
    2. Winford H. Masanjala & Chris Papageorgiou, 2008. "Rough and lonely road to prosperity: a reexamination of the sources of growth in Africa using Bayesian model averaging," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 671-682.
    3. Tara M. Sinclair & H. O. Stekler & Warren Carnow, 2012. "A new approach for evaluating economic forecasts," Economics Bulletin, AccessEcon, vol. 32(3), pages 2332-2342.
    4. Stanley Fischer, 1999. "On the Need for an International Lender of Last Resort," Journal of Economic Perspectives, American Economic Association, vol. 13(4), pages 85-104, Fall.
    5. Loungani, Prakash, 2001. "How accurate are private sector forecasts? Cross-country evidence from consensus forecasts of output growth," International Journal of Forecasting, Elsevier, vol. 17(3), pages 419-432.
    6. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 407-443.
    7. Rudiger Dornbusch & Stanley Fischer, 1986. "Stopping hyperinflations past and present," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 122(1), pages 1-47, March.
    8. Dreher, Axel, 2006. "IMF and economic growth: The effects of programs, loans, and compliance with conditionality," World Development, Elsevier, vol. 34(5), pages 769-788, May.
    9. Easterly, William, 2006. "An identity crisis? Examining IMF financial programming," World Development, Elsevier, vol. 34(6), pages 964-980, June.
    10. Paul Beaudry & Tim Willems, 2022. "On the Macroeconomic Consequences of Over-Optimism," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(1), pages 38-59, January.
    11. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    12. Graciela L. Kaminsky & Carmen M. Reinhart & Carlos A. Végh, 2003. "The Unholy Trinity of Financial Contagion," Journal of Economic Perspectives, American Economic Association, vol. 17(4), pages 51-74, Fall.
    13. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    14. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    15. Frank-Oliver Aldenhoff, 2007. "Are economic forecasts of the International Monetary Fund politically biased? A public choice analysis," The Review of International Organizations, Springer, vol. 2(3), pages 239-260, September.
    16. Roy Batchelor, 2001. "How useful are the forecasts of intergovernmental agencies? The IMF and OECD versus the consensus," Applied Economics, Taylor & Francis Journals, vol. 33(2), pages 225-235.
    17. Eicher, Theo S. & Kuenzel, David J. & Papageorgiou, Chris & Christofides, Charis, 2019. "Forecasts in times of crises," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1143-1159.
    18. Wallis, Kenneth F, 1989. "Macroeconomic Forecasting: A Survey," Economic Journal, Royal Economic Society, vol. 99(394), pages 28-61, March.
    19. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    20. Gultekin Isiklar & Kajal Lahiri & Prakash Loungani, 2006. "How quickly do forecasters incorporate news? Evidence from cross‐country surveys," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 703-725, September.
    21. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    22. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
    23. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    24. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    25. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    26. Reza Baqir & Rodney Ramcharan & Ratna Sahay, 2005. "IMF Programs and Growth: Is Optimism Defensible?," IMF Staff Papers, Palgrave Macmillan, vol. 52(2), pages 260-286, September.
    27. Ruben Atoyan & Patrick Conway, 2011. "Projecting macroeconomic outcomes: Evidence from the IMF," The Review of International Organizations, Springer, vol. 6(3), pages 415-441, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eicher, Theo S. & Kawai, Reina, 2023. "IMF trade forecasts for crisis countries: Bias, inefficiency, and their origins," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1615-1639.
    2. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    3. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    4. Klaus-Peter Hellwig, 2018. "Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections," IMF Working Papers 2018/260, International Monetary Fund.
    5. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    6. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    7. Sinclair, Tara M. & Stekler, H.O. & Carnow, Warren, 2015. "Evaluating a vector of the Fed’s forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 157-164.
    8. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    9. Jalles, João Tovar, 2017. "On the rationality and efficiency of inflation forecasts: Evidence from advanced and emerging market economies," Research in International Business and Finance, Elsevier, vol. 40(C), pages 175-189.
    10. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    11. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    12. Loungani, Prakash & Stekler, Herman & Tamirisa, Natalia, 2013. "Information rigidity in growth forecasts: Some cross-country evidence," International Journal of Forecasting, Elsevier, vol. 29(4), pages 605-621.
    13. Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
    14. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    15. Sergey V. Smirnov & Daria A. Avdeeva, 2016. "Wishful Bias in Predicting Us Recessions: Indirect Evidence," HSE Working papers WP BRP 135/EC/2016, National Research University Higher School of Economics.
    16. Carola Conces Binder & Rodrigo Sekkel, 2024. "Central bank forecasting: A survey," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 342-364, April.
    17. Aromí, J. Daniel, 2019. "Medium term growth forecasts: Experts vs. simple models," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1085-1099.
    18. Paulo Júlio & Pedro M. Esperança & João C. Fonseca, 2011. "Evaluating the forecast quality of GDP components," GEE Papers 0041 Classification-C52, , Gabinete de Estratégia e Estudos, Ministério da Economia, revised Oct 2011.
    19. Eicher, Theo S. & Kuenzel, David J. & Papageorgiou, Chris & Christofides, Charis, 2019. "Forecasts in times of crises," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1143-1159.
    20. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:431-449. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.