IDEAS home Printed from https://ideas.repec.org/a/anr/reveco/v10y2018p615-643.html
   My bibliography  Save this article

Macroeconomic Nowcasting and Forecasting with Big Data

Author

Listed:
  • Brandyn Bok

    (Federal Reserve Bank of New York, New York, New York 10045, USA)

  • Daniele Caratelli

    (Department of Economics, Stanford University, Stanford, California 94305, USA)

  • Domenico Giannone

    (Federal Reserve Bank of New York, New York, New York 10045, USA)

  • Argia M. Sbordone

    (Federal Reserve Bank of New York, New York, New York 10045, USA)

  • Andrea Tambalotti

    (Federal Reserve Bank of New York, New York, New York 10045, USA)

Abstract

Data, data, data…. Economists know their importance well, especially when it comes to monitoring macroeconomic conditions—the basis for making informed economic and policy decisions. Handling large and complex data sets was a challenge that macroeconomists engaged in real-time analysis faced long before so-called big data became pervasive in other disciplines. We review how methods for tracking economic conditions using big data have evolved over time and explain how econometric techniques have advanced to mimic and automate best practices of forecasters on trading desks, at central banks, and in other market-monitoring roles. We present in detail the methodology underlying the New York Fed Staff Nowcast, which employs these innovative techniques to produce early estimates of GDP growth, synthesizing a wide range of macroeconomic data as they become available.Data, data, data... Economists know their importance well, especially when it comes to monitoring macroeconomic conditions?the basis for making informed economic and policy decisions. Handling large and complex data sets was a challenge that macroeconomists engaged in real-time analysis faced long before so-called big data became pervasive in other disciplines. We review how methods for tracking economic conditions using big data have evolved over time and explain how econometric techniques have advanced to mimic and automate best practices of forecasters on trading desks, at central banks, and in other market-monitoring roles. We present in detail the methodology underlying the New York Fed Staff Nowcast, which employs these innovative techniques to produce early estimates of GDP growth, synthesizing a wide range of macroeconomic data as they become available.

Suggested Citation

  • Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
  • Handle: RePEc:anr:reveco:v:10:y:2018:p:615-643
    DOI: 10.1146/annurev-economics-080217-053214
    as

    Download full text from publisher

    File URL: https://doi.org/10.1146/annurev-economics-080217-053214
    Download Restriction: Full text downloads are only available to subscribers. Visit the abstract page for more information.

    File URL: https://libkey.io/10.1146/annurev-economics-080217-053214?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    2. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    3. Don Harding & Adrian Pagan, 2016. "The Econometric Analysis of Recurrent Events in Macroeconomics and Finance," Economics Books, Princeton University Press, edition 1, number 10744.
    4. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    5. Juan Antolin-Diaz & Thomas Drechsel & Ivan Petrella, 2017. "Tracking the Slowdown in Long-Run GDP Growth," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 343-356, May.
    6. Altavilla, Carlo & Giannone, Domenico & Modugno, Michele, 2017. "Low frequency effects of macroeconomic news on government bond yields," Journal of Monetary Economics, Elsevier, vol. 92(C), pages 31-46.
    7. Alain Kabundi & Elmarie Nel & Franz Ruch, 2016. "Nowcasting Real GDP growth in South Africa," Working Papers 54, Economic Research Southern Africa.
    8. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    9. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    10. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    11. G. Rünstler & K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze, 2009. "Short-term forecasting of GDP using large datasets: a pseudo real-time forecast evaluation exercise," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(7), pages 595-611.
    12. Gary Koop, 2017. "Bayesian Methods for Empirical Macroeconomics," Review of Economic Analysis, Digital Initiatives at the University of Waterloo Library, vol. 9(1), pages 33-56, June.
    13. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    14. Knotek, Edward S. & Zaman, Saeed, 2019. "Financial nowcasts and their usefulness in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1708-1724.
    15. Lahiri, Kajal & Monokroussos, George, 2013. "Nowcasting US GDP: The role of ISM business surveys," International Journal of Forecasting, Elsevier, vol. 29(4), pages 644-658.
    16. Harding, Don & Pagan, Adrian, 2002. "Dissecting the cycle: a methodological investigation," Journal of Monetary Economics, Elsevier, vol. 49(2), pages 365-381, March.
    17. Refet S. Gürkaynak & Jonathan H. Wright, 2013. "Identification and Inference Using Event Studies," Manchester School, University of Manchester, vol. 81, pages 48-65, September.
    18. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    19. Knut Aastveit & Tørres Trovik, 2012. "Nowcasting norwegian GDP: the role of asset prices in a small open economy," Empirical Economics, Springer, vol. 42(1), pages 95-119, February.
    20. Leonardo Bartolini & Linda S. Goldberg & Adam Sacarny, 2008. "How economic news moves markets," Current Issues in Economics and Finance, Federal Reserve Bank of New York, vol. 14(Aug).
    21. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    22. Patrick C. Higgins, 2014. "GDPNow: A Model for GDP \"Nowcasting\"," FRB Atlanta Working Paper 2014-7, Federal Reserve Bank of Atlanta.
    23. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    24. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    25. Tobias Adrian & Nina Boyarchenko & Domenico Giannone, 2019. "Vulnerable Growth," American Economic Review, American Economic Association, vol. 109(4), pages 1263-1289, April.
    26. Kurt Graden Lunsford, 2017. "Lingering Residual Seasonality in GDP Growth," Economic Commentary, Federal Reserve Bank of Cleveland, issue March.
    27. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    28. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    29. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Bayesian VARs: Specification Choices and Forecast Accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 46-73, January.
    30. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    31. repec:hal:journl:peer-00844811 is not listed on IDEAS
    32. Matheson, Troy D., 2010. "An analysis of the informational content of New Zealand data releases: The importance of business opinion surveys," Economic Modelling, Elsevier, vol. 27(1), pages 304-314, January.
    33. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 569-594, Emerald Group Publishing Limited.
    34. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    35. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    36. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    37. Joelle Liebermann, 2014. "Real-Time Nowcasting of GDP: A Factor Model vs. Professional Forecasters," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(6), pages 783-811, December.
    38. Charles E. Gilbert & Norman J. Morin & Andrew D. Paciorek & Claudia R. Sahm, 2015. "Residual Seasonality in GDP," FEDS Notes 2015-05-14, Board of Governors of the Federal Reserve System (U.S.).
    39. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    40. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    41. Arthur F. Burns & Wesley C. Mitchell, 1946. "Measuring Business Cycles," NBER Books, National Bureau of Economic Research, Inc, number burn46-1.
    42. Gerhard Bry & Charlotte Boschan, 1971. "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs," NBER Books, National Bureau of Economic Research, Inc, number bry_71-1.
    43. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    44. Tim Mahedy & Glenn D. Rudebusch & Daniel J. Wilson, 2015. "The puzzle of weak first-quarter GDP growth," FRBSF Economic Letter, Federal Reserve Bank of San Francisco.
    45. Gerhard Bry & Charlotte Boschan, 1971. "Foreword to "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs"," NBER Chapters, in: Cyclical Analysis of Time Series: Selected Procedures and Computer Programs, pages -1, National Bureau of Economic Research, Inc.
    46. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    47. Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Finance and Economics Discussion Series 2005-42, Board of Governors of the Federal Reserve System (U.S.).
    48. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    49. Alberto Caruso, 2015. "Nowcasting Mexican GDP," Working Papers ECARES ECARES 2015-40, ULB -- Universite Libre de Bruxelles.
    50. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    51. Keith R. Phillips & Jack Wang, 2016. "Residual seasonality in U.S. GDP data," Working Papers 1608, Federal Reserve Bank of Dallas.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    2. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    3. Cascaldi-Garcia, Danilo & Ferreira, Thiago R.T. & Giannone, Domenico & Modugno, Michele, 2024. "Back to the present: Learning about the euro area through a now-casting model," International Journal of Forecasting, Elsevier, vol. 40(2), pages 661-686.
    4. Caruso, Alberto, 2018. "Nowcasting with the help of foreign indicators: The case of Mexico," Economic Modelling, Elsevier, vol. 69(C), pages 160-168.
    5. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    6. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2023. "Lessons from Nowcasting GDP across the World," International Finance Discussion Papers 1385, Board of Governors of the Federal Reserve System (U.S.).
    7. Bragoli, Daniela & Modugno, Michele, 2017. "A now-casting model for Canada: Do U.S. variables matter?," International Journal of Forecasting, Elsevier, vol. 33(4), pages 786-800.
    8. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    9. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    10. Martha Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Nowcasting," Working Papers ECARES ECARES 2010-021, ULB -- Universite Libre de Bruxelles.
    11. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    12. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    13. Caruso, Alberto, 2019. "Macroeconomic news and market reaction: Surprise indexes meet nowcasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1725-1734.
    14. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    15. Tóth, Peter, 2014. "Malý dynamický faktorový model na krátkodobé prognózovanie slovenského HDP [A Small Dynamic Factor Model for the Short-Term Forecasting of Slovak GDP]," MPRA Paper 63713, University Library of Munich, Germany.
    16. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    17. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 569-594, Emerald Group Publishing Limited.
    18. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    19. Matteo Luciani & Madhavi Pundit & Arief Ramayandi & Giovanni Veronese, 2018. "Nowcasting Indonesia," Empirical Economics, Springer, vol. 55(2), pages 597-619, September.
    20. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.

    More about this item

    Keywords

    business cycle analysis; high-dimensional data; monitoring economic conditions; real-time data flow;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:anr:reveco:v:10:y:2018:p:615-643. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: http://www.annualreviews.org (email available below). General contact details of provider: http://www.annualreviews.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.