IDEAS home Printed from https://ideas.repec.org/p/mod/wcefin/0070.html
   My bibliography  Save this paper

The Forecasting Performance of Dynamic Factor Models with Vintage Data

Author

Listed:
  • Luca Di Bonaventura
  • Mario Forni
  • Francesco Pattarin

Abstract

We present a comparative analysis of the forecasting performance of two dynamic factor models, the Stock and Watson (2002a, b) model and the Forni, Hallin, Lippi and Reichlin (2005) model, based on vintage data. Our dataset that contains 107 monthly US “first release” macroeconomic and financial vintage time series, spanning the 1996:12 to 2017:6 period with monthly periodicity, extracted from the Bloomberg database†. We compute real-time one-month-ahead forecasts with both models for four key macroeconomic variables: the month-on-month change in industrial production, the unemployment rate, the core consumer price index and the ISM Purchasing Managers’ Index. First, we find that both the Stock and Watson and the Forni, Hallin, Lippi and Reichlin models outperform simple autoregressions for industrial production, unemployment rate and consumer prices, but that only the first model does so for the PMI. Second, we find that neither models always outperform the other. While Forni, Hallin, Lippi and Reichlin’s beats Stock and Watson’s in forecasting industrial production and consumer prices, the opposite happens for the unemployment rate and the PMI.

Suggested Citation

  • Luca Di Bonaventura & Mario Forni & Francesco Pattarin, 2018. "The Forecasting Performance of Dynamic Factor Models with Vintage Data," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0070, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
  • Handle: RePEc:mod:wcefin:0070
    as

    Download full text from publisher

    File URL: http://155.185.68.2/CefinPaper/CEFIN-WP70.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    2. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    3. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2015. "Dynamic factor models with infinite-dimensional factor spaces: One-sided representations," Journal of Econometrics, Elsevier, vol. 185(2), pages 359-371.
    4. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    5. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    6. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2017. "Dynamic factor models with infinite-dimensional factor space: Asymptotic analysis," Journal of Econometrics, Elsevier, vol. 199(1), pages 74-92.
    7. Mario Forni & Alessandro Giovannelli & Marco Lippi & Stefano Soccorsi, 2018. "Dynamic factor model with infinite‐dimensional factor space: Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 625-642, August.
    8. Forni, Mario & Giannone, Domenico & Lippi, Marco & Reichlin, Lucrezia, 2009. "Opening The Black Box: Structural Factor Models With Large Cross Sections," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1319-1347, October.
    9. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    10. Forni, Mario & Lippi, Marco, 2001. "The Generalized Dynamic Factor Model: Representation Theory," Econometric Theory, Cambridge University Press, vol. 17(6), pages 1113-1141, December.
    11. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    12. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    13. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    14. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    15. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    16. Alessi, Lucia & Barigozzi, Matteo & Capasso, Marco, 2010. "Improved penalization for determining the number of factors in approximate factor models," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1806-1813, December.
    17. Lippi, Marco & Reichlin, Lucrezia & Forni, Mario, 2003. "Opening the Black Box: Structural Factor Models versus Structural VARs," CEPR Discussion Papers 4133, C.E.P.R. Discussion Papers.
    18. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    19. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    20. George Kapetanios & Massimiliano Marcellino, 2009. "A parametric estimation method for dynamic factor models of large dimensions," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 208-238, March.
    21. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    22. F. Della Marra, 2017. "A forecasting performance comparison of dynamic factor models based on static and dynamic methods," Economics Department Working Papers 2017-ME01, Department of Economics, Parma University (Italy).
    23. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carlos Cesar Trucios-Maza & João H. G Mazzeu & Luis K. Hotta & Pedro L. Valls Pereira & Marc Hallin, 2019. "On the robustness of the general dynamic factor model with infinite-dimensional space: identification, estimation, and forecasting," Working Papers ECARES 2019-32, ULB -- Universite Libre de Bruxelles.
    2. Matteo Barigozzi & Marc Hallin & Stefano Soccorsi, 2019. "Time-Varying General Dynamic Factor Models and the Measurement of Financial Connectedness," Working Papers ECARES 2019-09, ULB -- Universite Libre de Bruxelles.
    3. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    4. Fan Yang & Robert C. Qiu & Zenan Ling & Xing He & Haosen Yang, 2019. "Detection and Analysis of Multiple Events Based on High-Dimensional Factor Models in Power Grid," Energies, MDPI, vol. 12(7), pages 1-16, April.
    5. Beatrice Bertelli & Gianna Boero & Costanza Torricelli, 2021. "The market price of greenness A factor pricing approach for Green Bonds," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0083, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    6. Marianna Brunetti & Roberta De Luca, 2023. "Pre-selection in cointegration-based pairs trading," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(5), pages 1611-1640, December.
    7. Costanza Torricelli & Eleonora Pellati, 2022. "Social Bonds and the “Social Premiumâ€," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0085, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    8. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    9. Lucchetti, Riccardo & Venetis, Ioannis A., 2020. "A replication of "A quasi-maximum likelihood approach for large, approximate dynamic factor models" (Review of Economics and Statistics, 2012)," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 14, pages 1-14.
    10. Barigozzi, Matteo & Hallin, Marc & Soccorsi, Stefano & von Sachs, Rainer, 2021. "Time-varying general dynamic factor models and the measurement of financial connectedness," Journal of Econometrics, Elsevier, vol. 222(1), pages 324-343.
    11. Barigozzi, Matteo & Hallin, Marc & Luciani, Matteo & Zaffaroni, Paolo, 2024. "Inferential theory for generalized dynamic factor models," Journal of Econometrics, Elsevier, vol. 239(2).
    12. Siegfried Hörmann & Gilles Nisol, 2021. "Prediction of Singular VARs and an Application to Generalized Dynamic Factor Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(3), pages 295-313, May.
    13. Trucíos, Carlos & Mazzeu, João H.G. & Hotta, Luiz K. & Valls Pereira, Pedro L. & Hallin, Marc, 2021. "Robustness and the general dynamic factor model with infinite-dimensional space: Identification, estimation, and forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1520-1534.
    14. Chiara Pederzoli & Costanza Torricelli, 2019. "The impact of the Fundamental Review of the Trading Book: A preliminary assessment on a stylized portfolio," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0075, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    15. Marc Hallin, 2022. "Manfred Deistler and the General Dynamic Factor Model Approach to the Analysis of High-Dimensional Time Series," Working Papers ECARES 2022-30, ULB -- Universite Libre de Bruxelles.
    16. Costanza Torricelli & Fabio Ferrari, 2022. "Climate Stress Test: bad (or good) news for the market? An Event Study Analysis on Euro Zone Banks," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0086, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    17. Costanza Torricelli & Beatrice Bertelli, 2022. "ESG compliant optimal portfolios: The impact of ESG constraints on portfolio optimization in a sample of European stocks," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0088, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    18. Francesca Arnaboldi, Francesca Gioia, 2019. "Portfolio choice: Evidence from new-borns," Centro Studi di Banca e Finanza (CEFIN) (Center for Studies in Banking and Finance) 0078, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Barigozzi & Marco Lippi & Matteo Luciani, 2016. "Non-Stationary Dynamic Factor Models for Large Datasets," Finance and Economics Discussion Series 2016-024, Board of Governors of the Federal Reserve System (U.S.).
    2. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    3. Barigozzi, Matteo & Lippi, Marco & Luciani, Matteo, 2021. "Large-dimensional Dynamic Factor Models: Estimation of Impulse–Response Functions with I(1) cointegrated factors," Journal of Econometrics, Elsevier, vol. 221(2), pages 455-482.
    4. Mario Forni & Alessandro Giovannelli & Marco Lippi & Stefano Soccorsi, 2018. "Dynamic factor model with infinite‐dimensional factor space: Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 625-642, August.
    5. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    6. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2017. "Dynamic factor models with infinite-dimensional factor space: Asymptotic analysis," Journal of Econometrics, Elsevier, vol. 199(1), pages 74-92.
    7. Trucíos, Carlos & Mazzeu, João H.G. & Hotta, Luiz K. & Valls Pereira, Pedro L. & Hallin, Marc, 2021. "Robustness and the general dynamic factor model with infinite-dimensional space: Identification, estimation, and forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1520-1534.
    8. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    9. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    10. Carlos Cesar Trucios-Maza & João H. G Mazzeu & Luis K. Hotta & Pedro L. Valls Pereira & Marc Hallin, 2019. "On the robustness of the general dynamic factor model with infinite-dimensional space: identification, estimation, and forecasting," Working Papers ECARES 2019-32, ULB -- Universite Libre de Bruxelles.
    11. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    12. Matteo Barigozzi & Marco Lippi & Matteo Luciani, 2014. "Dynamic Factor Models, Cointegration and Error Correction Mechanisms," Working Papers ECARES ECARES 2014-14, ULB -- Universite Libre de Bruxelles.
    13. Barigozzi, Matteo & Hallin, Marc & Luciani, Matteo & Zaffaroni, Paolo, 2024. "Inferential theory for generalized dynamic factor models," Journal of Econometrics, Elsevier, vol. 239(2).
    14. Forni, Mario & Cavicchioli, Maddalena & Lippi, Marco & Zaffaroni, Paolo, 2016. "Eigenvalue Ratio Estimators for the Number of Common Factors," CEPR Discussion Papers 11440, C.E.P.R. Discussion Papers.
    15. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    16. Philipp Gersing & Christoph Rust & Manfred Deistler, 2023. "Weak Factors are Everywhere," Papers 2307.10067, arXiv.org, revised Jan 2024.
    17. Juho Koistinen & Bernd Funovits, 2022. "Estimation of Impulse-Response Functions with Dynamic Factor Models: A New Parametrization," Papers 2202.00310, arXiv.org, revised Feb 2022.
    18. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    19. Matteo Luciani, 2015. "Monetary Policy and the Housing Market: A Structural Factor Analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 199-218, March.
    20. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.

    More about this item

    Keywords

    Dynamic factor models; Forecasting; Forecasting Performance; Vintage data; First release data;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mod:wcefin:0070. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giuseppe Marotta (email available below). General contact details of provider: https://edirc.repec.org/data/demodit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.