IDEAS home Printed from https://ideas.repec.org/p/fip/fednsr/363.html
   My bibliography  Save this paper

Model selection criteria for factor-augmented regressions

Author

Abstract

In a factor-augmented regression, the forecast of a variable depends on a few factors estimated from a large number of predictors. But how does one determine the appropriate number of factors relevant for such a regression? Existing work has focused on criteria that can consistently estimate the appropriate number of factors in a large-dimensional panel of explanatory variables. However, not all of these factors are necessarily relevant for modeling a specific dependent variable within a factor-augmented regression. This paper develops a number of theoretical conditions that selection criteria must fulfill in order to provide a consistent estimate of the factor dimension relevant for a factor-augmented regression. Our framework takes into account factor estimation error and does not depend on a specific factor estimation methodology. It also provides, as a by-product, a template for developing selection criteria for regressions that include standard generated regressors. The conditions make it clear that standard model selection criteria do not provide a consistent estimate of the factor dimension in a factor-augmented regression. We propose alternative criteria that do fulfill our conditions. These criteria essentially modify standard information criteria so that the corresponding penalty function for dimensionality also penalizes factor estimation error. We show through Monte Carlo and empirical applications that these modified information criteria are useful in determining the appropriate dimensions of factor-augmented regressions.

Suggested Citation

  • Jan J. J. Groen & George Kapetanios, 2009. "Model selection criteria for factor-augmented regressions," Staff Reports 363, Federal Reserve Bank of New York.
  • Handle: RePEc:fip:fednsr:363
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr363.html
    Download Restriction: no

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr363.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    2. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    3. Groen, Jan J.J. & Kapetanios, George, 2016. "Revisiting useful approaches to data-rich macroeconomic forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 221-239.
    4. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    5. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    6. Marianne Sensier & Dick van Dijk, 2004. "Testing for Volatility Changes in U.S. Macroeconomic Time Series," The Review of Economics and Statistics, MIT Press, vol. 86(3), pages 833-839, August.
    7. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    8. repec:wop:calsdi:96-17 is not listed on IDEAS
    9. Wouter Denhaan & Andrew T. Levin, 1996. "VARHAC Covariance Matrix Estimator (GAUSS)," QM&RBC Codes 64, Quantitative Macroeconomics & Real Business Cycles.
    10. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    11. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    12. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    13. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John W. Galbraith & Victoria Zinde-Walsh, 2011. "Partially Dimension-Reduced Regressions with Potentially Infinite-Dimensional Processes," CIRANO Working Papers 2011s-57, CIRANO.
    2. Menzie Chinn & Kavan Kucko, 2015. "The Predictive Power of the Yield Curve Across Countries and Time," International Finance, Wiley Blackwell, vol. 18(2), pages 129-156, June.
    3. Jan J. J. Groen & Paolo A. Pesenti, 2011. "Commodity Prices, Commodity Currencies, and Global Economic Developments," NBER Chapters, in: Commodity Prices and Markets, pages 15-42, National Bureau of Economic Research, Inc.
    4. Westerlund, Joakim & Urbain, Jean-Pierre, 2013. "On the implementation and use of factor-augmented regressions in panel data," Journal of Asian Economics, Elsevier, vol. 28(C), pages 3-11.
    5. Kapetanios, George & Price, Simon & Young, Garry, 2018. "A UK financial conditions index using targeted data reduction: Forecasting and structural identification," Econometrics and Statistics, Elsevier, vol. 7(C), pages 1-17.
    6. Antoine A. Djogbenou, 2021. "Model selection in factor-augmented regressions with estimated factors," Econometric Reviews, Taylor & Francis Journals, vol. 40(5), pages 470-503, April.
    7. Panagiotidis, Theodore & Stengos, Thanasis & Vravosinos, Orestis, 2019. "The effects of markets, uncertainty and search intensity on bitcoin returns," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 220-242.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Groen, Jan J.J. & Kapetanios, George, 2016. "Revisiting useful approaches to data-rich macroeconomic forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 221-239.
    2. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    3. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.
    4. Simona Delle Chiaie & Laurent Ferrara & Domenico Giannone, 2022. "Common factors of commodity prices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 461-476, April.
    5. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    6. Barigozzi, Matteo & Hallin, Marc & Luciani, Matteo & Zaffaroni, Paolo, 2024. "Inferential theory for generalized dynamic factor models," Journal of Econometrics, Elsevier, vol. 239(2).
    7. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    8. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    9. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    10. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    11. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    12. Varlam Kutateladze, 2021. "The Kernel Trick for Nonlinear Factor Modeling," Papers 2103.01266, arXiv.org.
    13. Kutateladze, Varlam, 2022. "The kernel trick for nonlinear factor modeling," International Journal of Forecasting, Elsevier, vol. 38(1), pages 165-177.
    14. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    15. Matteo Barigozzi & Antonio M. Conti & Matteo Luciani, 2014. "Do Euro Area Countries Respond Asymmetrically to the Common Monetary Policy?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 693-714, October.
    16. Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Papers 1910.03821, arXiv.org, revised Sep 2024.
    17. Kirstin Hubrich & Guenter Beck & Massimiliano Marcellino, 2000. "Regional Inflation Dynamics within and across Euro Area Countries and a Comparison with the US," Regional and Urban Modeling 283600037, EcoMod.
    18. Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
    19. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    20. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.

    More about this item

    Keywords

    Regression analysis; Econometric models; time series analysis; Forecasting;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednsr:363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.