IDEAS home Printed from https://ideas.repec.org/a/taf/emetrv/v38y2019i6p577-596.html
   My bibliography  Save this article

Model selection for factor analysis: Some new criteria and performance comparisons

Author

Listed:
  • In Choi
  • Hanbat Jeong

Abstract

This paper derives Akaike information criterion (AIC), corrected AIC, the Bayesian information criterion (BIC) and Hannan and Quinn’s information criterion for approximate factor models assuming a large number of cross-sectional observations and studies the consistency properties of these information criteria. It also reports extensive simulation results comparing the performance of the extant and new procedures for the selection of the number of factors. The simulation results show the difficulty of determining which criterion performs best. In practice, it is advisable to consider several criteria at the same time, especially Hannan and Quinn’s information criterion, Bai and Ng’s ICp2 and BIC3, and Onatski’s and Ahn and Horenstein’s eigenvalue-based criteria. The model-selection criteria considered in this paper are also applied to Stock and Watson’s two macroeconomic data sets. The results differ considerably depending on the model-selection criterion in use, but evidence suggesting five factors for the first data and five to seven factors for the second data is obtainable.

Suggested Citation

  • In Choi & Hanbat Jeong, 2019. "Model selection for factor analysis: Some new criteria and performance comparisons," Econometric Reviews, Taylor & Francis Journals, vol. 38(6), pages 577-596, July.
  • Handle: RePEc:taf:emetrv:v:38:y:2019:i:6:p:577-596
    DOI: 10.1080/07474938.2017.1382763
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07474938.2017.1382763
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/07474938.2017.1382763?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    2. Schumacher Christian & Dreger Christian, 2004. "Estimating Large-Scale Factor Models for Economic Activity in Germany: Do They Outperform Simpler Models? / Die Schätzung von großen Faktormodellen für die deutsche Volkswirtschaft: Übertreffen sie ei," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 224(6), pages 731-750, December.
    3. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    4. Moon, H.R.Hyungsik Roger & Perron, Benoit, 2004. "Testing for a unit root in panels with dynamic factors," Journal of Econometrics, Elsevier, vol. 122(1), pages 81-126, September.
    5. Reichlin, Lucrezia & Sala, Luca & Giannone, Domenico, 2002. "Tracking Greenspan: Systematic and Unsystematic Monetary Policy Revisited," CEPR Discussion Papers 3550, C.E.P.R. Discussion Papers.
    6. Lippi, Marco & Reichlin, Lucrezia & Hallin, Marc & Forni, Mario & Altissimo, Filippo & Cristadoro, Riccardo & Veronese, Giovanni & Bassanetti, Antonio, 2001. "EuroCOIN: A Real Time Coincident Indicator of the Euro Area Business Cycle," CEPR Discussion Papers 3108, C.E.P.R. Discussion Papers.
    7. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    8. Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, September.
    9. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    10. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    11. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    12. Banerjee, Anindya & Marcellino, Massimiliano, 2006. "Are there any reliable leading indicators for US inflation and GDP growth?," International Journal of Forecasting, Elsevier, vol. 22(1), pages 137-151.
    13. Jushan Bai & Serena Ng, 2004. "A PANIC Attack on Unit Roots and Cointegration," Econometrica, Econometric Society, vol. 72(4), pages 1127-1177, July.
    14. Cristadoro, Riccardo & Forni, Mario & Reichlin, Lucrezia & Veronese, Giovanni, 2005. "A Core Inflation Indicator for the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 539-560, June.
    15. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    16. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    17. Forni, Mario & Giannone, Domenico & Lippi, Marco & Reichlin, Lucrezia, 2009. "Opening The Black Box: Structural Factor Models With Large Cross Sections," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1319-1347, October.
    18. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2005. "Leading Indicators for Euro‐area Inflation and GDP Growth," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 785-813, December.
    19. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    20. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    21. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    22. Massimiliano Marcellino & Carlo A. Favero & Francesca Neglia, 2005. "Principal components at work: the empirical analysis of monetary policy with large data sets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 603-620.
    23. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Lucrezia Reichlin & Giovanni Veronese, 2001. "The construction of coincident and leading indicators for the euro area business cycler of the euro area business cycle," Temi di discussione (Economic working papers) 434, Bank of Italy, Economic Research and International Relations Area.
    24. Bai, Jushan & Ng, Serena, 2010. "Instrumental Variable Estimation In A Data Rich Environment," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1577-1606, December.
    25. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    26. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    27. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    28. Amengual, Dante & Watson, Mark W., 2007. "Consistent Estimation of the Number of Dynamic Factors in a Large N and T Panel," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 91-96, January.
    29. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    30. Kapetanios, George, 2004. "A note on modelling core inflation for the UK using a new dynamic factor estimation method and a large disaggregated price index dataset," Economics Letters, Elsevier, vol. 85(1), pages 63-69, October.
    31. George Kapetanios & Gonzalo Camba-Mendez, 2005. "Forecasting euro area inflation using dynamic factor measures of underlying inflation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(7), pages 491-503.
    32. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Mario Forni & Marco Lippi & Lucrezia Reichlin & Giovanni Veronese, 2001. "A real time coincident indicator of the euro area business cycle," Temi di discussione (Economic working papers) 436, Bank of Italy, Economic Research and International Relations Area.
    33. Peter C. B. Phillips & Donggyu Sul, 2003. "Dynamic panel estimation and homogeneity testing under cross section dependence *," Econometrics Journal, Royal Economic Society, vol. 6(1), pages 217-259, June.
    34. George Kapetanios, 2002. "Modelling Core Inflation for the UK Using a New Dynamic Factor Estimation Method and a Large Disaggregated Price Index Dataset," Working Papers 471, Queen Mary University of London, School of Economics and Finance.
    35. Francesco Moscone & Elisa Tosetti, 2009. "A Review And Comparison Of Tests Of Cross‐Section Independence In Panels," Journal of Economic Surveys, Wiley Blackwell, vol. 23(3), pages 528-561, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hevia, Constantino & Servén, Luis, 2018. "Assessing the degree of international consumption risk sharing," Journal of Development Economics, Elsevier, vol. 134(C), pages 176-190.
    2. Daniel Czarnowske & Amrei Stammann, 2020. "Inference in Unbalanced Panel Data Models with Interactive Fixed Effects," Papers 2004.03414, arXiv.org.
    3. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    4. Karen Miranda & Pilar Poncela & Esther Ruiz, 2022. "Dynamic factor models: Does the specification matter?," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 13(1), pages 397-428, May.
    5. Lena Janys & Bettina Siflinger, 2021. "Mental Health and Abortions among Young Women: Time-Varying Unobserved Heterogeneity, Health Behaviors, and Risky Decisions," ECONtribute Discussion Papers Series 083, University of Bonn and University of Cologne, Germany.
    6. Janys, Lena & Siflinger, Bettina, 2024. "Mental health and abortions among young women: time-varying unobserved heterogeneity, health behaviors, and risky decisions," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Guo, Xiao & Chen, Yu & Tang, Cheng Yong, 2023. "Information criteria for latent factor models: A study on factor pervasiveness and adaptivity," Journal of Econometrics, Elsevier, vol. 233(1), pages 237-250.
    8. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    9. Choi, In & Lin, Rui & Shin, Yongcheol, 2023. "Canonical correlation-based model selection for the multilevel factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 22-44.
    10. Byoungsoo Cho, 2020. "The Monetary Policy Reaction Function in Korea with Multi-level Factors," Korean Economic Review, Korean Economic Association, vol. 36, pages 353-376.
    11. Chen, Yunxiao & Li, Xiaoou, 2022. "Determining the number of factors in high-dimensional generalized latent factor models," LSE Research Online Documents on Economics 111574, London School of Economics and Political Science, LSE Library.
    12. Eric Hillebrand & Jakob Guldbæk Mikkelsen & Lars Spreng & Giovanni Urga, 2023. "Exchange rates and macroeconomic fundamentals: Evidence of instabilities from time‐varying factor loadings," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(6), pages 857-877, September.
    13. Davis, J. Scott & Valente, Giorgio & van Wincoop, Eric, 2021. "Global drivers of gross and net capital flows," Journal of International Economics, Elsevier, vol. 128(C).
    14. Alexander Chudik & M. Hashem Pesaran, 2013. "Large Panel Data Models with Cross-Sectional Dependence: A Survey," CESifo Working Paper Series 4371, CESifo.
    15. Luca Margaritella & Joakim Westerlund, 2023. "Using information criteria to select averages in CCE," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 405-421.
    16. Eric Hillebrand & Jakob Mikkelsen & Lars Spreng & Giovanni Urga, 2020. "Exchange Rates and Macroeconomic Fundamentals: Evidence of Instabilities from Time-Varying Factor Loadings," CREATES Research Papers 2020-19, Department of Economics and Business Economics, Aarhus University.
    17. Lena Janys & Bettina Siflinger, 2021. "Mental Health and Abortions among Young Women: Time-varying Unobserved Heterogeneity, Health Behaviors, and Risky Decisions," Papers 2103.12159, arXiv.org, revised May 2022.
    18. Zhao Zhao & Guowei Cui & Shaoping Wang, 2017. "A Monte Carlo comparison of estimating the number of dynamic factors," Empirical Economics, Springer, vol. 53(3), pages 1217-1241, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. In Choi & Dukpa Kim & Yun Jung Kim & Noh‐Sun Kwark, 2018. "A multilevel factor model: Identification, asymptotic theory and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(3), pages 355-377, April.
    2. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    3. In Choi, 2011. "Efficient Estimation of Nonstationary Factor Models," Working Papers 1101, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Jun 2011.
    4. Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    5. Jörg Breitung & In Choi, 2013. "Factor models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 11, pages 249-265, Edward Elgar Publishing.
      • In Choi & Jorg Breitung, 2011. "Factor models," Working Papers 1121, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Dec 2011.
    6. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    7. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    8. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.
    9. Forni, Mario & Cavicchioli, Maddalena & Lippi, Marco & Zaffaroni, Paolo, 2016. "Eigenvalue Ratio Estimators for the Number of Common Factors," CEPR Discussion Papers 11440, C.E.P.R. Discussion Papers.
    10. Hallin, Marc & Liska, Roman, 2011. "Dynamic factors in the presence of blocks," Journal of Econometrics, Elsevier, vol. 163(1), pages 29-41, July.
    11. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    12. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    13. Marc Hallin & Roman Liska, 2008. "Dynamic Factors in the Presence of Block Structure," Working Papers ECARES 2008_012, ULB -- Universite Libre de Bruxelles.
    14. Ergemen, Yunus Emre, 2023. "Parametric estimation of long memory in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1483-1499.
    15. Barigozzi, Matteo & Lippi, Marco & Luciani, Matteo, 2021. "Large-dimensional Dynamic Factor Models: Estimation of Impulse–Response Functions with I(1) cointegrated factors," Journal of Econometrics, Elsevier, vol. 221(2), pages 455-482.
    16. Sandra Eickmeier, 2009. "Comovements and heterogeneity in the euro area analyzed in a non-stationary dynamic factor model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 933-959.
    17. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    18. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    19. K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze & G. Rünstler, 2008. "Short-term forecasting of GDP using large monthly datasets – A pseudo real-time forecast evaluation exercise," Working Paper Research 133, National Bank of Belgium.
    20. Yunus Emre Ergemen, 2022. "Parametric Estimation of Long Memory in Factor Models," CREATES Research Papers 2022-10, Department of Economics and Business Economics, Aarhus University.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:38:y:2019:i:6:p:577-596. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.tandfonline.com/LECR20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.