IDEAS home Printed from https://ideas.repec.org/p/sgo/wpaper/1209.html
   My bibliography  Save this paper

Model Selection for Factor Analysis: Some New Criteria and Performance Comparisons

Author

Listed:
  • In Choi

    (Department of Economics, Sogang University, Seoul)

Abstract

This paper derives Akaike?s (1973) Akaike information criterion (AIC), Hur- vich and Tsai?s (1989) corrected AIC, the Bayesian information criterion (BIC) of Akaike (1978) and Schwarz (1978), and Hannan and Quinn?s (1979) informa- tion criterion for factor models and studies the consistency properties of these information criteria. It also reports extensive simulation results comparing the performance of the extant and new procedures for the selection of the number of factors. The data generating process for the simulation consists of serially cor- related factors and serially and cross-sectionally correlated idiosyncratic errors. The idiosyncratic errors are either homoskedastic or heteroskedastic. Idiosyn- cratic errors with fat tails and those with outliers having a much larger variance than the rest of the errors are also considered. The simulation results show the di¡Ë culty of determining which criterion performs best. In practice, it is advisable to consider several criteria at the same time, especially BIC, Hannan and Quinn?s information criterion, Bai and Ng?s (2002) IC p2 and BIC3, and Onatski?s (2010) and Ahn and Horenstein?s (2009) eigenvalue-based criteria. The model-selection criteria considered in this paper are also applied to Stock and Watson?s (2002, 2005) data sets. The results di¢´er considerably depending on the model-selectioncriterion in use, but evidence suggesting four factors for Stock and Watson?s (2002) data and six or seven factors for Stock and Watson?s (2005) is obtainable.

Suggested Citation

  • In Choi, 2012. "Model Selection for Factor Analysis: Some New Criteria and Performance Comparisons," Working Papers 1209, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy).
  • Handle: RePEc:sgo:wpaper:1209
    as

    Download full text from publisher

    File URL: https://tinyurl.com/yukadpxv
    File Function: first version, 2012
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    2. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Lucrezia Reichlin & Giovanni Veronese, 2001. "The construction of coincident and leading indicators for the euro area business cycler of the euro area business cycle," Temi di discussione (Economic working papers) 434, Bank of Italy, Economic Research and International Relations Area.
    3. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    4. Bai, Jushan & Ng, Serena, 2010. "Instrumental Variable Estimation In A Data Rich Environment," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1577-1606, December.
    5. Schumacher Christian & Dreger Christian, 2004. "Estimating Large-Scale Factor Models for Economic Activity in Germany: Do They Outperform Simpler Models? / Die Schätzung von großen Faktormodellen für die deutsche Volkswirtschaft: Übertreffen sie ei," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 224(6), pages 731-750, December.
    6. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    7. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    8. Christian Schumacher, 2007. "Forecasting German GDP using alternative factor models based on large datasets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(4), pages 271-302.
    9. Moon, H.R.Hyungsik Roger & Perron, Benoit, 2004. "Testing for a unit root in panels with dynamic factors," Journal of Econometrics, Elsevier, vol. 122(1), pages 81-126, September.
    10. Reichlin, Lucrezia & Sala, Luca & Giannone, Domenico, 2002. "Tracking Greenspan: Systematic and Unsystematic Monetary Policy Revisited," CEPR Discussion Papers 3550, C.E.P.R. Discussion Papers.
    11. Lippi, Marco & Reichlin, Lucrezia & Hallin, Marc & Forni, Mario & Altissimo, Filippo & Cristadoro, Riccardo & Veronese, Giovanni & Bassanetti, Antonio, 2001. "EuroCOIN: A Real Time Coincident Indicator of the Euro Area Business Cycle," CEPR Discussion Papers 3108, C.E.P.R. Discussion Papers.
    12. Jushan Bai & Serena Ng, 2004. "A PANIC Attack on Unit Roots and Cointegration," Econometrica, Econometric Society, vol. 72(4), pages 1127-1177, July.
    13. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    14. Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, September.
    15. Banerjee, Anindya & Marcellino, Massimiliano, 2006. "Are there any reliable leading indicators for US inflation and GDP growth?," International Journal of Forecasting, Elsevier, vol. 22(1), pages 137-151.
    16. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    17. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    18. Forni, Mario & Giannone, Domenico & Lippi, Marco & Reichlin, Lucrezia, 2009. "Opening The Black Box: Structural Factor Models With Large Cross Sections," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1319-1347, October.
    19. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February.
    20. Anindya Banerjee & Massimiliano Marcellino & Igor Masten, 2005. "Leading Indicators for Euro‐area Inflation and GDP Growth," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 785-813, December.
    21. Amengual, Dante & Watson, Mark W., 2007. "Consistent Estimation of the Number of Dynamic Factors in a Large N and T Panel," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 91-96, January.
    22. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    23. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    24. Cristadoro, Riccardo & Forni, Mario & Reichlin, Lucrezia & Veronese, Giovanni, 2005. "A Core Inflation Indicator for the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 539-560, June.
    25. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    26. Kapetanios, George, 2004. "A note on modelling core inflation for the UK using a new dynamic factor estimation method and a large disaggregated price index dataset," Economics Letters, Elsevier, vol. 85(1), pages 63-69, October.
    27. George Kapetanios & Gonzalo Camba-Mendez, 2005. "Forecasting euro area inflation using dynamic factor measures of underlying inflation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(7), pages 491-503.
    28. Filippo Altissimo & Antonio Bassanetti & Riccardo Cristadoro & Mario Forni & Marco Lippi & Lucrezia Reichlin & Giovanni Veronese, 2001. "A real time coincident indicator of the euro area business cycle," Temi di discussione (Economic working papers) 436, Bank of Italy, Economic Research and International Relations Area.
    29. Bai, Jushan & Ng, Serena, 2007. "Determining the Number of Primitive Shocks in Factor Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 52-60, January.
    30. Peter C. B. Phillips & Donggyu Sul, 2003. "Dynamic panel estimation and homogeneity testing under cross section dependence *," Econometrics Journal, Royal Economic Society, vol. 6(1), pages 217-259, June.
    31. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    32. Ard H.J. den Reijer, 2005. "Forecasting Dutch GDP using Large Scale Factor Models," DNB Working Papers 028, Netherlands Central Bank, Research Department.
    33. George Kapetanios, 2002. "Modelling Core Inflation for the UK Using a New Dynamic Factor Estimation Method and a Large Disaggregated Price Index Dataset," Working Papers 471, Queen Mary University of London, School of Economics and Finance.
    34. Massimiliano Marcellino & Carlo A. Favero & Francesca Neglia, 2005. "Principal components at work: the empirical analysis of monetary policy with large data sets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 603-620.
    35. Francesco Moscone & Elisa Tosetti, 2009. "A Review And Comparison Of Tests Of Cross‐Section Independence In Panels," Journal of Economic Surveys, Wiley Blackwell, vol. 23(3), pages 528-561, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hevia, Constantino & Servén, Luis, 2018. "Assessing the degree of international consumption risk sharing," Journal of Development Economics, Elsevier, vol. 134(C), pages 176-190.
    2. Daniel Czarnowske & Amrei Stammann, 2020. "Inference in Unbalanced Panel Data Models with Interactive Fixed Effects," Papers 2004.03414, arXiv.org.
    3. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    4. Karen Miranda & Pilar Poncela & Esther Ruiz, 2022. "Dynamic factor models: Does the specification matter?," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 13(1), pages 397-428, May.
    5. Lena Janys & Bettina Siflinger, 2021. "Mental Health and Abortions among Young Women: Time-Varying Unobserved Heterogeneity, Health Behaviors, and Risky Decisions," ECONtribute Discussion Papers Series 083, University of Bonn and University of Cologne, Germany.
    6. Janys, Lena & Siflinger, Bettina, 2024. "Mental health and abortions among young women: time-varying unobserved heterogeneity, health behaviors, and risky decisions," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Guo, Xiao & Chen, Yu & Tang, Cheng Yong, 2023. "Information criteria for latent factor models: A study on factor pervasiveness and adaptivity," Journal of Econometrics, Elsevier, vol. 233(1), pages 237-250.
    8. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    9. Choi, In & Lin, Rui & Shin, Yongcheol, 2023. "Canonical correlation-based model selection for the multilevel factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 22-44.
    10. Byoungsoo Cho, 2020. "The Monetary Policy Reaction Function in Korea with Multi-level Factors," Korean Economic Review, Korean Economic Association, vol. 36, pages 353-376.
    11. Chen, Yunxiao & Li, Xiaoou, 2022. "Determining the number of factors in high-dimensional generalized latent factor models," LSE Research Online Documents on Economics 111574, London School of Economics and Political Science, LSE Library.
    12. Eric Hillebrand & Jakob Guldbæk Mikkelsen & Lars Spreng & Giovanni Urga, 2023. "Exchange rates and macroeconomic fundamentals: Evidence of instabilities from time‐varying factor loadings," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(6), pages 857-877, September.
    13. Davis, J. Scott & Valente, Giorgio & van Wincoop, Eric, 2021. "Global drivers of gross and net capital flows," Journal of International Economics, Elsevier, vol. 128(C).
    14. Alexander Chudik & M. Hashem Pesaran, 2013. "Large Panel Data Models with Cross-Sectional Dependence: A Survey," CESifo Working Paper Series 4371, CESifo.
    15. Luca Margaritella & Joakim Westerlund, 2023. "Using information criteria to select averages in CCE," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 405-421.
    16. Eric Hillebrand & Jakob Mikkelsen & Lars Spreng & Giovanni Urga, 2020. "Exchange Rates and Macroeconomic Fundamentals: Evidence of Instabilities from Time-Varying Factor Loadings," CREATES Research Papers 2020-19, Department of Economics and Business Economics, Aarhus University.
    17. Lena Janys & Bettina Siflinger, 2021. "Mental Health and Abortions among Young Women: Time-varying Unobserved Heterogeneity, Health Behaviors, and Risky Decisions," Papers 2103.12159, arXiv.org, revised May 2022.
    18. Zhao Zhao & Guowei Cui & Shaoping Wang, 2017. "A Monte Carlo comparison of estimating the number of dynamic factors," Empirical Economics, Springer, vol. 53(3), pages 1217-1241, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. In Choi & Dukpa Kim & Yun Jung Kim & Noh‐Sun Kwark, 2018. "A multilevel factor model: Identification, asymptotic theory and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(3), pages 355-377, April.
    2. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    3. In Choi, 2011. "Efficient Estimation of Nonstationary Factor Models," Working Papers 1101, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Jun 2011.
    4. Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    5. Jörg Breitung & In Choi, 2013. "Factor models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 11, pages 249-265, Edward Elgar Publishing.
      • In Choi & Jorg Breitung, 2011. "Factor models," Working Papers 1121, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Dec 2011.
    6. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    7. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.
    8. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    9. Forni, Mario & Cavicchioli, Maddalena & Lippi, Marco & Zaffaroni, Paolo, 2016. "Eigenvalue Ratio Estimators for the Number of Common Factors," CEPR Discussion Papers 11440, C.E.P.R. Discussion Papers.
    10. Hallin, Marc & Liska, Roman, 2011. "Dynamic factors in the presence of blocks," Journal of Econometrics, Elsevier, vol. 163(1), pages 29-41, July.
    11. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    12. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    13. Marc Hallin & Roman Liska, 2008. "Dynamic Factors in the Presence of Block Structure," Working Papers ECARES 2008_012, ULB -- Universite Libre de Bruxelles.
    14. Ergemen, Yunus Emre, 2023. "Parametric estimation of long memory in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1483-1499.
    15. Barigozzi, Matteo & Lippi, Marco & Luciani, Matteo, 2021. "Large-dimensional Dynamic Factor Models: Estimation of Impulse–Response Functions with I(1) cointegrated factors," Journal of Econometrics, Elsevier, vol. 221(2), pages 455-482.
    16. Sandra Eickmeier, 2009. "Comovements and heterogeneity in the euro area analyzed in a non-stationary dynamic factor model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 933-959.
    17. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    18. Matteo Barigozzi & Marco Lippi & Matteo Luciani, 2016. "Non-Stationary Dynamic Factor Models for Large Datasets," Finance and Economics Discussion Series 2016-024, Board of Governors of the Federal Reserve System (U.S.).
    19. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    20. Van Nieuwenhuyze, Christophe & Benk, Szilard & Rünstler, Gerhard & Cristadoro, Riccardo & Den Reijer, Ard & Jakaitiene, Audrone & Jelonek, Piotr & Rua, António & Ruth, Karsten & Barhoumi, Karim, 2008. "Short-term forecasting of GDP using large monthly datasets: a pseudo real-time forecast evaluation exercise," Occasional Paper Series 84, European Central Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sgo:wpaper:1209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jung Hur (email available below). General contact details of provider: https://edirc.repec.org/data/risogkr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.