IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/9829.html
   My bibliography  Save this paper

Are More Data Always Better for Factor Analysis?

Author

Listed:
  • Jean Boivin
  • Serena Ng

Abstract

Factors estimated from large macroeconomic panels are being used in an increasing number of applications. However, little is known about how the size and the composition of the data affect the factor estimates. In this paper, we question whether it is possible to use more series to extract the factors, and yet the resulting factors are less useful for forecasting, and the answer is yes. Such a problem tends to arise when the idiosyncratic errors are cross-correlated. It can also arise if forecasting power is provided by a factor that is dominant in a small dataset but is a dominated factor in a larger dataset. In a real time forecasting exercise, we find that factors extracted from as few as 40 pre-screened series often yield satisfactory or even better results than using all 147 series. Weighting the data by their properties when constructing the factors also lead to improved forecasts. Our simulation analysis is unique in that special attention is paid to cross-correlated idiosyncratic errors, and we also allow the factors to have stronger loadings on some groups of series than others. It thus allows us to better understand the properties of the principal components estimator in empirical applications.

Suggested Citation

  • Jean Boivin & Serena Ng, 2003. "Are More Data Always Better for Factor Analysis?," NBER Working Papers 9829, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:9829
    Note: ME
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w9829.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. George Kapetanios & Massimiliano Marcellino, 2003. "A Comparison of Estimation Methods for Dynamic Factor Models of Large Dimensions," Working Papers 489, Queen Mary University of London, School of Economics and Finance.
    4. Reichlin, Lucrezia & Sala, Luca & Giannone, Domenico, 2002. "Tracking Greenspan: Systematic and Unsystematic Monetary Policy Revisited," CEPR Discussion Papers 3550, C.E.P.R. Discussion Papers.
    5. Forni, Mario, et al, 2001. "Coincident and Leading Indicators for the Euro Area," Economic Journal, Royal Economic Society, vol. 111(471), pages 62-85, May.
    6. Reichlin, Lucrezia & Forni, Mario & Cristadoro, Riccardo & Veronese, Giovanni, 2001. "A Core Inflation Index for the Euro Area," CEPR Discussion Papers 3097, C.E.P.R. Discussion Papers.
    7. Jushan Bai & Serena Ng, 2004. "A PANIC Attack on Unit Roots and Cointegration," Econometrica, Econometric Society, vol. 72(4), pages 1127-1177, July.
    8. Mario Forni & Lucrezia Reichlin, 1998. "Let's Get Real: A Factor Analytical Approach to Disaggregated Business Cycle Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 453-473.
    9. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
    10. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    11. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    12. Forni, Mario & Lippi, Marco, 1997. "Aggregation and the Microfoundations of Dynamic Macroeconomics," OUP Catalogue, Oxford University Press, number 9780198288008.
    13. Forni, Mario & Lippi, Marco, 2001. "The Generalized Dynamic Factor Model: Representation Theory," Econometric Theory, Cambridge University Press, vol. 17(6), pages 1113-1141, December.
    14. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    15. Robert Inklaar & Jan Jacobs & Ward Romp, 2005. "Business Cycle Indexes: Does a Heap of Data Help?," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2004(3), pages 309-336.
    16. Jones, Christopher S., 2001. "Extracting factors from heteroskedastic asset returns," Journal of Financial Economics, Elsevier, vol. 62(2), pages 293-325, November.
    17. repec:dgr:rugccs:200312 is not listed on IDEAS
    18. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    19. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    20. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    21. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reichlin, Lucrezia, 2002. "Factor Models in Large Cross-Sections of Time Series," CEPR Discussion Papers 3285, C.E.P.R. Discussion Papers.
    2. Matteo Luciani, 2015. "Monetary Policy and the Housing Market: A Structural Factor Analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 199-218, March.
    3. Helmut Lütkepohl, 2014. "Structural Vector Autoregressive Analysis in a Data Rich Environment: A Survey," Discussion Papers of DIW Berlin 1351, DIW Berlin, German Institute for Economic Research.
    4. Tsay, Ruey S. & Ando, Tomohiro, 2012. "Bayesian panel data analysis for exploring the impact of subprime financial crisis on the US stock market," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3345-3365.
    5. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    6. Eickmeier, Sandra, 2005. "Common stationary and non-stationary factors in the euro area analyzed in a large-scale factor model," Discussion Paper Series 1: Economic Studies 2005,02, Deutsche Bundesbank.
    7. Lippi, Marco & Reichlin, Lucrezia & Forni, Mario, 2003. "Opening the Black Box: Structural Factor Models versus Structural VARs," CEPR Discussion Papers 4133, C.E.P.R. Discussion Papers.
    8. Tomohiro Ando & Ruey S. Tsay, 2009. "Model selection for generalized linear models with factor‐augmented predictors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 207-235, May.
    9. António Rua & Francisco Craveiro Dias, 2008. "Determining the number of factors in approximate factor models with global and group-specific factors," Working Papers w200809, Banco de Portugal, Economics and Research Department.
    10. Hallin, Marc & Liska, Roman, 2011. "Dynamic factors in the presence of blocks," Journal of Econometrics, Elsevier, vol. 163(1), pages 29-41, July.
    11. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    12. Houssa, Romain, 2008. "Monetary union in West Africa and asymmetric shocks: A dynamic structural factor model approach," Journal of Development Economics, Elsevier, vol. 85(1-2), pages 319-347, February.
    13. Gupta, Rangan & Kabundi, Alain, 2011. "A large factor model for forecasting macroeconomic variables in South Africa," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1076-1088, October.
    14. Daniel Armeanu & Jean Vasile Andrei & Leonard Lache & Mirela Panait, 2017. "A multifactor approach to forecasting Romanian gross domestic product (GDP) in the short run," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-23, July.
    15. Bai, Jushan & Ando, Tomohiro, 2013. "Multifactor asset pricing with a large number of observable risk factors and unobservable common and group-specific factors," MPRA Paper 52785, University Library of Munich, Germany, revised Dec 2013.
    16. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    17. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    18. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    19. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    20. Eickmeier, Sandra, 2007. "Business cycle transmission from the US to Germany--A structural factor approach," European Economic Review, Elsevier, vol. 51(3), pages 521-551, April.

    More about this item

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:9829. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.