IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.09828.html
   My bibliography  Save this paper

Modelling Large Dimensional Datasets with Markov Switching Factor Models

Author

Listed:
  • Matteo Barigozzi
  • Daniele Massacci

Abstract

We study a novel large dimensional approximate factor model with regime changes in the loadings driven by a latent first order Markov process. By exploiting the equivalent linear representation of the model, we first recover the latent factors by means of Principal Component Analysis. We then cast the model in state-space form, and we estimate loadings and transition probabilities through an EM algorithm based on a modified version of the Baum-Lindgren-Hamilton-Kim filter and smoother that makes use of the factors previously estimated. Our approach is appealing as it provides closed form expressions for all estimators. More importantly, it does not require knowledge of the true number of factors. We derive the theoretical properties of the proposed estimation procedure, and we show their good finite sample performance through a comprehensive set of Monte Carlo experiments. The empirical usefulness of our approach is illustrated through three applications to large U.S. datasets of stock returns, macroeconomic variables, and inflation indexes.

Suggested Citation

  • Matteo Barigozzi & Daniele Massacci, 2022. "Modelling Large Dimensional Datasets with Markov Switching Factor Models," Papers 2210.09828, arXiv.org, revised Dec 2024.
  • Handle: RePEc:arx:papers:2210.09828
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.09828
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    2. Gabriel Perez‐Quiros & Allan Timmermann, 2000. "Firm Size and Cyclical Variations in Stock Returns," Journal of Finance, American Finance Association, vol. 55(3), pages 1229-1262, June.
    3. Giovanni Urga & Fa Wang, 2022. "Estimation and Inference for High Dimensional Factor Model with Regime Switching," Papers 2205.12126, arXiv.org, revised Apr 2023.
    4. Lorenzo Trapani, 2018. "A Randomized Sequential Procedure to Determine the Number of Factors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1341-1349, July.
    5. Bai, Jushan & Ng, Serena, 2013. "Principal components estimation and identification of static factors," Journal of Econometrics, Elsevier, vol. 176(1), pages 18-29.
    6. Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation of Non-Stationary Large Approximate Dynamic Factor Models," Papers 1910.09841, arXiv.org.
    7. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2017. "Dynamic factor models with infinite-dimensional factor space: Asymptotic analysis," Journal of Econometrics, Elsevier, vol. 199(1), pages 74-92.
    8. Andrew Ang & Allan Timmermann, 2012. "Regime Changes and Financial Markets," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 313-337, October.
    9. Andrew Ang & Geert Bekaert, 2002. "International Asset Allocation With Regime Shifts," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1137-1187.
    10. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    11. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Advances in Econometrics, in: Missing Data Methods: Time-Series Methods and Applications, pages 1-86, Emerald Group Publishing Limited.
    12. Baltagi, Badi H. & Feng, Qu & Kao, Chihwa, 2016. "Estimation of heterogeneous panels with structural breaks," Journal of Econometrics, Elsevier, vol. 191(1), pages 176-195.
    13. Markus Pelger & Ruoxuan Xiong, 2022. "State-Varying Factor Models of Large Dimensions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1315-1333, June.
    14. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    15. Goldfeld, Stephen M. & Quandt, Richard E., 1973. "A Markov model for switching regressions," Journal of Econometrics, Elsevier, vol. 1(1), pages 3-15, March.
    16. Breitung, Jörg & Eickmeier, Sandra, 2011. "Testing for structural breaks in dynamic factor models," Journal of Econometrics, Elsevier, vol. 163(1), pages 71-84, July.
    17. Motta, Giovanni & Hafner, Christian M. & von Sachs, Rainer, 2011. "Locally Stationary Factor Models: Identification And Nonparametric Estimation," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1279-1319, December.
    18. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    19. Perez-Quiros, Gabriel & Timmermann, Allan, 2001. "Business cycle asymmetries in stock returns: Evidence from higher order moments and conditional densities," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 259-306, July.
    20. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    21. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    22. Barigozzi, Matteo & Trapani, Lorenzo, 2020. "Sequential testing for structural stability in approximate factor models," Stochastic Processes and their Applications, Elsevier, vol. 130(8), pages 5149-5187.
    23. Jushan Bai & Kunpeng Li, 2016. "Maximum Likelihood Estimation and Inference for Approximate Factor Models of High Dimension," The Review of Economics and Statistics, MIT Press, vol. 98(2), pages 298-309, May.
    24. Massimo Guidolin & Allan Timmermann, 2006. "An econometric model of nonlinear dynamics in the joint distribution of stock and bond returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 1-22, January.
    25. Massacci, Daniele, 2017. "Least squares estimation of large dimensional threshold factor models," Journal of Econometrics, Elsevier, vol. 197(1), pages 101-129.
    26. Kim, Chang-Jin, 1994. "Dynamic linear models with Markov-switching," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 1-22.
    27. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    28. Massimo Guidolin & Allan Timmermann, 2008. "International asset allocation under regime switching, skew, and kurtosis preferences," The Review of Financial Studies, Society for Financial Studies, vol. 21(2), pages 889-935, April.
    29. Zhongjun Qu & Fan Zhuo, 2021. "Likelihood Ratio-Based Tests for Markov Regime Switching," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(2), pages 937-968.
    30. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    31. Hamilton, J.D., 2016. "Macroeconomic Regimes and Regime Shifts," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 163-201, Elsevier.
    32. Barigozzi, Matteo & Cho, Haeran & Fryzlewicz, Piotr, 2018. "Simultaneous multiple change-point and factor analysis for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 206(1), pages 187-225.
    33. Eugene F. Fama & Kenneth R. French, 2016. "Dissecting Anomalies with a Five-Factor Model," The Review of Financial Studies, Society for Financial Studies, vol. 29(1), pages 69-103.
    34. Corradi, Valentina & Swanson, Norman R., 2014. "Testing for structural stability of factor augmented forecasting models," Journal of Econometrics, Elsevier, vol. 182(1), pages 100-118.
    35. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    36. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    37. Alessi, Lucia & Barigozzi, Matteo & Capasso, Marco, 2010. "Improved penalization for determining the number of factors in approximate factor models," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1806-1813, December.
    38. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    39. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
    40. Jushan Bai & Xu Han, 2016. "Structural Changes in High Dimensional Factor Models," Frontiers of Economics in China-Selected Publications from Chinese Universities, Higher Education Press, vol. 11(1), pages 9-39, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matteo Barigozzi, 2022. "On Estimation and Inference of Large Approximate Dynamic Factor Models via the Principal Component Analysis," Papers 2211.01921, arXiv.org, revised Jul 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    2. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    3. Barigozzi, Matteo & Trapani, Lorenzo, 2020. "Sequential testing for structural stability in approximate factor models," Stochastic Processes and their Applications, Elsevier, vol. 130(8), pages 5149-5187.
    4. Matteo Barigozzi, 2023. "Quasi Maximum Likelihood Estimation of High-Dimensional Factor Models: A Critical Review," Papers 2303.11777, arXiv.org, revised May 2024.
    5. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    6. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    7. Barigozzi, Matteo & Cho, Haeran & Fryzlewicz, Piotr, 2018. "Simultaneous multiple change-point and factor analysis for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 206(1), pages 187-225.
    8. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    9. Matteo Barigozzi, 2023. "Asymptotic equivalence of Principal Components and Quasi Maximum Likelihood estimators in Large Approximate Factor Models," Papers 2307.09864, arXiv.org, revised Jun 2024.
    10. Baltagi, Badi H. & Kao, Chihwa & Wang, Fa, 2021. "Estimating and testing high dimensional factor models with multiple structural changes," Journal of Econometrics, Elsevier, vol. 220(2), pages 349-365.
    11. Ma, Chenchen & Tu, Yundong, 2023. "Group fused Lasso for large factor models with multiple structural breaks," Journal of Econometrics, Elsevier, vol. 233(1), pages 132-154.
    12. Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Papers 1910.03821, arXiv.org, revised Sep 2024.
    13. Duan, Jiangtao & Bai, Jushan & Han, Xu, 2023. "Quasi-maximum likelihood estimation of break point in high-dimensional factor models," Journal of Econometrics, Elsevier, vol. 233(1), pages 209-236.
    14. Li, Kunpeng & Li, Qi & Lu, Lina, 2018. "Quasi maximum likelihood analysis of high dimensional constrained factor models," Journal of Econometrics, Elsevier, vol. 206(2), pages 574-612.
    15. Mao Takongmo, Charles Olivier & Stevanovic, Dalibor, 2015. "Selection Of The Number Of Factors In Presence Of Structural Instability: A Monte Carlo Study," L'Actualité Economique, Société Canadienne de Science Economique, vol. 91(1-2), pages 177-233, Mars-Juin.
    16. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    17. Luke Hartigan, 2015. "Changes in the Factor Structure of the U.S. Economy: Permanent Breaks or Business Cycle Regimes?," Discussion Papers 2015-17, School of Economics, The University of New South Wales.
    18. Bai, Jushan & Han, Xu & Shi, Yutang, 2020. "Estimation and inference of change points in high-dimensional factor models," Journal of Econometrics, Elsevier, vol. 219(1), pages 66-100.
    19. Simon Freyaldenhoven, 2020. "Identification Through Sparsity in Factor Models," Working Papers 20-25, Federal Reserve Bank of Philadelphia.
    20. Lippi, Marco & Deistler, Manfred & Anderson, Brian, 2023. "High-Dimensional Dynamic Factor Models: A Selective Survey and Lines of Future Research," Econometrics and Statistics, Elsevier, vol. 26(C), pages 3-16.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.09828. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.