IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v240y2024i1s0304407624000319.html
   My bibliography  Save this article

Panel data models with time-varying latent group structures

Author

Listed:
  • Wang, Yiren
  • Phillips, Peter C.B.
  • Su, Liangjun

Abstract

This paper considers a linear panel model with interactive fixed effects and unobserved individual and time heterogeneities that are captured by some latent group structures and an unknown structural break, respectively. To enhance realism, the model may have different numbers of groups and/or different group memberships before and after the break. With preliminary nuclear norm regularized estimation followed by row- and column-wise linear regressions, we estimate the break point based on the idea of binary segmentation and the latent group structures together with the number of groups before and after the break by sequential testing K-means algorithm simultaneously. It is shown that the break point, the number of groups and the group memberships can each be estimated correctly with probability approaching one. Asymptotic distributions of the estimators of the slope coefficients are established. Monte Carlo simulations demonstrate excellent finite sample performance for the proposed estimation algorithm. An empirical application to real house price data across 377 Metropolitan Statistical Areas in the US from 1975 to 2014 suggests the presence both of structural breaks and of changes in group membership.

Suggested Citation

  • Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
  • Handle: RePEc:eee:econom:v:240:y:2024:i:1:s0304407624000319
    DOI: 10.1016/j.jeconom.2024.105685
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407624000319
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2024.105685?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    2. Ando, Tomohiro & Bai, Jushan, 2015. "A simple new test for slope homogeneity in panel data models with interactive effects," Economics Letters, Elsevier, vol. 136(C), pages 112-117.
    3. Vasilis Sarafidis & Neville Weber, 2015. "A Partially Heterogeneous Framework for Analyzing Panel Data," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(2), pages 274-296, April.
    4. Lu, Xun & Su, Liangjun, 2016. "Shrinkage estimation of dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 190(1), pages 148-175.
    5. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    6. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    7. Dukpa Kim, 2014. "Common breaks in time trends for large panel data with a factor structure," Econometrics Journal, Royal Economic Society, vol. 17(3), pages 301-337, October.
    8. Su, Liangjun & Chen, Qihui, 2013. "Testing Homogeneity In Panel Data Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1079-1135, December.
    9. Shujie Ma & Liangjun Su & Yichong Zhang, 2020. "Detecting Latent Communities in Network Formation Models," Papers 2005.03226, arXiv.org, revised Mar 2021.
    10. Ben-David, Dan, 1998. "Convergence clubs and subsistence economies," Journal of Development Economics, Elsevier, vol. 55(1), pages 155-171, February.
    11. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    12. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    13. Xun Lu & Liangjun Su, 2017. "Determining the number of groups in latent panel structures with an application to income and democracy," Quantitative Economics, Econometric Society, vol. 8(3), pages 729-760, November.
    14. Wenxin Huang & Yiru Wang & Lingyun Zhou, 2024. "Identify latent group structures in panel data: The classifylasso command," Stata Journal, StataCorp LP, vol. 24(1), pages 46-71, March.
    15. Durlauf, Steven N & Johnson, Paul A, 1995. "Multiple Regimes and Cross-Country Growth Behaviour," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 365-384, Oct.-Dec..
    16. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    17. Moon, Hyungsik Roger & Weidner, Martin, 2017. "Dynamic Linear Panel Regression Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 33(1), pages 158-195, February.
    18. François Ortalo-Magné & Sven Rady, 2006. "Housing Market Dynamics: On the Contribution of Income Shocks and Credit Constraints ," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(2), pages 459-485.
    19. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    20. Miao, Ke & Phillips, Peter C.B. & Su, Liangjun, 2023. "High-dimensional VARs with common factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 155-183.
    21. Klapper, Leora & Love, Inessa, 2011. "The impact of the financial crisis on new firm registration," Economics Letters, Elsevier, vol. 113(1), pages 1-4, October.
    22. Hashem Pesaran, M. & Yamagata, Takashi, 2008. "Testing slope homogeneity in large panels," Journal of Econometrics, Elsevier, vol. 142(1), pages 50-93, January.
    23. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    24. Joshua Gallin, 2006. "The Long-Run Relationship between House Prices and Income: Evidence from Local Housing Markets," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 34(3), pages 417-438, September.
    25. Huang, Wenxin & Jin, Sainan & Su, Liangjun, 2020. "Identifying Latent Grouped Patterns In Cointegrated Panels," Econometric Theory, Cambridge University Press, vol. 36(3), pages 410-456, June.
    26. Jushan Bai & Pierre Perron, 2003. "Critical values for multiple structural change tests," Econometrics Journal, Royal Economic Society, vol. 6(1), pages 72-78, June.
    27. Kim, Dukpa, 2011. "Estimating a common deterministic time trend break in large panels with cross sectional dependence," Journal of Econometrics, Elsevier, vol. 164(2), pages 310-330, October.
    28. Zhang, Yingying & Wang, Huixia Judy & Zhu, Zhongyi, 2019. "Quantile-regression-based clustering for panel data," Journal of Econometrics, Elsevier, vol. 213(1), pages 54-67.
    29. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    30. Bai, Jushan, 2010. "Common breaks in means and variances for panel data," Journal of Econometrics, Elsevier, vol. 157(1), pages 78-92, July.
    31. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    32. Michele Aquaro & Natalia Bailey & M. Hashem Pesaran, 2021. "Estimation and inference for spatial models with heterogeneous coefficients: An application to US house prices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 18-44, January.
    33. Jun Zhang & Li Cheng, 2019. "Threshold Effect of Tourism Development on Economic Growth Following a Disaster Shock: Evidence from the Wenchuan Earthquake, P.R. China," Sustainability, MDPI, vol. 11(2), pages 1-22, January.
    34. Liangjun Su & Xia Wang & Sainan Jin, 2019. "Sieve Estimation of Time-Varying Panel Data Models With Latent Structures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 334-349, April.
    35. Jushan Bai, 1997. "Estimation Of A Change Point In Multiple Regression Models," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 551-563, November.
    36. Michael Keane & Timothy Neal, 2020. "Climate change and U.S. agriculture: Accounting for multidimensional slope heterogeneity in panel data," Quantitative Economics, Econometric Society, vol. 11(4), pages 1391-1429, November.
    37. Berthelemy, Jean-Claude & Varoudakis, Aristomene, 1996. "Economic Growth, Convergence Clubs, and the Role of Financial Development," Oxford Economic Papers, Oxford University Press, vol. 48(2), pages 300-328, April.
    38. Badi H. Baltagi & Chihwa Kao & Long Liu, 2017. "Estimation and identification of change points in panel models with nonstationary or stationary regressors and error term," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 85-102, March.
    39. Degui Li & Junhui Qian & Liangjun Su, 2016. "Panel Data Models With Interactive Fixed Effects and Multiple Structural Breaks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1804-1819, October.
    40. Bai, Jushan & Ng, Serena, 2019. "Rank regularized estimation of approximate factor models," Journal of Econometrics, Elsevier, vol. 212(1), pages 78-96.
    41. Malpezzi, Stephen, 1999. "A Simple Error Correction Model of House Prices," Journal of Housing Economics, Elsevier, vol. 8(1), pages 27-62, March.
    42. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.
    43. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    44. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    45. Su, Liangjun & Wang, Xia, 2020. "Testing For Structural Changes In Factor Models Via A Nonparametric Regression," Econometric Theory, Cambridge University Press, vol. 36(6), pages 1127-1158, December.
    46. Zhaofang Chu, 2012. "Logistics and economic growth: a panel data approach," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 49(1), pages 87-102, August.
    47. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    48. Wang, Wuyi & Phillips, Peter C.B. & Su, Liangjun, 2019. "The heterogeneous effects of the minimum wage on employment across states," Economics Letters, Elsevier, vol. 174(C), pages 179-185.
    49. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    50. Dennis R. Capozza & Patric H. Hendershott & Charlotte Mack & Christopher J. Mayer, 2002. "Determinants of Real House Price Dynamics," NBER Working Papers 9262, National Bureau of Economic Research, Inc.
    51. Zheng Tracy Ke & Jianqing Fan & Yichao Wu, 2015. "Homogeneity Pursuit," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 175-194, March.
    52. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    53. Lu, Xun & Su, Liangjun, 2023. "Uniform inference in linear panel data models with two-dimensional heterogeneity," Journal of Econometrics, Elsevier, vol. 235(2), pages 694-719.
    54. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    55. B. Prakasa Rao, 2009. "Conditional independence, conditional mixing and conditional association," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(2), pages 441-460, June.
    56. Lee, Nayoung & Moon, Hyungsik Roger & Zhou, Qiankun, 2017. "Many IVs estimation of dynamic panel regression models with measurement error," Journal of Econometrics, Elsevier, vol. 200(2), pages 251-259.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Langevin, R.;, 2024. "Consistent Estimation of Finite Mixtures: An Application to Latent Group Panel Structures," Health, Econometrics and Data Group (HEDG) Working Papers 24/16, HEDG, c/o Department of Economics, University of York.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    2. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    3. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    4. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    5. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    6. Huang, Wenxin & Jin, Sainan & Phillips, Peter C.B. & Su, Liangjun, 2021. "Nonstationary panel models with latent group structures and cross-section dependence," Journal of Econometrics, Elsevier, vol. 221(1), pages 198-222.
    7. Mehrabani, Ali, 2023. "Estimation and identification of latent group structures in panel data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1464-1482.
    8. Su, Liangjun & Ju, Gaosheng, 2018. "Identifying latent grouped patterns in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 554-573.
    9. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    10. Hong, Shengjie & Su, Liangjun & Jiang, Tao, 2023. "Profile GMM estimation of panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 927-948.
    11. Yu, Lu & Gu, Jiaying & Volgushev, Stanislav, 2024. "Spectral clustering with variance information for group structure estimation in panel data," Journal of Econometrics, Elsevier, vol. 241(1).
    12. Lu, Xun & Su, Liangjun, 2023. "Uniform inference in linear panel data models with two-dimensional heterogeneity," Journal of Econometrics, Elsevier, vol. 235(2), pages 694-719.
    13. Miao, Ke & Li, Kunpeng & Su, Liangjun, 2020. "Panel threshold models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 219(1), pages 137-170.
    14. Saptorshee Kanto Chakraborty & Massimiliano Mazzanti, 2021. "Revisiting the literature on the dynamic Environmental Kuznets Curves using a latent structure approach," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 923-941, October.
    15. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.
    16. Liu, Ruiqi & Shang, Zuofeng & Zhang, Yonghui & Zhou, Qiankun, 2020. "Identification and estimation in panel models with overspecified number of groups," Journal of Econometrics, Elsevier, vol. 215(2), pages 574-590.
    17. Jiang, Peiyun & Kurozumi, Eiji, 2021. "A new test for common breaks in heterogeneous panel data models," Discussion paper series HIAS-E-107, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    18. Langevin, R.;, 2024. "Consistent Estimation of Finite Mixtures: An Application to Latent Group Panel Structures," Health, Econometrics and Data Group (HEDG) Working Papers 24/16, HEDG, c/o Department of Economics, University of York.
    19. Ando, Tomohiro & Bai, Jushan, 2021. "Large-scale generalized linear longitudinal data models with grouped patterns of unobserved heterogeneity," MPRA Paper 111431, University Library of Munich, Germany.
    20. Boyuan Zhang, 2022. "Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models," Papers 2211.16714, arXiv.org, revised Oct 2023.

    More about this item

    Keywords

    Interactive fixed effects; Latent group structure; Structural break; Nuclear norm regularization; Sequential testing K-means algorithm;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:240:y:2024:i:1:s0304407624000319. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.