IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v241y2024i1s0304407624000551.html
   My bibliography  Save this article

Spectral clustering with variance information for group structure estimation in panel data

Author

Listed:
  • Yu, Lu
  • Gu, Jiaying
  • Volgushev, Stanislav

Abstract

Consider a panel data setting where repeated observations on individuals are available. Often it is reasonable to assume that there exist groups of individuals that share similar effects of observed characteristics, but the grouping is typically unknown in advance. We first conduct a local analysis which reveals that the variances of the individual coefficient estimates contain useful information for the estimation of group structure. We then propose a method to estimate unobserved groupings for general panel data models that explicitly accounts for the variance information. Our proposed method remains computationally feasible with a large number of individuals and/or repeated measurements on each individual. The developed ideas can also be applied even when individual-level data are not available and only parameter estimates together with some quantification of estimation uncertainty are given to the researcher. A thorough simulation study demonstrates superior performance of our method than existing methods and we apply the method to two empirical applications.

Suggested Citation

  • Yu, Lu & Gu, Jiaying & Volgushev, Stanislav, 2024. "Spectral clustering with variance information for group structure estimation in panel data," Journal of Econometrics, Elsevier, vol. 241(1).
  • Handle: RePEc:eee:econom:v:241:y:2024:i:1:s0304407624000551
    DOI: 10.1016/j.jeconom.2024.105709
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407624000551
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2024.105709?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liangjun Su & Zhentao Shi & Peter C. B. Phillips, 2016. "Identifying Latent Structures in Panel Data," Econometrica, Econometric Society, vol. 84, pages 2215-2264, November.
    2. Galvao, Antonio F. & Kato, Kengo, 2016. "Smoothed quantile regression for panel data," Journal of Econometrics, Elsevier, vol. 193(1), pages 92-112.
    3. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    4. Carlos A. Flores & Alfonso Flores-Lagunes & Dimitrios Kapetanakis, 2014. "Lessons From Quantile Panel Estimation of the Environmental Kuznets Curve," Econometric Reviews, Taylor & Francis Journals, vol. 33(8), pages 815-853, November.
    5. Kato, Kengo & F. Galvao, Antonio & Montes-Rojas, Gabriel V., 2012. "Asymptotics for panel quantile regression models with individual effects," Journal of Econometrics, Elsevier, vol. 170(1), pages 76-91.
    6. Stéphane Bonhomme & Elena Manresa, 2015. "Grouped Patterns of Heterogeneity in Panel Data," Econometrica, Econometric Society, vol. 83(3), pages 1147-1184, May.
    7. Ando, Tomohiro & Bai, Jushan & Li, Kunpeng, 2022. "Bayesian and maximum likelihood analysis of large-scale panel choice models with unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 230(1), pages 20-38.
    8. Daniel L. Millimet & John A. List & Thanasis Stengos, 2003. "The Environmental Kuznets Curve: Real Progress or Misspecified Models?," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 1038-1047, November.
    9. Galvao, Antonio F. & Gu, Jiaying & Volgushev, Stanislav, 2020. "On the unbiased asymptotic normality of quantile regression with fixed effects," Journal of Econometrics, Elsevier, vol. 218(1), pages 178-215.
    10. Raj Chetty & Nathaniel Hendren, 2018. "The Impacts of Neighborhoods on Intergenerational Mobility I: Childhood Exposure Effects," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1107-1162.
    11. Wuyi Wang & Peter C. B. Phillips & Liangjun Su, 2018. "Homogeneity pursuit in panel data models: Theory and application," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 797-815, September.
    12. List, John A. & Gallet, Craig A., 1999. "The environmental Kuznets curve: does one size fit all?," Ecological Economics, Elsevier, vol. 31(3), pages 409-423, December.
    13. Grossman, G.M & Krueger, A.B., 1991. "Environmental Impacts of a North American Free Trade Agreement," Papers 158, Princeton, Woodrow Wilson School - Public and International Affairs.
    14. Peter Bergman & Raj Chetty & Stefanie DeLuca & Nathaniel Hendren & Lawrence F. Katz & Christopher Palmer, 2024. "Creating Moves to Opportunity: Experimental Evidence on Barriers to Neighborhood Choice," American Economic Review, American Economic Association, vol. 114(5), pages 1281-1337, May.
    15. Okui, Ryo & Wang, Wendun, 2021. "Heterogeneous structural breaks in panel data models," Journal of Econometrics, Elsevier, vol. 220(2), pages 447-473.
    16. Koenker, Roger, 2004. "Quantile regression for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 91(1), pages 74-89, October.
    17. Matthew Harding & Carlos Lamarche, 2017. "Penalized Quantile Regression with Semiparametric Correlated Effects: An Application with Heterogeneous Preferences," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 342-358, March.
    18. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    19. Miao, Ke & Su, Liangjun & Wang, Wendun, 2020. "Panel threshold regressions with latent group structures," Journal of Econometrics, Elsevier, vol. 214(2), pages 451-481.
    20. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    21. Raj Chetty & Nathaniel Hendren & Patrick Kline & Emmanuel Saez, 2014. "Where is the land of Opportunity? The Geography of Intergenerational Mobility in the United States," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1553-1623.
    22. Zheng Tracy Ke & Jianqing Fan & Yichao Wu, 2015. "Homogeneity Pursuit," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 175-194, March.
    23. Zhang, Yingying & Wang, Huixia Judy & Zhu, Zhongyi, 2019. "Quantile-regression-based clustering for panel data," Journal of Econometrics, Elsevier, vol. 213(1), pages 54-67.
    24. Raj Chetty & John N. Friedman & Nathaniel Hendren & Maggie R. Jones & Sonya R. Porter, 2018. "The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility," NBER Working Papers 25147, National Bureau of Economic Research, Inc.
    25. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    26. Lamarche, Carlos, 2010. "Robust penalized quantile regression estimation for panel data," Journal of Econometrics, Elsevier, vol. 157(2), pages 396-408, August.
    27. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504, January.
    28. Lin Chang-Ching & Ng Serena, 2012. "Estimation of Panel Data Models with Parameter Heterogeneity when Group Membership is Unknown," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 42-55, August.
    29. Junhui Wang, 2010. "Consistent selection of the number of clusters via crossvalidation," Biometrika, Biometrika Trust, vol. 97(4), pages 893-904.
    30. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leng, Xuan & Chen, Heng & Wang, Wendun, 2023. "Multi-dimensional latent group structures with heterogeneous distributions," Journal of Econometrics, Elsevier, vol. 233(1), pages 1-21.
    2. Wang, Yiren & Phillips, Peter C.B. & Su, Liangjun, 2024. "Panel data models with time-varying latent group structures," Journal of Econometrics, Elsevier, vol. 240(1).
    3. Yiren Wang & Liangjun Su & Yichong Zhang, 2022. "Low-rank Panel Quantile Regression: Estimation and Inference," Papers 2210.11062, arXiv.org.
    4. Zhang, Yingying & Wang, Huixia Judy & Zhu, Zhongyi, 2019. "Quantile-regression-based clustering for panel data," Journal of Econometrics, Elsevier, vol. 213(1), pages 54-67.
    5. Gu, Jiaying & Volgushev, Stanislav, 2019. "Panel data quantile regression with grouped fixed effects," Journal of Econometrics, Elsevier, vol. 213(1), pages 68-91.
    6. Jiaying Gu & Stanislav Volgushev, 2018. "Panel Data Quantile Regression with Grouped Fixed Effects," Papers 1801.05041, arXiv.org, revised Aug 2018.
    7. Langevin, R.;, 2024. "Consistent Estimation of Finite Mixtures: An Application to Latent Group Panel Structures," Health, Econometrics and Data Group (HEDG) Working Papers 24/16, HEDG, c/o Department of Economics, University of York.
    8. Su, Liangjun & Wang, Wuyi & Xu, Xingbai, 2023. "Identifying latent group structures in spatial dynamic panels," Journal of Econometrics, Elsevier, vol. 235(2), pages 1955-1980.
    9. Antonio F. Galvao & Thomas Parker & Zhijie Xiao, 2024. "Bootstrap Inference for Panel Data Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(2), pages 628-639, April.
    10. Xiaorong Yang & Jia Chen & Degui Li & Runze Li, 2024. "Functional-Coefficient Quantile Regression for Panel Data with Latent Group Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 1026-1040, July.
    11. Saptorshee Kanto Chakraborty & Massimiliano Mazzanti, 2021. "Revisiting the literature on the dynamic Environmental Kuznets Curves using a latent structure approach," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 923-941, October.
    12. Ando, Tomohiro & Bai, Jushan, 2021. "Large-scale generalized linear longitudinal data models with grouped patterns of unobserved heterogeneity," MPRA Paper 111431, University Library of Munich, Germany.
    13. Wang, Wuyi & Su, Liangjun, 2021. "Identifying latent group structures in nonlinear panels," Journal of Econometrics, Elsevier, vol. 220(2), pages 272-295.
    14. Lamarche, Carlos & Parker, Thomas, 2023. "Wild bootstrap inference for penalized quantile regression for longitudinal data," Journal of Econometrics, Elsevier, vol. 235(2), pages 1799-1826.
    15. Sun, Yan & Wan, Chuang & Zhang, Wenyang & Zhong, Wei, 2024. "A Multi-Kink quantile regression model with common structure for panel data analysis," Journal of Econometrics, Elsevier, vol. 239(2).
    16. Lumsdaine, Robin L. & Okui, Ryo & Wang, Wendun, 2023. "Estimation of panel group structure models with structural breaks in group memberships and coefficients," Journal of Econometrics, Elsevier, vol. 233(1), pages 45-65.
    17. Bennedsen, Mikkel & Hillebrand, Eric & Jensen, Sebastian, 2023. "A neural network approach to the environmental Kuznets curve," Energy Economics, Elsevier, vol. 126(C).
    18. Battagliola, Maria Laura & Sørensen, Helle & Tolver, Anders & Staicu, Ana-Maria, 2022. "A bias-adjusted estimator in quantile regression for clustered data," Econometrics and Statistics, Elsevier, vol. 23(C), pages 165-186.
    19. Denis Chetverikov & Elena Manresa, 2022. "Spectral and post-spectral estimators for grouped panel data models," Papers 2212.13324, arXiv.org, revised Dec 2022.
    20. Liang Chen & Juan J. Dolado & Jesús Gonzalo, 2021. "Quantile Factor Models," Econometrica, Econometric Society, vol. 89(2), pages 875-910, March.

    More about this item

    Keywords

    Group structure estimation; Spectral clustering; Panel data models;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:241:y:2024:i:1:s0304407624000551. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.