IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-137736.html
   My bibliography  Save this paper

Group Invariance, Likelihood Ratio Tests, and the Incidental Parameter Problem in a High-Dimensional Linear Model

Author

Listed:
  • Marc Hallin
  • Marcelo Moreira J.
  • Alexei Onatski

Abstract

This paper considers a linear panel data model with reduced rank regressors and interactive fixed effects. The leading example is a factor model where some of the factors are observed, some others not. Invariance considerations yield a maximal invariant statistic whose density does not depend on incidental parameters. It is natural to consider a likelihood ratio test based on the maximal invariant statistic. Its density can be found by using as a prior the unique invariant distribution for the incidental parameters. That invariant distribution is least favorable and leads to minimax optimality properties. Combining the invariant distribution with a prior for the remaining parameters gives a class of admissible tests. A particular choice of distribution yields the spiked covariance model of Johnstone (2001). Numerical simulations suggest that the maximal invariant likelihood ratio test outperforms the standard likelihood ratio test. Tests which are not invariant to data transformations (i) are uniquely represented as randomized tests of the maximal invariant statistic and (ii) do not solve the incidental parameter problem.

Suggested Citation

  • Marc Hallin & Marcelo Moreira J. & Alexei Onatski, 2013. "Group Invariance, Likelihood Ratio Tests, and the Incidental Parameter Problem in a High-Dimensional Linear Model," Working Papers ECARES ECARES 2013-04, ULB -- Universite Libre de Bruxelles.
    • Handle: RePEc:eca:wpaper:2013/137736
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/137736/1/2013-04-HALLIN_MOREIRA_ONATSKI-group.pdf
    File Function: 2013-04-HALLIN_MOREIRA_ONATSKI-group
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    2. Athey, Susan & Haile, Philip A., 2007. "Nonparametric Approaches to Auctions," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 60, Elsevier.
    3. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    4. Alexei Onatski & Marcelo Moreira J. & Marc Hallin, 2011. "Asymptotic Power of Sphericity Tests for High-Dimensional Data," Working Papers ECARES ECARES 2011-018, ULB -- Universite Libre de Bruxelles.
    5. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    6. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    7. Chioda, Laura & Jansson, Michael, 2009. "Optimal Invariant Inference When The Number Of Instruments Is Large," Econometric Theory, Cambridge University Press, vol. 25(3), pages 793-805, June.
    8. Chen, Song Xi & Zhang, Li-Xin & Zhong, Ping-Shou, 2010. "Tests for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 810-819.
    9. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    10. Alexei Onatski, 2010. "Determining the Number of Factors from Empirical Distribution of Eigenvalues," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1004-1016, November.
    11. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    12. Alessi, Lucia & Barigozzi, Matteo & Capasso, Marco, 2010. "Improved penalization for determining the number of factors in approximate factor models," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1806-1813, December.
    13. Bryan S. Graham, 2008. "Identifying Social Interactions Through Conditional Variance Restrictions," Econometrica, Econometric Society, vol. 76(3), pages 643-660, May.
    14. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    15. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    16. Arellano, Manuel, 2003. "Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780199245291.
    17. Lancaster, Tony, 2000. "The incidental parameter problem since 1948," Journal of Econometrics, Elsevier, vol. 95(2), pages 391-413, April.
    18. Gary Chamberlain & Marcelo J. Moreira, 2009. "Decision Theory Applied to a Linear Panel Data Model," Econometrica, Econometric Society, vol. 77(1), pages 107-133, January.
    19. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    20. Gary Chamberlain, 2007. "Decision Theory Applied to an Instrumental Variables Model," Econometrica, Econometric Society, vol. 75(3), pages 609-652, May.
    21. Tibor F. Liska, 2007. "The Liska model," Society and Economy, Akadémiai Kiadó, Hungary, vol. 29(3), pages 363-381, December.
    22. Schott, James R., 2006. "A high-dimensional test for the equality of the smallest eigenvalues of a covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 97(4), pages 827-843, April.
    23. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Mingli & Fernández-Val, Iván & Weidner, Martin, 2021. "Nonlinear factor models for network and panel data," Journal of Econometrics, Elsevier, vol. 220(2), pages 296-324.
    2. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2019. "Estimation of large dimensional conditional factor models in finance," Working Papers unige:125031, University of Geneva, Geneva School of Economics and Management.
    3. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2019. "A diagnostic criterion for approximate factor structure," Journal of Econometrics, Elsevier, vol. 212(2), pages 503-521.
    4. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    5. Gu, Shihao & Kelly, Bryan & Xiu, Dacheng, 2021. "Autoencoder asset pricing models," Journal of Econometrics, Elsevier, vol. 222(1), pages 429-450.
    6. Aït-Sahalia, Yacine & Xiu, Dacheng, 2017. "Using principal component analysis to estimate a high dimensional factor model with high-frequency data," Journal of Econometrics, Elsevier, vol. 201(2), pages 384-399.
    7. Mao Takongmo, Charles Olivier & Stevanovic, Dalibor, 2015. "Selection Of The Number Of Factors In Presence Of Structural Instability: A Monte Carlo Study," L'Actualité Economique, Société Canadienne de Science Economique, vol. 91(1-2), pages 177-233, Mars-Juin.
    8. Patrick Gagliardini & Elisa Ossola & Olivier Scaillet, 2016. "Time‐Varying Risk Premium in Large Cross‐Sectional Equity Data Sets," Econometrica, Econometric Society, vol. 84, pages 985-1046, May.
    9. Tomohiro Ando & Jushan Bai, 2016. "Panel Data Models with Grouped Factor Structure Under Unknown Group Membership," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(1), pages 163-191, January.
    10. Freyaldenhoven, Simon, 2022. "Factor models with local factors — Determining the number of relevant factors," Journal of Econometrics, Elsevier, vol. 229(1), pages 80-102.
    11. Stefano Giglio & Dacheng Xiu, 2017. "Inference on Risk Premia in the Presence of Omitted Factors," NBER Working Papers 23527, National Bureau of Economic Research, Inc.
    12. Jörg Breitung & In Choi, 2013. "Factor models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 11, pages 249-265, Edward Elgar Publishing.
      • In Choi & Jorg Breitung, 2011. "Factor models," Working Papers 1121, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy), revised Dec 2011.
    13. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    14. Choi, In & Lin, Rui & Shin, Yongcheol, 2023. "Canonical correlation-based model selection for the multilevel factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 22-44.
    15. repec:gnv:wpaper:unige:76321 is not listed on IDEAS
    16. Vasilis Sarafidis & Tom Wansbeek, 2012. "Cross-Sectional Dependence in Panel Data Analysis," Econometric Reviews, Taylor & Francis Journals, vol. 31(5), pages 483-531, September.
    17. Li, Hongjun & Li, Qi & Shi, Yutang, 2017. "Determining the number of factors when the number of factors can increase with sample size," Journal of Econometrics, Elsevier, vol. 197(1), pages 76-86.
    18. Francisco Corona & Graciela González-Farías & Pedro Orraca, 2017. "A dynamic factor model for the Mexican economy: are common trends useful when predicting economic activity?," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 26(1), pages 1-35, December.
    19. Li, Kunpeng & Li, Qi & Lu, Lina, 2018. "Quasi maximum likelihood analysis of high dimensional constrained factor models," Journal of Econometrics, Elsevier, vol. 206(2), pages 574-612.
    20. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    21. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.

    More about this item

    Keywords

    panel data models; factor model; incidental parameters; invariance; integrated likelihood; minimax; likelihood ratio test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/137736. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.