IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v87y2022i3d10.1007_s11336-021-09824-8.html
   My bibliography  Save this article

Factor Analysis Procedures Revisited from the Comprehensive Model with Unique Factors Decomposed into Specific Factors and Errors

Author

Listed:
  • Kohei Adachi

    (Osaka University)

Abstract

Factor analysis (FA) procedures can be classified into three types (Adachi in WIREs Comput Stat https://onlinelibrary.wiley.com/doi/abs/10.1002/wics.1458 , 2019): latent variable FA (LVFA), matrix decomposition FA (MDFA), and its variant (Stegeman in Comput Stat Data Anal 99: 189–203, 2016) named completely decomposed FA (CDFA) through the theorems proved in this paper. We revisit those procedures from the Comprehensive FA (CompFA) model, in which a multivariate observation is decomposed into common factor, specific factor, and error parts. These three parts are separated in MDFA and CDFA, while the specific factor and error parts are not separated, but their sum, called a unique factor, is considered in LVFA. We show that the assumptions in the CompFA model are satisfied by the CDFA solution, but not completely by the MDFA one. Then, how the CompFA model parameters are estimated in the FA procedures is examined. The study shows that all parameters can be recovered well in CDFA, while the sum of the parameters for the specific factor and error parts is approximated by the LVFA estimate of the unique factor parameter and by the MDFA estimate of the specific factor parameter. More detailed results are given through our subdivision of the CompFA model according to whether the error part is uncorrelated among variables or not.

Suggested Citation

  • Kohei Adachi, 2022. "Factor Analysis Procedures Revisited from the Comprehensive Model with Unique Factors Decomposed into Specific Factors and Errors," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 967-991, September.
    • Handle: RePEc:spr:psycho:v:87:y:2022:i:3:d:10.1007_s11336-021-09824-8
    DOI: 10.1007/s11336-021-09824-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-021-09824-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-021-09824-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Harry Harman & Wayne Jones, 1966. "Factor analysis by minimizing residuals (minres)," Psychometrika, Springer;The Psychometric Society, vol. 31(3), pages 351-368, September.
    2. Henry Kaiser, 1958. "The varimax criterion for analytic rotation in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(3), pages 187-200, September.
    3. Carl Eckart & Gale Young, 1936. "The approximation of one matrix by another of lower rank," Psychometrika, Springer;The Psychometric Society, vol. 1(3), pages 211-218, September.
    4. repec:ucp:bkecon:9780226316529 is not listed on IDEAS
    5. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    6. Stegeman, Alwin, 2016. "A new method for simultaneous estimation of the factor model parameters, factor scores, and unique parts," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 189-203.
    7. Kohei Adachi & Nickolay T. Trendafilov, 2018. "Some Mathematical Properties of the Matrix Decomposition Solution in Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 407-424, June.
    8. Kohei Adachi, 2013. "Factor Analysis with EM Algorithm Never Gives Improper Solutions when Sample Covariance and Initial Parameter Matrices Are Proper," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 380-394, April.
    9. Jos Berge & Henk Kiers, 1991. "A numerical approach to the approximate and the exact minimum rank of a covariance matrix," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 309-315, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stegeman, Alwin, 2016. "A new method for simultaneous estimation of the factor model parameters, factor scores, and unique parts," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 189-203.
    2. Kohei Adachi & Nickolay T. Trendafilov, 2018. "Some Mathematical Properties of the Matrix Decomposition Solution in Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 407-424, June.
    3. Bai, Jushan & Ng, Serena, 2019. "Rank regularized estimation of approximate factor models," Journal of Econometrics, Elsevier, vol. 212(1), pages 78-96.
    4. Chester Harris, 1967. "On factors and factor scores," Psychometrika, Springer;The Psychometric Society, vol. 32(4), pages 363-379, December.
    5. Jushan Bai & Serena Ng, 2020. "Simpler Proofs for Approximate Factor Models of Large Dimensions," Papers 2008.00254, arXiv.org.
    6. Jos Berge & Henk Kiers, 1993. "An alternating least squares method for the weighted approximation of a symmetric matrix," Psychometrika, Springer;The Psychometric Society, vol. 58(1), pages 115-118, March.
    7. Rosember Guerra-Urzola & Katrijn Van Deun & Juan C. Vera & Klaas Sijtsma, 2021. "A Guide for Sparse PCA: Model Comparison and Applications," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 893-919, December.
    8. Marie Chavent & Vanessa Kuentz-Simonet & Jérôme Saracco, 2012. "Orthogonal rotation in PCAMIX," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 6(2), pages 131-146, July.
    9. Jin, Shaobo & Moustaki, Irini & Yang-Wallentin, Fan, 2018. "Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case," LSE Research Online Documents on Economics 88118, London School of Economics and Political Science, LSE Library.
    10. Bai, Jushan & Ng, Serena, 2023. "Approximate factor models with weaker loadings," Journal of Econometrics, Elsevier, vol. 235(2), pages 1893-1916.
    11. Kohei Uno & Kohei Adachi & Nickolay T. Trendafilov, 2019. "Clustered Common Factor Exploration in Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 84(4), pages 1048-1067, December.
    12. Shaobo Jin & Irini Moustaki & Fan Yang-Wallentin, 2018. "Approximated Penalized Maximum Likelihood for Exploratory Factor Analysis: An Orthogonal Case," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 628-649, September.
    13. Lorenzo Finesso & Peter Spreij, 2016. "Factor analysis models via I-divergence optimization," Psychometrika, Springer;The Psychometric Society, vol. 81(3), pages 702-726, September.
    14. Stanley Mulaik, 1986. "Factor analysis and Psychometrika: Major developments," Psychometrika, Springer;The Psychometric Society, vol. 51(1), pages 23-33, March.
    15. Alwin Stegeman & Tam Lam, 2014. "Three-Mode Factor Analysis by Means of Candecomp/Parafac," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 426-443, July.
    16. Alwin Stegeman, 2018. "Simultaneous Component Analysis by Means of Tucker3," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 21-47, March.
    17. M. Corballis & R. Traub, 1970. "Longitudinal factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 35(1), pages 79-98, March.
    18. Niels G. Waller, 2018. "Direct Schmid–Leiman Transformations and Rank-Deficient Loadings Matrices," Psychometrika, Springer;The Psychometric Society, vol. 83(4), pages 858-870, December.
    19. Artür Manukyan & Erhan Çene & Ahmet Sedef & Ibrahim Demir, 2014. "Dandelion plot: a method for the visualization of R-mode exploratory factor analyses," Computational Statistics, Springer, vol. 29(6), pages 1769-1791, December.
    20. Kei Hirose & Miyuki Imada, 2018. "Sparse factor regression via penalized maximum likelihood estimation," Statistical Papers, Springer, vol. 59(2), pages 633-662, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:87:y:2022:i:3:d:10.1007_s11336-021-09824-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.