IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v116y2013icp310-331.html
   My bibliography  Save this article

Model-based principal components of correlation matrices

Author

Listed:
  • Boik, Robert J.

Abstract

A model for principal components of correlation matrices is proposed. The model satisfies the correlation constraint (i.e., unit valued diagonal elements) as well as optional constraints on eigenvalues and/or eigenvectors. The model yields simplified principal components that retain both orthogonality and variance maximization properties. Inference procedures for eigenvalues, eigenvectors, and loadings on rotated or raw principal components are given. Multivariate normality is not required. A major issue in the modeling process is that the eigen-structure of the population correlation matrix can induce rank deficiencies in the submatrix of the constraint Jacobian matrix that is associated with the correlation constraint. This rank deficiency is a property of the population constraint Jacobian matrix; it is not necessarily a property of the sample Jacobian matrix evaluated at the solution to the estimating equation. Furthermore, if degenerate constraints are eliminated, then the fitted correlation matrix need not satisfy the correlation constraint. Procedures are proposed for detecting rank deficiencies, eliminating degenerate constraints, and constructing auxiliary constraints that ensure that the correlation constraint is satisfied. The procedures are illustrated on two real data sets.

Suggested Citation

  • Boik, Robert J., 2013. "Model-based principal components of correlation matrices," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 310-331.
    • Handle: RePEc:eee:jmvana:v:116:y:2013:i:c:p:310-331
    DOI: 10.1016/j.jmva.2012.11.017
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X1200276X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2012.11.017?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Schott, James R., 1998. "Estimating correlation matrices that have common eigenvectors," Computational Statistics & Data Analysis, Elsevier, vol. 27(4), pages 445-459, June.
    2. Ke-Hai Yuan & Peter Bentler, 2000. "On equivariance and invariance of standard errors in three exploratory factor models," Psychometrika, Springer;The Psychometric Society, vol. 65(1), pages 121-133, March.
    3. Boik, Robert J., 2005. "Second-order accurate inference on eigenvalues of covariance and correlation matrices," Journal of Multivariate Analysis, Elsevier, vol. 96(1), pages 136-171, September.
    4. Robert Boik, 2008. "Newton Algorithms for Analytic Rotation: an Implicit Function Approach," Psychometrika, Springer;The Psychometric Society, vol. 73(2), pages 231-259, June.
    5. Lee, Sik-Yum, 1985. "Analysis of covariance and correlation structures," Computational Statistics & Data Analysis, Elsevier, vol. 2(4), pages 279-295, February.
    6. Krishnaiah, P. R. & Lee, Jack C., 1979. "On the asymptotic joint distributions of certain functions of the eigenvalues of four random matrices," Journal of Multivariate Analysis, Elsevier, vol. 9(2), pages 248-258, June.
    7. Robert J. Boik, 2003. "Principal component models for correlation matrices," Biometrika, Biometrika Trust, vol. 90(3), pages 679-701, September.
    8. Peter Bentler & Ke-Hai Yuan, 1998. "Tests for linear trend in the smallest eigenvalues of the correlation matrix," Psychometrika, Springer;The Psychometric Society, vol. 63(2), pages 131-144, June.
    9. Robert J. Boik, 2002. "Spectral models for covariance matrices," Biometrika, Biometrika Trust, vol. 89(1), pages 159-182, March.
    10. Boik, Robert J., 1998. "A Local Parameterization of Orthogonal and Semi-Orthogonal Matrices with Applications," Journal of Multivariate Analysis, Elsevier, vol. 67(2), pages 244-276, November.
    11. Haruhiko Ogasawara, 2002. "Concise formulas for the standard errors of component loading estimates," Psychometrika, Springer;The Psychometric Society, vol. 67(2), pages 289-297, June.
    12. Kollo, T. & Neudecker, H., 1993. "Asymptotics of Eigenvalues and Unit-Length Eigenvectors of Sample Variance and Correlation Matrices," Journal of Multivariate Analysis, Elsevier, vol. 47(2), pages 283-300, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. D. F. Nwosu & V. U. Ekhosuehi & J. I. Mbegbu, 2020. "Performance of Some Factor Analysis Techniques," Annals of Data Science, Springer, vol. 7(2), pages 209-242, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boik, Robert J., 2005. "Second-order accurate inference on eigenvalues of covariance and correlation matrices," Journal of Multivariate Analysis, Elsevier, vol. 96(1), pages 136-171, September.
    2. Pourahmadi, Mohsen & Daniels, Michael J. & Park, Trevor, 2007. "Simultaneous modelling of the Cholesky decomposition of several covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 98(3), pages 568-587, March.
    3. Zongliang Hu & Zhishui Hu & Kai Dong & Tiejun Tong & Yuedong Wang, 2021. "A shrinkage approach to joint estimation of multiple covariance matrices," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(3), pages 339-374, April.
    4. Robert Boik, 2008. "Newton Algorithms for Analytic Rotation: an Implicit Function Approach," Psychometrika, Springer;The Psychometric Society, vol. 73(2), pages 231-259, June.
    5. Aaron Fisher & Brian Caffo & Brian Schwartz & Vadim Zipunnikov, 2016. "Fast, Exact Bootstrap Principal Component Analysis for > 1 Million," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 846-860, April.
    6. Ryan Browne & Paul McNicholas, 2014. "Estimating common principal components in high dimensions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(2), pages 217-226, June.
    7. Haruhiko Ogasawara, 2003. "Oblique factors and components with independent clusters," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 299-321, June.
    8. Kollo, Tõnu & Ruul, Kaire, 2003. "Approximations to the distribution of the sample correlation matrix," Journal of Multivariate Analysis, Elsevier, vol. 85(2), pages 318-334, May.
    9. Joost Ginkel & Pieter Kroonenberg, 2014. "Using Generalized Procrustes Analysis for Multiple Imputation in Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 242-269, July.
    10. Liu, Shuangzhe & Leiva, Víctor & Zhuang, Dan & Ma, Tiefeng & Figueroa-Zúñiga, Jorge I., 2022. "Matrix differential calculus with applications in the multivariate linear model and its diagnostics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    11. Ke-Hai Yuan & Ying Cheng & Wei Zhang, 2010. "Determinants of Standard Errors of MLEs in Confirmatory Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 633-648, December.
    12. Yinqiu He & Zi Wang & Gongjun Xu, 2021. "A Note on the Likelihood Ratio Test in High-Dimensional Exploratory Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 442-463, June.
    13. Haruhiko Ogasawara, 2009. "Asymptotic expansions in the singular value decomposition for cross covariance and correlation under nonnormality," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(4), pages 995-1017, December.
    14. Peter D. Hoff, 2009. "A hierarchical eigenmodel for pooled covariance estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(5), pages 971-992, November.
    15. Boik, Robert J., 2008. "An implicit function approach to constrained optimization with applications to asymptotic expansions," Journal of Multivariate Analysis, Elsevier, vol. 99(3), pages 465-489, March.
    16. Luca Bagnato & Antonio Punzo, 2021. "Unconstrained representation of orthogonal matrices with application to common principal components," Computational Statistics, Springer, vol. 36(2), pages 1177-1195, June.
    17. Magnus, Jan R., 2010. "On the concept of matrix derivative," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 2200-2206, October.
    18. Ke-Hai Yuan & Yutaka Kano, 2018. "Meta-Analytical SEM: Equivalence Between Maximum Likelihood and Generalized Least Squares," Journal of Educational and Behavioral Statistics, , vol. 43(6), pages 693-720, December.
    19. Bauer, Jan O. & Drabant, Bernhard, 2021. "Principal loading analysis," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    20. Daniels, Michael J., 2006. "Bayesian modeling of several covariance matrices and some results on propriety of the posterior for linear regression with correlated and/or heterogeneous errors," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1185-1207, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:116:y:2013:i:c:p:310-331. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.