IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v36y2021i2d10.1007_s00180-020-01041-8.html
   My bibliography  Save this article

Unconstrained representation of orthogonal matrices with application to common principal components

Author

Listed:
  • Luca Bagnato

    (Università Cattolica del Sacro Cuore)

  • Antonio Punzo

    (Università di Catania)

Abstract

Many statistical problems involve the estimation of a $$\left( d\times d\right) $$ d × d orthogonal matrix $$\varvec{Q}$$ Q . Such an estimation is often challenging due to the orthonormality constraints on $$\varvec{Q}$$ Q . To cope with this problem, we use the well-known PLU decomposition, which factorizes any invertible $$\left( d\times d\right) $$ d × d matrix as the product of a $$\left( d\times d\right) $$ d × d permutation matrix $$\varvec{P}$$ P , a $$\left( d\times d\right) $$ d × d unit lower triangular matrix $$\varvec{L}$$ L , and a $$\left( d\times d\right) $$ d × d upper triangular matrix $$\varvec{U}$$ U . Thanks to the QR decomposition, we find the formulation of $$\varvec{U}$$ U when the PLU decomposition is applied to $$\varvec{Q}$$ Q . We call the result as PLR decomposition; it produces a one-to-one correspondence between $$\varvec{Q}$$ Q and the $$d\left( d-1\right) /2$$ d d - 1 / 2 entries below the diagonal of $$\varvec{L}$$ L , which are advantageously unconstrained real values. Thus, once the decomposition is applied, regardless of the objective function under consideration, we can use any classical unconstrained optimization method to find the minimum (or maximum) of the objective function with respect to $$\varvec{L}$$ L . For illustrative purposes, we apply the PLR decomposition in common principle components analysis (CPCA) for the maximum likelihood estimation of the common orthogonal matrix when a multivariate leptokurtic-normal distribution is assumed in each group. Compared to the commonly used normal distribution, the leptokurtic-normal has an additional parameter governing the excess kurtosis; this makes the estimation of $$\varvec{Q}$$ Q in CPCA more robust against mild outliers. The usefulness of the PLR decomposition in leptokurtic-normal CPCA is illustrated by two biometric data analyses.

Suggested Citation

  • Luca Bagnato & Antonio Punzo, 2021. "Unconstrained representation of orthogonal matrices with application to common principal components," Computational Statistics, Springer, vol. 36(2), pages 1177-1195, June.
  • Handle: RePEc:spr:compst:v:36:y:2021:i:2:d:10.1007_s00180-020-01041-8
    DOI: 10.1007/s00180-020-01041-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-020-01041-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-020-01041-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bernhard Flury & Martin Schmid & A. Narayanan, 1994. "Error rates in quadratic discrimination with constraints on the covariance matrices," Journal of Classification, Springer;The Classification Society, vol. 11(1), pages 101-120, March.
    2. Trendafilov, Nickolay T., 2010. "Stepwise estimation of common principal components," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3446-3457, December.
    3. repec:bla:biomet:v:71:y:2015:i:4:p:1081-1089 is not listed on IDEAS
    4. Angelo Mazza & Antonio Punzo, 2020. "Mixtures of multivariate contaminated normal regression models," Statistical Papers, Springer, vol. 61(2), pages 787-822, April.
    5. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2010. "Testing for Common Principal Components under Heterokurticity," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(7), pages 879-895.
    6. Robert J. Boik, 2002. "Spectral models for covariance matrices," Biometrika, Biometrika Trust, vol. 89(1), pages 159-182, March.
    7. Antonello Maruotti & Antonio Punzo & Luca Bagnato, 2019. "Hidden Markov and Semi-Markov Models with Multivariate Leptokurtic-Normal Components for Robust Modeling of Daily Returns Series," Journal of Financial Econometrics, Oxford University Press, vol. 17(1), pages 91-117.
    8. Flury, Bernhard K., 1986. "Proportionality of k covariance matrices," Statistics & Probability Letters, Elsevier, vol. 4(1), pages 29-33, January.
    9. Boente, Graciela & Pires, Ana M. & Rodrigues, Isabel M., 2006. "General projection-pursuit estimators for the common principal components model: influence functions and Monte Carlo study," Journal of Multivariate Analysis, Elsevier, vol. 97(1), pages 124-147, January.
    10. W. J. Krzanowski, 1984. "Principal Component Analysis in the Presence of Group Structure," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 33(2), pages 164-168, June.
    11. Francesca Greselin & Antonio Punzo, 2013. "Closed Likelihood Ratio Testing Procedures to Assess Similarity of Covariance Matrices," The American Statistician, Taylor & Francis Journals, vol. 67(3), pages 117-128, August.
    12. Francesca Greselin & Salvatore Ingrassia & Antonio Punzo, 2011. "Assessing the pattern of covariance matrices via an augmentation multiple testing procedure," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 20(2), pages 141-170, June.
    13. Bernard N. Flury & Gregory Constantine, 1985. "The F‐G Diagonalization Algorithm," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 34(2), pages 177-183, June.
    14. Pourahmadi, Mohsen & Daniels, Michael J. & Park, Trevor, 2007. "Simultaneous modelling of the Cholesky decomposition of several covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 98(3), pages 568-587, March.
    15. Vrbik, Irene & McNicholas, Paul D., 2014. "Parsimonious skew mixture models for model-based clustering and classification," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 196-210.
    16. Graciela Boente, 2002. "Influence functions and outlier detection under the common principal components model: A robust approach," Biometrika, Biometrika Trust, vol. 89(4), pages 861-875, December.
    17. Lin, Tsung-I, 2014. "Learning from incomplete data via parameterized t mixture models through eigenvalue decomposition," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 183-195.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tortora, Cristina & Franczak, Brian C. & Bagnato, Luca & Punzo, Antonio, 2024. "A Laplace-based model with flexible tail behavior," Computational Statistics & Data Analysis, Elsevier, vol. 192(C).
    2. Punzo, Antonio & Bagnato, Luca, 2022. "Dimension-wise scaled normal mixtures with application to finance and biometry," Journal of Multivariate Analysis, Elsevier, vol. 191(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Graciela Boente & Frank Critchley & Liliana Orellana, 2007. "Influence functions of two families of robust estimators under proportional scatter matrices," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 15(3), pages 295-327, February.
    2. Graciela Boente & Frank Critchley & Liliana Orellana, 2007. "Influence functions of two families of robust estimators under proportional scatter matrices," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 15(3), pages 295-327, February.
    3. Bianco, Ana & Boente, Graciela & Pires, Ana M. & Rodrigues, Isabel M., 2008. "Robust discrimination under a hierarchy on the scatter matrices," Journal of Multivariate Analysis, Elsevier, vol. 99(6), pages 1332-1357, July.
    4. Salvatore D. Tomarchio & Luca Bagnato & Antonio Punzo, 2022. "Model-based clustering via new parsimonious mixtures of heavy-tailed distributions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(2), pages 315-347, June.
    5. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2014. "Efficient R-Estimation of Principal and Common Principal Components," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1071-1083, September.
    6. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2011. "Optimal Rank-Based Tests for Common Principal Components," Working Papers ECARES ECARES 2011-032, ULB -- Universite Libre de Bruxelles.
    7. Juneja, Januj, 2012. "Common factors, principal components analysis, and the term structure of interest rates," International Review of Financial Analysis, Elsevier, vol. 24(C), pages 48-56.
    8. Paindaveine, Davy & Rasoafaraniaina, Rondrotiana Joséa & Verdebout, Thomas, 2017. "Preliminary test estimation for multi-sample principal components," Econometrics and Statistics, Elsevier, vol. 2(C), pages 106-116.
    9. Pourahmadi, Mohsen & Daniels, Michael J. & Park, Trevor, 2007. "Simultaneous modelling of the Cholesky decomposition of several covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 98(3), pages 568-587, March.
    10. Zongliang Hu & Zhishui Hu & Kai Dong & Tiejun Tong & Yuedong Wang, 2021. "A shrinkage approach to joint estimation of multiple covariance matrices," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(3), pages 339-374, April.
    11. Tsukuda, Koji & Matsuura, Shun, 2019. "High-dimensional testing for proportional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 412-420.
    12. Dariush Najarzadeh & Mojtaba Khazaei & Mojtaba Ganjali, 2015. "Testing for equality of ordered eigenvectors of two multivariate normal populations," METRON, Springer;Sapienza Università di Roma, vol. 73(1), pages 57-72, April.
    13. Tortora, Cristina & Franczak, Brian C. & Bagnato, Luca & Punzo, Antonio, 2024. "A Laplace-based model with flexible tail behavior," Computational Statistics & Data Analysis, Elsevier, vol. 192(C).
    14. Boente, Graciela & Molina, Julieta & Sued, Mariela, 2010. "On the asymptotic behavior of general projection-pursuit estimators under the common principal components model," Statistics & Probability Letters, Elsevier, vol. 80(3-4), pages 228-235, February.
    15. Nickolay T. Trendafilov & Tsegay Gebrehiwot Gebru, 2016. "Recipes for sparse LDA of horizontal data," METRON, Springer;Sapienza Università di Roma, vol. 74(2), pages 207-221, August.
    16. Morris, Katherine & Punzo, Antonio & McNicholas, Paul D. & Browne, Ryan P., 2019. "Asymmetric clusters and outliers: Mixtures of multivariate contaminated shifted asymmetric Laplace distributions," Computational Statistics & Data Analysis, Elsevier, vol. 132(C), pages 145-166.
    17. Boente, Graciela & Pires, Ana M. & Rodrigues, Isabel M., 2010. "Detecting influential observations in principal components and common principal components," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 2967-2975, December.
    18. Trendafilov, Nickolay T., 2010. "Stepwise estimation of common principal components," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3446-3457, December.
    19. Paul D. McNicholas, 2016. "Model-Based Clustering," Journal of Classification, Springer;The Classification Society, vol. 33(3), pages 331-373, October.
    20. Bingkai Wang & Xi Luo & Yi Zhao & Brian Caffo, 2021. "Semiparametric partial common principal component analysis for covariance matrices," Biometrics, The International Biometric Society, vol. 77(4), pages 1175-1186, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:36:y:2021:i:2:d:10.1007_s00180-020-01041-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.