IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v78y2013i4p669-684.html
   My bibliography  Save this article

Constrained Candecomp/Parafac via the Lasso

Author

Listed:
  • Paolo Giordani
  • Roberto Rocci

Abstract

The Candecomp/Parafac (CP) model is a well-known tool for summarizing a three-way array by extracting a limited number of components. Unfortunately, in some cases, the model suffers from the so-called degeneracy, that is a solution with diverging and uninterpretable components. To avoid degeneracy, orthogonality constraints are usually applied to one of the component matrices. This solves the problem only from a technical point of view because the existence of orthogonal components underlying the data is not guaranteed. For this purpose, we consider some variants of the CP model where the orthogonality constraints are relaxed either by constraining only a pair, or a subset, of components or by stimulating the CP solution to be possibly orthogonal. We theoretically clarify that only the latter approach, based on the least absolute shrinkage and selection operator and named the CP-Lasso, is helpful in solving the degeneracy problem. The results of the application of CP-Lasso on simulated and real life data show its effectiveness. Copyright The Psychometric Society 2013

Suggested Citation

  • Paolo Giordani & Roberto Rocci, 2013. "Constrained Candecomp/Parafac via the Lasso," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 669-684, October.
    • Handle: RePEc:spr:psycho:v:78:y:2013:i:4:p:669-684
    DOI: 10.1007/s11336-013-9321-9
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-013-9321-9
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11336-013-9321-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wim Krijnen & Theo Dijkstra & Alwin Stegeman, 2008. "On the Non-Existence of Optimal Solutions and the Occurrence of “Degeneracy” in the CANDECOMP/PARAFAC Model," Psychometrika, Springer;The Psychometric Society, vol. 73(3), pages 431-439, September.
    2. J. Carroll & Jih-Jie Chang, 1970. "Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition," Psychometrika, Springer;The Psychometric Society, vol. 35(3), pages 283-319, September.
    3. Alwin Stegeman, 2007. "Degeneracy in Candecomp/Parafac and Indscal Explained For Several Three-Sliced Arrays With A Two-Valued Typical Rank," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 601-619, December.
    4. Alwin Stegeman & Jos Berge & Lieven Lathauwer, 2006. "Sufficient conditions for uniqueness in Candecomp/Parafac and Indscal with random component matrices," Psychometrika, Springer;The Psychometric Society, vol. 71(2), pages 219-229, June.
    5. Tomasi, Giorgio & Bro, Rasmus, 2006. "A comparison of algorithms for fitting the PARAFAC model," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1700-1734, April.
    6. Jos Berge & Henk Kiers & Jan Leeuw, 1988. "Explicit candecomp/parafac solutions for a contrived 2 × 2 × 2 array of rank three," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 579-583, December.
    7. Norman Cliff, 1966. "Orthogonal rotation to congruence," Psychometrika, Springer;The Psychometric Society, vol. 31(1), pages 33-42, March.
    8. Krijnen, Wim P., 2006. "Convergence of the sequence of parameters generated by alternating least squares algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 481-489, November.
    9. Alwin Stegeman, 2006. "Degeneracy in Candecomp/Parafac explained for p × p × 2 arrays of rank p + 1 or higher," Psychometrika, Springer;The Psychometric Society, vol. 71(3), pages 483-501, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carmen C. Rodríguez-Martínez & Mitzi Cubilla-Montilla & Purificación Vicente-Galindo & Purificación Galindo-Villardón, 2021. "Sparse STATIS-Dual via Elastic Net," Mathematics, MDPI, vol. 9(17), pages 1-15, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stegeman, Alwin, 2014. "Finding the limit of diverging components in three-way Candecomp/Parafac—A demonstration of its practical merits," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 203-216.
    2. Alwin Stegeman & Tam Lam, 2014. "Three-Mode Factor Analysis by Means of Candecomp/Parafac," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 426-443, July.
    3. Nathaniel Helwig, 2013. "The Special Sign Indeterminacy of the Direct-Fitting Parafac2 Model: Some Implications, Cautions, and Recommendations for Simultaneous Component Analysis," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 725-739, October.
    4. Alwin Stegeman, 2018. "Simultaneous Component Analysis by Means of Tucker3," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 21-47, March.
    5. Alwin Stegeman, 2007. "Degeneracy in Candecomp/Parafac and Indscal Explained For Several Three-Sliced Arrays With A Two-Valued Typical Rank," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 601-619, December.
    6. Paolo Giordani & Roberto Rocci & Giuseppe Bove, 2020. "Factor Uniqueness of the Structural Parafac Model," Psychometrika, Springer;The Psychometric Society, vol. 85(3), pages 555-574, September.
    7. Michele Gallo & Violetta Simonacci & Maria Anna Palma, 2019. "An integrated algorithm for three-way compositional data," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(5), pages 2353-2370, September.
    8. Carlos Martin-Barreiro & John A. Ramirez-Figueroa & Xavier Cabezas & Victor Leiva & Ana Martin-Casado & M. Purificación Galindo-Villardón, 2021. "A New Algorithm for Computing Disjoint Orthogonal Components in the Parallel Factor Analysis Model with Simulations and Applications to Real-World Data," Mathematics, MDPI, vol. 9(17), pages 1-22, August.
    9. Giordani, Paolo & Kiers, Henk A. L. & Del Ferraro, Maria Antonietta, 2014. "Three-Way Component Analysis Using the R Package ThreeWay," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 57(i07).
    10. Mohammed Dosse & Jos Berge & Jorge Tendeiro, 2011. "Some New Results on Orthogonally Constrained Candecomp," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 144-155, July.
    11. Dawn Iacobucci & Doug Grisaffe & Wayne DeSarbo, 2017. "Statistical perceptual maps: using confidence region ellipses to enhance the interpretations of brand positions in multidimensional scaling," Journal of Marketing Analytics, Palgrave Macmillan, vol. 5(3), pages 81-98, December.
    12. Mariela González-Narváez & María José Fernández-Gómez & Susana Mendes & José-Luis Molina & Omar Ruiz-Barzola & Purificación Galindo-Villardón, 2021. "Study of Temporal Variations in Species–Environment Association through an Innovative Multivariate Method: MixSTATICO," Sustainability, MDPI, vol. 13(11), pages 1-25, May.
    13. Wedel, M. & Bijmolt, T.H.A., 1998. "Mixed Tree and Spatial Representation of Dissimilarity Judgments," Discussion Paper 1998-109, Tilburg University, Center for Economic Research.
    14. Pietro Amenta & Antonio Lucadamo & Antonello D’Ambra, 2021. "Restricted Common Component and Specific Weight Analysis: A Constrained Explorative Approach for the Customer Satisfaction Evaluation," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 409-427, August.
    15. Elizabeth Hellier & Kirsteen Aldrich & Daniel B. Wright & Denny Daunt & Judy Edworthy, 2007. "A Multi Dimensional Analysis of Warning Signal Words," Journal of Risk Research, Taylor & Francis Journals, vol. 10(3), pages 323-338, April.
    16. Xu Cheng & Zhipeng Liao & Frank Schorfheide, 2016. "Shrinkage Estimation of High-Dimensional Factor Models with Structural Instabilities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1511-1543.
    17. Elisa Frutos-Bernal & Ángel Martín del Rey & Irene Mariñas-Collado & María Teresa Santos-Martín, 2022. "An Analysis of Travel Patterns in Barcelona Metro Using Tucker3 Decomposition," Mathematics, MDPI, vol. 10(7), pages 1-17, March.
    18. Jad Beyhum & Eric Gautier, 2020. "Factor and factor loading augmented estimators for panel regression," Working Papers hal-02957008, HAL.
    19. Michael Browne & Walter Kristof, 1969. "On the oblique rotation of a factor matrix to a specified pattern," Psychometrika, Springer;The Psychometric Society, vol. 34(2), pages 237-248, June.
    20. Yoshio Takane & Forrest Young & Jan Leeuw, 1977. "Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling features," Psychometrika, Springer;The Psychometric Society, vol. 42(1), pages 7-67, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:78:y:2013:i:4:p:669-684. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.