IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v82y2017i1d10.1007_s11336-016-9515-z.html
   My bibliography  Save this article

Considering Horn’s Parallel Analysis from a Random Matrix Theory Point of View

Author

Listed:
  • Edoardo Saccenti

    (Wageningen University)

  • Marieke E. Timmerman

    (University of Groningen)

Abstract

Horn’s parallel analysis is a widely used method for assessing the number of principal components and common factors. We discuss the theoretical foundations of parallel analysis for principal components based on a covariance matrix by making use of arguments from random matrix theory. In particular, we show that (i) for the first component, parallel analysis is an inferential method equivalent to the Tracy–Widom test, (ii) its use to test high-order eigenvalues is equivalent to the use of the joint distribution of the eigenvalues, and thus should be discouraged, and (iii) a formal test for higher-order components can be obtained based on a Tracy–Widom approximation. We illustrate the performance of the two testing procedures using simulated data generated under both a principal component model and a common factors model. For the principal component model, the Tracy–Widom test performs consistently in all conditions, while parallel analysis shows unpredictable behavior for higher-order components. For the common factor model, including major and minor factors, both procedures are heuristic approaches, with variable performance. We conclude that the Tracy–Widom procedure is preferred over parallel analysis for statistically testing the number of principal components based on a covariance matrix.

Suggested Citation

  • Edoardo Saccenti & Marieke E. Timmerman, 2017. "Considering Horn’s Parallel Analysis from a Random Matrix Theory Point of View," Psychometrika, Springer;The Psychometric Society, vol. 82(1), pages 186-209, March.
    • Handle: RePEc:spr:psycho:v:82:y:2017:i:1:d:10.1007_s11336-016-9515-z
    DOI: 10.1007/s11336-016-9515-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-016-9515-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-016-9515-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John Horn, 1965. "A rationale and test for the number of factors in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(2), pages 179-185, June.
    2. Peres-Neto, Pedro R. & Jackson, Donald A. & Somers, Keith M., 2005. "How many principal components? stopping rules for determining the number of non-trivial axes revisited," Computational Statistics & Data Analysis, Elsevier, vol. 49(4), pages 974-997, June.
    3. Harding, Matthew C., 2008. "Explaining the single factor bias of arbitrage pricing models in finite samples," Economics Letters, Elsevier, vol. 99(1), pages 85-88, April.
    4. Nick Patterson & Alkes L Price & David Reich, 2006. "Population Structure and Eigenanalysis," PLOS Genetics, Public Library of Science, vol. 2(12), pages 1-20, December.
    5. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    6. Ledyard Tucker & Raymond Koopman & Robert Linn, 1969. "Evaluation of factor analytic research procedures by means of simulated correlation matrices," Psychometrika, Springer;The Psychometric Society, vol. 34(4), pages 421-459, December.
    7. Baik, Jinho & Silverstein, Jack W., 2006. "Eigenvalues of large sample covariance matrices of spiked population models," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1382-1408, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ard H. J. den Reijer & Pieter W. Otter & Jan P. A. M. Jacobs, 2024. "An heuristic scree plot criterion for the number of factors," Statistical Papers, Springer, vol. 65(6), pages 3991-4000, August.
    2. Yoo, Sun-Young & Vonk, M. Elizabeth, 2012. "The development and initial validation of the Immigrant Parental Stress Inventory (IPSI) in a sample of Korean immigrant parents," Children and Youth Services Review, Elsevier, vol. 34(5), pages 989-998.
    3. Hauck, Jana & Suess-Reyes, Julia & Beck, Susanne & Prügl, Reinhard & Frank, Hermann, 2016. "Measuring socioemotional wealth in family-owned and -managed firms: A validation and short form of the FIBER Scale," Journal of Family Business Strategy, Elsevier, vol. 7(3), pages 133-148.
    4. James J. Heckman & Rodrigo Pinto, 2015. "Econometric Mediation Analyses: Identifying the Sources of Treatment Effects from Experimentally Estimated Production Technologies with Unmeasured and Mismeasured Inputs," Econometric Reviews, Taylor & Francis Journals, vol. 34(1-2), pages 6-31, February.
    5. Feher Kristen & Whelan James & Müller Samuel, 2012. "Exploring Multicollinearity Using a Random Matrix Theory Approach," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-35, May.
    6. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    7. Paweł Gajewski, 2017. "Sources of Regional Inflation in Poland," Eastern European Economics, Taylor & Francis Journals, vol. 55(3), pages 261-276, May.
    8. Godfred O Boateng & Shalean M Collins & Patrick Mbullo & Pauline Wekesa & Maricianah Onono & Torsten B Neilands & Sera L Young, 2018. "A novel household water insecurity scale: Procedures and psychometric analysis among postpartum women in western Kenya," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-28, June.
    9. Artür Manukyan & Erhan Çene & Ahmet Sedef & Ibrahim Demir, 2014. "Dandelion plot: a method for the visualization of R-mode exploratory factor analyses," Computational Statistics, Springer, vol. 29(6), pages 1769-1791, December.
    10. Mohieddine Rahmouni, 2014. "Perception des obstacles aux activités d'innovation dans les entreprises tunisiennes," Revue d’économie du développement, De Boeck Université, vol. 22(3), pages 69-98.
    11. Johannes Forkman & Julie Josse & Hans-Peter Piepho, 2019. "Hypothesis Tests for Principal Component Analysis When Variables are Standardized," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(2), pages 289-308, June.
    12. Stefan Schulenberg & Amanda Melton, 2010. "A Confirmatory Factor-Analytic Evaluation of the Purpose in Life Test: Preliminary Psychometric Support for a Replicable Two-Factor Model," Journal of Happiness Studies, Springer, vol. 11(1), pages 95-111, March.
    13. Andrea Zammitti & Isabella Valbusa & Sara Santilli & Maria Cristina Ginevra & Salvatore Soresi & Laura Nota, 2023. "Development and Validation of the Decent Work for Inclusive and Sustainable Future Construction Scale in Italy," Sustainability, MDPI, vol. 15(15), pages 1-19, July.
    14. Hudson F Golino & Sacha Epskamp, 2017. "Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-26, June.
    15. Agyeman, Stephen & Cheng, Lin, 2020. "Analysis of barriers to perceived service quality in Ghana: Students’ perspectives on bus mobility attributes," Transport Policy, Elsevier, vol. 99(C), pages 63-85.
    16. Iacobucci, Dawn & Ruvio, Ayalla & Román, Sergio & Moon, Sangkil & Herr, Paul M., 2022. "How many factors in factor analysis? New insights about parallel analysis with confidence intervals," Journal of Business Research, Elsevier, vol. 139(C), pages 1026-1043.
    17. Paola Zuccolotto, 2012. "Principal component analysis with interval imputed missing values," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(1), pages 1-23, January.
    18. Michael Greenacre & Patrick J. F Groenen & Trevor Hastie & Alfonso Iodice d’Enza & Angelos Markos & Elena Tuzhilina, 2023. "Principal component analysis," Economics Working Papers 1856, Department of Economics and Business, Universitat Pompeu Fabra.
    19. Iyetomi, Hiroshi & Nakayama, Yasuhiro & Yoshikawa, Hiroshi & Aoyama, Hideaki & Fujiwara, Yoshi & Ikeda, Yuichi & Souma, Wataru, 2011. "What causes business cycles? Analysis of the Japanese industrial production data," Journal of the Japanese and International Economies, Elsevier, vol. 25(3), pages 246-272, September.
    20. Klaus, Phil & Kuppelwieser, Volker G. & Heinonen, Kristina, 2023. "Quantifying the influence of customer experience on consumer share-of-category," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:82:y:2017:i:1:d:10.1007_s11336-016-9515-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.