IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v62y2017icp138-147.html
   My bibliography  Save this article

Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions

Author

Listed:
  • Gignac, Gilles E.
  • Kretzschmar, André

Abstract

Many differential cognitive psychologists appear to interpret correlated-factor models associated with inter-latent variable correlations meaningfully <1.0 as support for the plausibility of several related, but to some degree distinct, dimensions. It is contended in this paper that such a conclusion drawn from a well-fitting correlated-factor model may not be justified necessarily, even if the correlated-factor model fits better than a single-factor model. Based on a series of simulated correlation matrices, it is demonstrated that a well-fitting correlated-factor model with inter-latent variable correlations <1.0 only suggests the possibility of several distinct group-level dimensions. In order to obtain additional useful information relevant to the distinctness of the hypothesized group-level factors, a higher-order model is demonstrated to be particularly useful, especially when complemented with omega hierarchical subscale (omegaHS), an effect size index of unique latent variable strength. The following guidelines are provided to help interpret the magnitude of omegaHS values: relatively small <0.20; typical 0.20 to 0.30; and relatively large >0.30. The implications of the simulation are demonstrated based on the re-analysis of three previously published correlations relevant to cognitive processes. Researchers are encouraged to supplement correlated-factor model analyses with higher-order model analyses, in order to evaluate the distinctness of the hypothesized dimensions more fully.

Suggested Citation

  • Gignac, Gilles E. & Kretzschmar, André, 2017. "Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions," Intelligence, Elsevier, vol. 62(C), pages 138-147.
    • Handle: RePEc:eee:intell:v:62:y:2017:i:c:p:138-147
    DOI: 10.1016/j.intell.2017.04.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289616301404
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2017.04.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John Schmid & John Leiman, 1957. "The development of hierarchical factor solutions," Psychometrika, Springer;The Psychometric Society, vol. 22(1), pages 53-61, March.
    2. James Steiger & Alexander Shapiro & Michael Browne, 1985. "On the multivariate asymptotic distribution of sequential Chi-square statistics," Psychometrika, Springer;The Psychometric Society, vol. 50(3), pages 253-263, September.
    3. Nadine Correia Santos & Patrício Soares Costa & Liliana Amorim & Pedro Silva Moreira & Pedro Cunha & Jorge Cotter & Nuno Sousa, 2015. "Exploring the Factor Structure of Neurocognitive Measures in Older Individuals," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-18, April.
    4. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kampa, Nele & Scherer, Ronny & Saß, Steffani & Schipolowski, Stefan, 2021. "The relation between science achievement and general cognitive abilities in large-scale assessments," Intelligence, Elsevier, vol. 86(C).
    2. Sai-fu Fung & Esther Oi-wah Chow & Chau-kiu Cheung, 2020. "Development and Evaluation of the Psychometric Properties of a Brief Wisdom Development Scale," IJERPH, MDPI, vol. 17(8), pages 1-14, April.
    3. Marco Batista & Marta Leyton-Román & Samuel Honório & Jorge Santos & Ruth Jiménez-Castuera, 2020. "Validation of the Portuguese Version of the Healthy Lifestyle Questionnaire," IJERPH, MDPI, vol. 17(4), pages 1-12, February.
    4. Brydges, Christopher R. & Gignac, Gilles E. & Ecker, Ullrich K.H., 2018. "Working memory capacity, short-term memory capacity, and the continued influence effect: A latent-variable analysis," Intelligence, Elsevier, vol. 69(C), pages 117-122.
    5. Piotr Koc, 2021. "Measuring Non-electoral Political Participation: Bi-factor Model as a Tool to Extract Dimensions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(1), pages 271-287, July.
    6. Marco Batista & Marta Leyton-Román & Ruth Jiménez-Castuera, 2022. "Validity and Reliability of the Portuguese Version of the Healthy Lifestyle Questionnaire—EVS III," IJERPH, MDPI, vol. 19(3), pages 1-13, January.
    7. Giofrè, David & Pastore, Massimiliano & Cornoldi, Cesare & Toffalini, Enrico, 2019. "Lumpers vs. splitters: Intelligence in children with specific learning disorders," Intelligence, Elsevier, vol. 76(C), pages 1-1.
    8. Dennis Sing-wing Wong & Sai-fu Fung, 2020. "Development of the Cybercrime Rapid Identification Tool for Adolescents," IJERPH, MDPI, vol. 17(13), pages 1-13, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jinshu Cui & Heather Rosoff & Richard S. John, 2018. "Public Response to a Near‐Miss Nuclear Accident Scenario Varying in Causal Attributions and Outcome Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(5), pages 947-961, May.
    2. Kan, Kees-Jan & van der Maas, Han L.J. & Levine, Stephen Z., 2019. "Extending psychometric network analysis: Empirical evidence against g in favor of mutualism?," Intelligence, Elsevier, vol. 73(C), pages 52-62.
    3. Hartung, Johanna & Doebler, Philipp & Schroeders, Ulrich & Wilhelm, Oliver, 2018. "Dedifferentiation and differentiation of intelligence in adults across age and years of education," Intelligence, Elsevier, vol. 69(C), pages 37-49.
    4. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    5. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    6. Fetene B. Tekle & Dereje W. Gudicha & Jeroen K. Vermunt, 2016. "Power analysis for the bootstrap likelihood ratio test for the number of classes in latent class models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 10(2), pages 209-224, June.
    7. Nathaniel Oliver Iotti & Damiano Menin & Tomas Jungert, 2022. "Early Adolescents’ Motivations to Defend Victims of Cyberbullying," IJERPH, MDPI, vol. 19(14), pages 1-9, July.
    8. Christoph Dworschak, 2024. "Bias mitigation in empirical peace and conflict studies: A short primer on posttreatment variables," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(3), pages 462-476, May.
    9. Andreea-Ionela Puiu & Anca Monica Ardeleanu & Camelia Cojocaru & Anca Bratu, 2021. "Exploring the Effect of Status Quo, Innovativeness, and Involvement Tendencies on Luxury Fashion Innovations: The Mediation Role of Status Consumption," Mathematics, MDPI, vol. 9(9), pages 1-18, May.
    10. Slupphaug, KJell & Mehmetoglu, Mehmet & Mittner, Matthias, 2024. "modsem: An R package for estimating latent interactions and quadratic effects," OSF Preprints h3rpw, Center for Open Science.
    11. Allen, Jaime & Muñoz, Juan Carlos & Ortúzar, Juan de Dios, 2019. "On evasion behaviour in public transport: Dissatisfaction or contagion?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 626-651.
    12. Merkle, Edgar C. & Steyvers, Mark & Mellers, Barbara & Tetlock, Philip E., 2017. "A neglected dimension of good forecasting judgment: The questions we choose also matter," International Journal of Forecasting, Elsevier, vol. 33(4), pages 817-832.
    13. Sai-fu Fung & Esther Oi-wah Chow & Chau-kiu Cheung, 2020. "Development and Evaluation of the Psychometric Properties of a Brief Wisdom Development Scale," IJERPH, MDPI, vol. 17(8), pages 1-14, April.
    14. Dang Vu, Hoai Nam & Nielsen, Martin Reinhardt, 2022. "Understanding determinants of the intention to buy rhino horn in Vietnam through the Theory of Planned Behaviour and the Theory of Interpersonal Behaviour," Ecological Economics, Elsevier, vol. 195(C).
    15. Georges Steffgen & Philipp E. Sischka & Martha Fernandez de Henestrosa, 2020. "The Quality of Work Index and the Quality of Employment Index: A Multidimensional Approach of Job Quality and Its Links to Well-Being at Work," IJERPH, MDPI, vol. 17(21), pages 1-31, October.
    16. Zaitun Mohd Saman & Ab Hamid Siti-Azrin & Azizah Othman & Yee Cheng Kueh, 2021. "The Validity and Reliability of the Malay Version of the Cyberbullying Scale among Secondary School Adolescents in Malaysia," IJERPH, MDPI, vol. 18(21), pages 1-12, November.
    17. Dennis Cook, R. & Forzani, Liliana, 2023. "On the role of partial least squares in path analysis for the social sciences," Journal of Business Research, Elsevier, vol. 167(C).
    18. Castaldo, Sandro & Ciacci, Andrea & Penco, Lara, 2023. "Perceived corporate social responsibility and job satisfaction in grocery retail: A comparison between low- and high-productivity stores," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    19. Daniel Hoppe, 2021. "Argument-Based Versus Emotion-Based Videos During the Early Stages of Recruitment: Effects on Perceived Employer Brand Image, Application Intentions, and Positive Word-of-Mouth," Corporate Reputation Review, Palgrave Macmillan, vol. 24(1), pages 31-47, February.
    20. Chen, Junhong & Nian, Yefan & Gao, Zhifeng, 2022. "Value, Attitude/Belief, and Sustainable Food Consumption," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322485, Agricultural and Applied Economics Association.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:62:y:2017:i:c:p:138-147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.