IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v81y2016i4d10.1007_s11336-016-9524-y.html
   My bibliography  Save this article

Covariate-free and Covariate-dependent Reliability

Author

Listed:
  • Peter M. Bentler

    (University of California, Los Angeles)

Abstract

Classical test theory reliability coefficients are said to be population specific. Reliability generalization, a meta-analysis method, is the main procedure for evaluating the stability of reliability coefficients across populations. A new approach is developed to evaluate the degree of invariance of reliability coefficients to population characteristics. Factor or common variance of a reliability measure is partitioned into parts that are, and are not, influenced by control variables, resulting in a partition of reliability into a covariate-dependent and a covariate-free part. The approach can be implemented in a single sample and can be applied to a variety of reliability coefficients.

Suggested Citation

  • Peter M. Bentler, 2016. "Covariate-free and Covariate-dependent Reliability," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 907-920, December.
    • Handle: RePEc:spr:psycho:v:81:y:2016:i:4:d:10.1007_s11336-016-9524-y
    DOI: 10.1007/s11336-016-9524-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-016-9524-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-016-9524-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. José Antonio López-López & Juan Botella & Julio Sánchez-Meca & Fulgencio Marín-Martínez, 2013. "Alternatives for Mixed-Effects Meta-Regression Models in the Reliability Generalization Approach," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 443-469, October.
    2. Tarkkonen, L. & Vehkalahti, K., 2005. "Measurement errors in multivariate measurement scales," Journal of Multivariate Analysis, Elsevier, vol. 96(1), pages 172-189, September.
    3. Henry Kaiser & John Caffrey, 1965. "Alpha factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(1), pages 1-14, March.
    4. Louis Guttman, 1945. "A basis for analyzing test-retest reliability," Psychometrika, Springer;The Psychometric Society, vol. 10(4), pages 255-282, December.
    5. Paul Jackson, 1979. "A note on the relation between coefficient alpha and guttman's “split-half” lower bounds," Psychometrika, Springer;The Psychometric Society, vol. 44(2), pages 251-252, June.
    6. Edgar Merkle & Achim Zeileis, 2013. "Tests of Measurement Invariance Without Subgroups: A Generalization of Classical Methods," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 59-82, January.
    7. Jiajuan Liang & Peter Bentler, 2004. "An EM algorithm for fitting two-level structural equation models," Psychometrika, Springer;The Psychometric Society, vol. 69(1), pages 101-122, March.
    8. P. Bentler & J. Woodward, 1980. "Inequalities among lower bounds to reliability: With applications to test construction and factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 45(2), pages 249-267, June.
    9. Lee Cronbach, 1951. "Coefficient alpha and the internal structure of tests," Psychometrika, Springer;The Psychometric Society, vol. 16(3), pages 297-334, September.
    10. Yuan, Ke-Hai & Bentler, Peter M., 2003. "Eight test statistics for multilevel structural equation models," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 89-107, October.
    11. Peter Bentler, 2009. "Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 137-143, March.
    12. P. Bentler, 1968. "Alpha-maximized factor analysis (alphamax): Its relation to alpha and canonical factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 33(3), pages 335-345, September.
    13. Brian Woodhouse & Paul Jackson, 1977. "Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound," Psychometrika, Springer;The Psychometric Society, vol. 42(4), pages 579-591, December.
    14. P. Bentler & David Weeks, 1980. "Linear structural equations with latent variables," Psychometrika, Springer;The Psychometric Society, vol. 45(3), pages 289-308, September.
    15. Paul Jackson & Christian Agunwamba, 1977. "Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: I: Algebraic lower bounds," Psychometrika, Springer;The Psychometric Society, vol. 42(4), pages 567-578, December.
    16. Tyler Hunt & Peter Bentler, 2015. "Quantile Lower Bounds to Reliability Based on Locally Optimal Splits," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 182-195, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leila Karimi & Denny Meyer, 2019. "An Evaluation of Common Method Variance-Bias in Psychology," International Journal of Psychological Studies, Canadian Center of Science and Education, vol. 11(3), pages 1-83, September.
    2. Rohit Yadav & Tripti Mahara, 2020. "Interactions and Participation on Social Commerce Websites: Exploratory Study," Global Business Review, International Management Institute, vol. 21(4), pages 1127-1152, August.
    3. Peter M. Bentler, 2021. "Alpha, FACTT, and Beyond," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 861-868, December.
    4. Klaas Sijtsma & Julius M. Pfadt, 2021. "Rejoinder: The Future of Reliability," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 887-892, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter M. Bentler, 2021. "Alpha, FACTT, and Beyond," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 861-868, December.
    2. Eunseong Cho, 2021. "Neither Cronbach’s Alpha nor McDonald’s Omega: A Commentary on Sijtsma and Pfadt," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 877-886, December.
    3. Tyler Hunt & Peter Bentler, 2015. "Quantile Lower Bounds to Reliability Based on Locally Optimal Splits," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 182-195, March.
    4. Jos Berge & Willem Hofstee, 1999. "Coefficients alpha and reliabilities of unrotated and rotated components," Psychometrika, Springer;The Psychometric Society, vol. 64(1), pages 83-90, March.
    5. Zhengguo Gu & Wilco H. M. Emons & Klaas Sijtsma, 2021. "Estimating Difference-Score Reliability in Pretest–Posttest Settings," Journal of Educational and Behavioral Statistics, , vol. 46(5), pages 592-610, October.
    6. Klaas Sijtsma & Ivo Molenaar, 1987. "Reliability of test scores in nonparametric item response theory," Psychometrika, Springer;The Psychometric Society, vol. 52(1), pages 79-97, March.
    7. Ke-Hai Yuan & Peter Bentler, 2002. "On robusiness of the normal-theory based asymptotic distributions of three reliability coefficient estimates," Psychometrika, Springer;The Psychometric Society, vol. 67(2), pages 251-259, June.
    8. Alexander Shapiro & Jos Berge, 2000. "The asymptotic bias of minimum trace factor analysis, with applications to the greatest lower bound to reliability," Psychometrika, Springer;The Psychometric Society, vol. 65(3), pages 413-425, September.
    9. Klaas Sijtsma & Julius M. Pfadt, 2021. "Part II: On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha: Discussing Lower Bounds and Correlated Errors," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 843-860, December.
    10. Jos Berge & Gregor Sočan, 2004. "The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality," Psychometrika, Springer;The Psychometric Society, vol. 69(4), pages 613-625, December.
    11. David J. Hessen, 2017. "Lower Bounds to the Reliabilities of Factor Score Estimators," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 648-659, September.
    12. William Revelle & Richard Zinbarg, 2009. "Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 145-154, March.
    13. P. Bentler, 1986. "Structural modeling and psychometrika: An historical perspective on growth and achievements," Psychometrika, Springer;The Psychometric Society, vol. 51(1), pages 35-51, March.
    14. Markus Pauly & Maria Umlauft & Ali Ünlü, 2018. "Resampling-Based Inference Methods for Comparing Two Coefficients Alpha," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 203-222, March.
    15. Anne-Catherine Guio & David Gordon & Eric Marlier & Hector Najera & Marco Pomati, 2018. "Towards an EU measure of child deprivation," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 11(3), pages 835-860, June.
    16. Klaas Sijtsma, 2012. "Future of Psychometrics: Ask What Psychometrics Can Do for Psychology," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 4-20, January.
    17. Jules L. Ellis, 2021. "A Test Can Have Multiple Reliabilities," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 869-876, December.
    18. Massimiliano Pastore & Luigi Lombardi, 2014. "The impact of faking on Cronbach’s alpha for dichotomous and ordered rating scores," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(3), pages 1191-1211, May.
    19. Peter Bentler, 2009. "Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 137-143, March.
    20. Jonathan Schweig, 2014. "Multilevel Factor Analysis by Model Segregation," Journal of Educational and Behavioral Statistics, , vol. 39(5), pages 394-422, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:81:y:2016:i:4:d:10.1007_s11336-016-9524-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.