IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v84y2019i3d10.1007_s11336-019-09672-7.html
   My bibliography  Save this article

Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models

Author

Listed:
  • Chun Wang

    (University of Washington)

  • Gongjun Xu

    (University of Michigan)

  • Xue Zhang

    (Northeast Normal University)

Abstract

When latent variables are used as outcomes in regression analysis, a common approach that is used to solve the ignored measurement error issue is to take a multilevel perspective on item response modeling (IRT). Although recent computational advancement allows efficient and accurate estimation of multilevel IRT models, we argue that a two-stage divide-and-conquer strategy still has its unique advantages. Within the two-stage framework, three methods that take into account heteroscedastic measurement errors of the dependent variable in stage II analysis are introduced; they are the closed-form marginal MLE, the expectation maximization algorithm, and the moment estimation method. They are compared to the naïve two-stage estimation and the one-stage MCMC estimation. A simulation study is conducted to compare the five methods in terms of model parameter recovery and their standard error estimation. The pros and cons of each method are also discussed to provide guidelines for practitioners. Finally, a real data example is given to illustrate the applications of various methods using the National Educational Longitudinal Survey data (NELS 88).

Suggested Citation

  • Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.
    • Handle: RePEc:spr:psycho:v:84:y:2019:i:3:d:10.1007_s11336-019-09672-7
    DOI: 10.1007/s11336-019-09672-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-019-09672-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-019-09672-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jean-Paul Fox & Cees Glas, 2003. "Bayesian modeling of measurement error in predictor variables using item response theory," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 169-191, June.
    2. Silvia Bianconcini & Silvia Cagnone, 2012. "A General Multivariate Latent Growth Model With Applications to Student Achievement," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 339-364, April.
    3. Hua-Hua Chang & William Stout, 1993. "The asymptotic posterior normality of the latent trait in an IRT model," Psychometrika, Springer;The Psychometric Society, vol. 58(1), pages 37-52, March.
    4. Devanarayan, Viswanath & Stefanski, Leonard A., 2002. "Empirical simulation extrapolation for measurement error models with replicate measurements," Statistics & Probability Letters, Elsevier, vol. 59(3), pages 219-225, October.
    5. Aeilko Zwinderman, 1991. "A generalized rasch model for manifest predictors," Psychometrika, Springer;The Psychometric Society, vol. 56(4), pages 589-600, December.
    6. James Anderson & David Gerbing, 1984. "The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 155-173, June.
    7. Skrondal, Anders & Kuha, Jouni, 2012. "Improved regression calibration," LSE Research Online Documents on Economics 44135, London School of Economics and Political Science, LSE Library.
    8. Chun Wang, 2015. "On Latent Trait Estimation in Multidimensional Compensatory Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 428-449, June.
    9. Frank Rijmen & Kristof Vansteelandt & Paul Boeck, 2008. "Latent Class Models for Diary Method Data: Parameter Estimation by Local Computations," Psychometrika, Springer;The Psychometric Society, vol. 73(2), pages 167-182, June.
    10. David Magis & Gilles Raîche, 2012. "On the Relationships Between Jeffreys Modal and Weighted Likelihood Estimation of Ability Under Logistic IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 163-169, January.
    11. Jörg Drechsler, 2015. "Multiple Imputation of Multilevel Missing Data—Rigor Versus Simplicity," Journal of Educational and Behavioral Statistics, , vol. 40(1), pages 69-95, February.
    12. Anders Skrondal & Jouni Kuha, 2012. "Improved Regression Calibration," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 649-669, October.
    13. Yang Liu & Ji Seung Yang, 2018. "Bootstrap-Calibrated Interval Estimates for Latent Variable Scores in Item Response Theory," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 333-354, June.
    14. Anders Skrondal & Petter Laake, 2001. "Regression among factor scores," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 563-575, December.
    15. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    16. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    17. Dan D. Goldhaber & Dominic J. Brewer, 1997. "Why Don't Schools and Teachers Seem to Matter? Assessing the Impact of Unobservables on Educational Productivity," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 505-523.
    18. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    19. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. R. Lockwood & Daniel F. McCaffrey, 2014. "Correcting for Test Score Measurement Error in ANCOVA Models for Estimating Treatment Effects," Journal of Educational and Behavioral Statistics, , vol. 39(1), pages 22-52, February.
    2. J. R. Lockwood & Daniel F. McCaffrey, 2017. "Simulation-Extrapolation with Latent Heteroskedastic Error Variance," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 717-736, September.
    3. Sandip Sinharay, 2015. "The Asymptotic Distribution of Ability Estimates," Journal of Educational and Behavioral Statistics, , vol. 40(5), pages 511-528, October.
    4. Mariagiulia Matteucci & Bernard Veldkamp, 2013. "On the use of MCMC computerized adaptive testing with empirical prior information to improve efficiency," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(2), pages 243-267, June.
    5. Zsuzsa Bakk & Jouni Kuha, 2018. "Two-Step Estimation of Models Between Latent Classes and External Variables," Psychometrika, Springer;The Psychometric Society, vol. 83(4), pages 871-892, December.
    6. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.
    7. J. R. Lockwood & D. McCaffrey, 2020. "Using hidden information and performance level boundaries to study student–teacher assignments: implications for estimating teacher causal effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1333-1362, October.
    8. Brian Gin & Nicholas Sim & Anders Skrondal & Sophia Rabe-Hesketh, 2020. "A Dyadic IRT Model," Psychometrika, Springer;The Psychometric Society, vol. 85(3), pages 815-836, September.
    9. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    10. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    11. Chun Wang & Steven W. Nydick, 2020. "On Longitudinal Item Response Theory Models: A Didactic," Journal of Educational and Behavioral Statistics, , vol. 45(3), pages 339-368, June.
    12. Udo Boehm & Maarten Marsman & Han L. J. Maas & Gunter Maris, 2021. "An Attention-Based Diffusion Model for Psychometric Analyses," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 938-972, December.
    13. Ai Ye & Kathleen M. Gates & Teague Rhine Henry & Lan Luo, 2021. "Path and Directionality Discovery in Individual Dynamic Models: A Regularized Unified Structural Equation Modeling Approach for Hybrid Vector Autoregression," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 404-441, June.
    14. Alexander Robitzsch, 2021. "A Comprehensive Simulation Study of Estimation Methods for the Rasch Model," Stats, MDPI, vol. 4(4), pages 1-23, October.
    15. Ke-Hai Yuan & Zhiyong Zhang & Lijuan Wang, 2024. "Signal-to-Noise Ratio in Estimating and Testing the Mediation Effect: Structural Equation Modeling versus Path Analysis with Weighted Composites," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 974-1006, September.
    16. Heijdra Suasnabar, Jan M. & Finch, Aureliano Paolo & Mulhern, Brendan & van den Akker-van Marle, M. Elske, 2024. "Exploring the measurement of health related quality of life and broader instruments: A dimensionality analysis," Social Science & Medicine, Elsevier, vol. 346(C).
    17. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    18. Marie-Ann Sengewald & Steffi Pohl, 2019. "Compensation and Amplification of Attenuation Bias in Causal Effect Estimates," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 589-610, June.
    19. Di Mari, Roberto & Bakk, Zsuzsa & Oser, Jennifer & Kuha, Jouni, 2023. "A two-step estimator for multilevel latent class analysis with covariates," LSE Research Online Documents on Economics 119994, London School of Economics and Political Science, LSE Library.
    20. Fox, Jean-Paul, 2007. "Multilevel IRT Modeling in Practice with the Package mlirt," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i05).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:84:y:2019:i:3:d:10.1007_s11336-019-09672-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.