IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v83y2018i2d10.1007_s11336-017-9582-9.html
   My bibliography  Save this article

Bootstrap-Calibrated Interval Estimates for Latent Variable Scores in Item Response Theory

Author

Listed:
  • Yang Liu

    (University of Maryland)

  • Ji Seung Yang

    (University of Maryland)

Abstract

In most item response theory applications, model parameters need to be first calibrated from sample data. Latent variable (LV) scores calculated using estimated parameters are thus subject to sampling error inherited from the calibration stage. In this article, we propose a resampling-based method, namely bootstrap calibration (BC), to reduce the impact of the carryover sampling error on the interval estimates of LV scores. BC modifies the quantile of the plug-in posterior, i.e., the posterior distribution of the LV evaluated at the estimated model parameters, to better match the corresponding quantile of the true posterior, i.e., the posterior distribution evaluated at the true model parameters, over repeated sampling of calibration data. Furthermore, to achieve better coverage of the fixed true LV score, we explore the use of BC in conjunction with Jeffreys’ prior. We investigate the finite-sample performance of BC via Monte Carlo simulations and apply it to two empirical data examples.

Suggested Citation

  • Yang Liu & Ji Seung Yang, 2018. "Bootstrap-Calibrated Interval Estimates for Latent Variable Scores in Item Response Theory," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 333-354, June.
    • Handle: RePEc:spr:psycho:v:83:y:2018:i:2:d:10.1007_s11336-017-9582-9
    DOI: 10.1007/s11336-017-9582-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-017-9582-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-017-9582-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yang Liu & Jan Hannig, 2016. "Generalized Fiducial Inference for Binary Logistic Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 81(2), pages 290-324, June.
    2. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    3. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    4. Chalmers, R. Philip, 2012. "mirt: A Multidimensional Item Response Theory Package for the R Environment," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i06).
    5. Carol Woods & David Thissen, 2006. "Item Response Theory with Estimation of the Latent Population Distribution Using Spline-Based Densities," Psychometrika, Springer;The Psychometric Society, vol. 71(2), pages 281-301, June.
    6. Paolo Vidoni, 2009. "Improved Prediction Intervals and Distribution Functions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 735-748, December.
    7. Yang Liu & Jan Hannig, 2017. "Generalized Fiducial Inference for Logistic Graded Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1097-1125, December.
    8. Judith Rousseau, 2000. "Coverage Properties of One-Sided Intervals in the Discrete Case and Application to Matching Priors," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 52(1), pages 28-42, March.
    9. Rizopoulos, Dimitris, 2006. "ltm: An R Package for Latent Variable Modeling and Item Response Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 17(i05).
    10. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    11. Richard J. Patz & Brian W. Junker, 1999. "A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models," Journal of Educational and Behavioral Statistics, , vol. 24(2), pages 146-178, June.
    12. Hua-Hua Chang & William Stout, 1993. "The asymptotic posterior normality of the latent trait in an IRT model," Psychometrika, Springer;The Psychometric Society, vol. 58(1), pages 37-52, March.
    13. Carol M. Woods & David Thissen, 2006. "Item Response Theory with Estimation of the Latent Population Distribution Using Spline-Based Densities," Psychometrika, Springer;The Psychometric Society, vol. 71(2), pages 281-301, June.
    14. Stephen Schilling & R. Bock, 2005. "High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature," Psychometrika, Springer;The Psychometric Society, vol. 70(3), pages 533-555, September.
    15. James H. Albert, 1992. "Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling," Journal of Educational and Behavioral Statistics, , vol. 17(3), pages 251-269, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    2. Yang Liu & Ji Seung Yang & Alberto Maydeu-Olivares, 2019. "Restricted Recalibration of Item Response Theory Models," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 529-553, June.
    3. Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher J. Urban & Daniel J. Bauer, 2021. "A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 1-29, March.
    2. Yang Liu, 2020. "A Riemannian Optimization Algorithm for Joint Maximum Likelihood Estimation of High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 439-468, June.
    3. Li Cai, 2010. "A Two-Tier Full-Information Item Factor Analysis Model with Applications," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 581-612, December.
    4. Yang Liu & Jan Hannig, 2017. "Generalized Fiducial Inference for Logistic Graded Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1097-1125, December.
    5. Yang Liu & Ji Seung Yang, 2018. "Interval Estimation of Latent Variable Scores in Item Response Theory," Journal of Educational and Behavioral Statistics, , vol. 43(3), pages 259-285, June.
    6. Bianconcini, Silvia & Cagnone, Silvia, 2012. "Estimation of generalized linear latent variable models via fully exponential Laplace approximation," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 183-193.
    7. Zhehan Jiang & Jonathan Templin, 2019. "Gibbs Samplers for Logistic Item Response Models via the Pólya–Gamma Distribution: A Computationally Efficient Data-Augmentation Strategy," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 358-374, June.
    8. Ying Cheng & Cheng Liu & John Behrens, 2015. "Standard Error of Ability Estimates and the Classification Accuracy and Consistency of Binary Decisions," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 645-664, September.
    9. Vitoratou, Silia & Ntzoufras, Ioannis & Moustaki, Irini, 2016. "Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions," LSE Research Online Documents on Economics 57685, London School of Economics and Political Science, LSE Library.
    10. Björn Andersson & Tao Xin, 2021. "Estimation of Latent Regression Item Response Theory Models Using a Second-Order Laplace Approximation," Journal of Educational and Behavioral Statistics, , vol. 46(2), pages 244-265, April.
    11. Steven P. Reise & Han Du & Emily F. Wong & Anne S. Hubbard & Mark G. Haviland, 2021. "Matching IRT Models to Patient-Reported Outcomes Constructs: The Graded Response and Log-Logistic Models for Scaling Depression," Psychometrika, Springer;The Psychometric Society, vol. 86(3), pages 800-824, September.
    12. Ke-Hai Yuan & Ying Cheng & Jeff Patton, 2014. "Information Matrices and Standard Errors for MLEs of Item Parameters in IRT," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 232-254, April.
    13. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    14. Ji Seung Yang & Xiaying Zheng, 2018. "Item Response Data Analysis Using Stata Item Response Theory Package," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 116-129, February.
    15. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    16. Longjuan Liang & Michael W. Browne, 2015. "A Quasi-Parametric Method for Fitting Flexible Item Response Functions," Journal of Educational and Behavioral Statistics, , vol. 40(1), pages 5-34, February.
    17. Scott Monroe, 2021. "Testing Latent Variable Distribution Fit in IRT Using Posterior Residuals," Journal of Educational and Behavioral Statistics, , vol. 46(3), pages 374-398, June.
    18. Yunxiao Chen & Xiaoou Li & Siliang Zhang, 2019. "Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 124-146, March.
    19. Ping Chen & Chun Wang, 2021. "Using EM Algorithm for Finite Mixtures and Reformed Supplemented EM for MIRT Calibration," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 299-326, March.
    20. Javier Revuelta, 2008. "The generalized Logit-Linear Item Response Model for Binary-Designed Items," Psychometrika, Springer;The Psychometric Society, vol. 73(3), pages 385-405, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:83:y:2018:i:2:d:10.1007_s11336-017-9582-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.