IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v37y2012i6p737-757.html
   My bibliography  Save this article

The Impact of Variability of Item Parameter Estimators on Test Information Function

Author

Listed:
  • Jinming Zhang

Abstract

The impact of uncertainty about item parameters on test information functions is investigated. The information function of a test is one of the most important tools in item response theory (IRT). Inaccuracy in the estimation of test information can have substantial consequences on data analyses based on IRT. In this article, the major part (called the adjusted term) of the deviation of an estimated test information function from the true test information function due to the uncertainty of item parameters was approximated asymptotically, and a simulation study shows that this approximation captures the difference between the estimated and the true information functions rather well. A real data example shows that the magnitude of an estimated adjusted term can be substantially large when a sample size is relatively small.

Suggested Citation

  • Jinming Zhang, 2012. "The Impact of Variability of Item Parameter Estimators on Test Information Function," Journal of Educational and Behavioral Statistics, , vol. 37(6), pages 737-757, December.
    • Handle: RePEc:sae:jedbes:v:37:y:2012:i:6:p:737-757
    DOI: 10.3102/1076998612458321
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998612458321
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998612458321?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert Tsutakawa & Jane Johnson, 1990. "The effect of uncertainty of item parameter estimation on ability estimates," Psychometrika, Springer;The Psychometric Society, vol. 55(2), pages 371-390, June.
    2. David Thissen & Howard Wainer, 1982. "Some standard errors in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 47(4), pages 397-412, December.
    3. Sebie Oosterloo, 1984. "Confidence Intervals For Test Information And Relative Efficiency," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 38(2), pages 91-107, June.
    4. Jinming Zhang & Minge Xie & Xiaolan Song & Ting Lu, 2011. "Investigating the Impact of Uncertainty About Item Parameters on Ability Estimation," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 97-118, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giada Spaccapanico Proietti & Mariagiulia Matteucci & Stefania Mignani & Bernard P. Veldkamp, 2024. "Chance-Constrained Automated Test Assembly," Journal of Educational and Behavioral Statistics, , vol. 49(1), pages 92-120, February.
    2. Ogasawara, Haruhiko, 2013. "Asymptotic cumulants of ability estimators using fallible item parameters," Journal of Multivariate Analysis, Elsevier, vol. 119(C), pages 144-162.
    3. Yang Liu & Ji Seung Yang, 2018. "Interval Estimation of Latent Variable Scores in Item Response Theory," Journal of Educational and Behavioral Statistics, , vol. 43(3), pages 259-285, June.
    4. Jodi M. Casabianca & Charles Lewis, 2015. "IRT Item Parameter Recovery With Marginal Maximum Likelihood Estimation Using Loglinear Smoothing Models," Journal of Educational and Behavioral Statistics, , vol. 40(6), pages 547-578, December.
    5. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    6. Chun Wang, 2015. "On Latent Trait Estimation in Multidimensional Compensatory Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 428-449, June.
    7. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    8. Xiao Li & Hanchen Xu & Jinming Zhang & Hua-hua Chang, 2023. "Deep Reinforcement Learning for Adaptive Learning Systems," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 220-243, April.
    9. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.
    10. Martha Stocking, 1990. "Specifying optimum examinees for item parameter estimation in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 55(3), pages 461-475, September.
    11. Yinhong He & Ping Chen, 2020. "Optimal Online Calibration Designs for Item Replenishment in Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 85(1), pages 35-55, March.
    12. Farinaz Havaei & V. Susan Dahinten, 2017. "How Well Does the CWEQ II Measure Structural Empowerment? Findings from Applying Item Response Theory," Administrative Sciences, MDPI, vol. 7(2), pages 1-20, May.
    13. Sheng, Yanyan, 2008. "Markov Chain Monte Carlo Estimation of Normal Ogive IRT Models in MATLAB," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 25(i08).
    14. Michel Philipp & Carolin Strobl & Jimmy de la Torre & Achim Zeileis, 2018. "On the Estimation of Standard Errors in Cognitive Diagnosis Models," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 88-115, February.
    15. Ke-Hai Yuan & Ying Cheng & Jeff Patton, 2014. "Information Matrices and Standard Errors for MLEs of Item Parameters in IRT," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 232-254, April.
    16. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    17. Carrie R. Houts & Melissa A. Z. Knoll, 2020. "The Financial Knowledge Scale: New Analyses, Findings, and Development of a Short Form," Journal of Consumer Affairs, Wiley Blackwell, vol. 54(2), pages 775-800, June.
    18. Ellen Bernadette Maria Elsman & Gerardus Hermanus Maria Bartholomeus van Rens & Ruth Marie Antoinette van Nispen, 2018. "Psychometric properties of a new intake questionnaire for visually impaired young adults: The Participation and Activity Inventory for Young Adults (PAI-YA)," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-24, August.
    19. Lijuan Wang, 2010. "IRT–ZIP Modeling for Multivariate Zero-Inflated Count Data," Journal of Educational and Behavioral Statistics, , vol. 35(6), pages 671-692, December.
    20. repec:jss:jstsof:25:i08 is not listed on IDEAS
    21. Dato Gruijter, 1984. "A comment on ‘some standard errors in item response theory’," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 269-272, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:37:y:2012:i:6:p:737-757. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.