IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v40y2015i4p343-365.html
   My bibliography  Save this article

Assessment of Person Fit for Mixed-Format Tests

Author

Listed:
  • Sandip Sinharay

    (Pacific Metrics Corporation)

Abstract

Person-fit assessment may help the researcher to obtain additional information regarding the answering behavior of persons. Although several researchers examined person fit, there is a lack of research on person-fit assessment for mixed-format tests. In this article, the l z statistic and the ζ 2 statistic, both of which have been used for tests with only dichotomous items or with only polytomous items, were modified for use with mixed-format tests. In a detailed simulation, the l z and ζ 2 statistics are found to be conservative under a (frequentist) asymptotic normal approximation. However, the use of the statistics along with the (Bayesian) posterior predictive model checking method leads to a larger power. The suggested approaches are applied to an operational data set. The approaches appear to be satisfactory tools for assessing person fit for mixed-format tests.

Suggested Citation

  • Sandip Sinharay, 2015. "Assessment of Person Fit for Mixed-Format Tests," Journal of Educational and Behavioral Statistics, , vol. 40(4), pages 343-365, August.
    • Handle: RePEc:sae:jedbes:v:40:y:2015:i:4:p:343-365
    DOI: 10.3102/1076998615589128
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998615589128
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998615589128?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Johnson, Matthew S., 2007. "Marginal Maximum Likelihood Estimation of Item Response Models in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i10).
    2. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    3. Ivo Molenaar & Herbert Hoijtink, 1990. "The many null distributions of person fit indices," Psychometrika, Springer;The Psychometric Society, vol. 55(1), pages 75-106, March.
    4. Tom Snijders, 2001. "Asymptotic null distribution of person fit statistics with estimated person parameter," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 331-342, September.
    5. Jean-Paul Fox & Cees Glas, 2003. "Bayesian modeling of measurement error in predictor variables using item response theory," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 169-191, June.
    6. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    7. Kikumi Tatsuoka, 1984. "Caution indices based on item response theory," Psychometrika, Springer;The Psychometric Society, vol. 49(1), pages 95-110, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandip Sinharay, 2016. "Asymptotically Correct Standardization of Person-Fit Statistics Beyond Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 992-1013, December.
    2. Kevin Carl P. Santos & Jimmy Torre & Matthias Davier, 2020. "Adjusting Person Fit Index for Skewness in Cognitive Diagnosis Modeling," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 399-420, July.
    3. David Magis & Gilles Raîche & Sébastien Béland, 2012. "A Didactic Presentation of Snijders’s lz* Index of Person Fit With Emphasis on Response Model Selection and Ability Estimation," Journal of Educational and Behavioral Statistics, , vol. 37(1), pages 57-81, February.
    4. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    5. Gregory Camilli & Jean-Paul Fox, 2015. "An Aggregate IRT Procedure for Exploratory Factor Analysis," Journal of Educational and Behavioral Statistics, , vol. 40(4), pages 377-401, August.
    6. Sandip Sinharay, 2016. "Person Fit Analysis in Computerized Adaptive Testing Using Tests for a Change Point," Journal of Educational and Behavioral Statistics, , vol. 41(5), pages 521-549, October.
    7. Sandip Sinharay, 2017. "Detection of Item Preknowledge Using Likelihood Ratio Test and Score Test," Journal of Educational and Behavioral Statistics, , vol. 42(1), pages 46-68, February.
    8. Rob R. Meijer & Jorge N. Tendeiro, 2012. "The Use of the lz and lz* Person-Fit Statistics and Problems Derived From Model Misspecification," Journal of Educational and Behavioral Statistics, , vol. 37(6), pages 758-766, December.
    9. Martijn Jong & Jan-Benedict Steenkamp, 2010. "Finite Mixture Multilevel Multidimensional Ordinal IRT Models for Large Scale Cross-Cultural Research," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 3-32, March.
    10. Sukaesi Marianti & Jean-Paul Fox & Marianna Avetisyan & Bernard P. Veldkamp & Jesper Tijmstra, 2014. "Testing for Aberrant Behavior in Response Time Modeling," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 426-451, December.
    11. Maxwell Hong & Lizhen Lin & Ying Cheng, 2021. "Asymptotically Corrected Person Fit Statistics for Multidimensional Constructs with Simple Structure and Mixed Item Types," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 464-488, June.
    12. Karl Klauer, 1991. "An exact and optimal standardized person test for assessing consistency with the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 213-228, June.
    13. Jeffrey M. Patton & Ying Cheng & Maxwell Hong & Qi Diao, 2019. "Detection and Treatment of Careless Responses to Improve Item Parameter Estimation," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 309-341, June.
    14. Steven Andrew Culpepper & James Joseph Balamuta, 2017. "A Hierarchical Model for Accuracy and Choice on Standardized Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 820-845, September.
    15. Edison M. Choe & Jinming Zhang & Hua-Hua Chang, 2018. "Sequential Detection of Compromised Items Using Response Times in Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 650-673, September.
    16. Martijn G. de Jong & Jan-Benedict E. M. Steenkamp & Bernard P. Veldkamp, 2009. "A Model for the Construction of Country-Specific Yet Internationally Comparable Short-Form Marketing Scales," Marketing Science, INFORMS, vol. 28(4), pages 674-689, 07-08.
    17. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    18. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    19. Wendy Yen & George Burket & Robert Sykes, 1991. "Nonunique solutions to the likelihood equation for the three-parameter logistic model," Psychometrika, Springer;The Psychometric Society, vol. 56(1), pages 39-54, March.
    20. Michael Edwards, 2010. "A Markov Chain Monte Carlo Approach to Confirmatory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 75(3), pages 474-497, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:40:y:2015:i:4:p:343-365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.