IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v49y2024i3p403-430.html
   My bibliography  Save this article

An Improved Inferential Procedure to Evaluate Item Discriminations in a Conditional Maximum Likelihood Framework

Author

Listed:
  • Clemens Draxler

    (UMIT TIROL Private University for Health Sciences and Technology)

  • Andreas Kurz

    (University of Salzburg)

  • Can Gürer
  • Jan Philipp Nolte

    (UMIT TIROL Private University for Health Sciences and Technology)

Abstract

A modified and improved inductive inferential approach to evaluate item discriminations in a conditional maximum likelihood and Rasch modeling framework is suggested. The new approach involves the derivation of four hypothesis tests. It implies a linear restriction of the assumed set of probability distributions in the classical approach that represents scenarios of different item discriminations in a straightforward and efficient manner. Its improvement is discussed, compared to classical procedures (tests and information criteria), and illustrated in Monte Carlo experiments as well as real data examples from educational research. The results show an improvement of power of the modified tests of up to 0.3.

Suggested Citation

  • Clemens Draxler & Andreas Kurz & Can Gürer & Jan Philipp Nolte, 2024. "An Improved Inferential Procedure to Evaluate Item Discriminations in a Conditional Maximum Likelihood Framework," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 403-430, June.
    • Handle: RePEc:sae:jedbes:v:49:y:2024:i:3:p:403-430
    DOI: 10.3102/10769986231183335
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986231183335
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986231183335?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    2. Clemens Draxler & Johannes Zessin, 2015. "The power function of conditional tests of the Rasch model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(3), pages 367-378, July.
    3. Geoff Masters, 1982. "A rasch model for partial credit scoring," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 149-174, June.
    4. Mair, Patrick & Hatzinger, Reinhold, 2007. "Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i09).
    5. Norman Verhelst, 2008. "An Efficient MCMC Algorithm to Sample Binary Matrices with Fixed Marginals," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 705-728, December.
    6. Clemens Draxler & Andreas Kurz, 2021. "Conditional Inference in Small Sample Scenarios Using a Resampling Approach," Stats, MDPI, vol. 4(4), pages 1-13, October.
    7. Anders Skrondal & Sophia Rabe-Hesketh, 2022. "The Role of Conditional Likelihoods in Latent Variable Modeling," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 799-834, September.
    8. Gerhard Fischer, 1981. "On the existence and uniqueness of maximum-likelihood estimates in the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 59-77, March.
    9. Clemens Draxler & Rainer Alexandrowicz, 2015. "Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 897-919, December.
    10. J. Pfanzagl, 1993. "On the consistency of conditional maximum likelihood estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 45(4), pages 703-719, December.
    11. Erling Andersen, 1973. "A goodness of fit test for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 38(1), pages 123-140, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clemens Draxler & Andreas Kurz, 2021. "Conditional Inference in Small Sample Scenarios Using a Resampling Approach," Stats, MDPI, vol. 4(4), pages 1-13, October.
    2. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    3. Clemens Draxler & Rainer Alexandrowicz, 2015. "Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 897-919, December.
    4. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    5. Gerhard Tutz & Gunther Schauberger, 2015. "A Penalty Approach to Differential Item Functioning in Rasch Models," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 21-43, March.
    6. Clemens Draxler, 2010. "Sample Size Determination for Rasch Model Tests," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 708-724, December.
    7. Wenjia Wang & Mickaël Guedj & Viviane Bertrand & Julie Foucquier & Elisabeth Jouve & Daniel Commenges & Cécile Proust-Lima & Niall P Murphy & Olivier Blin & Laurent Magy & Daniel Cohen & Shahram Attar, 2017. "A Rasch Analysis of the Charcot-Marie-Tooth Neuropathy Score (CMTNS) in a Cohort of Charcot-Marie-Tooth Type 1A Patients," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-14, January.
    8. Jürgen M. Pelikan & Thomas Link & Christa Straßmayr & Karin Waldherr & Tobias Alfers & Henrik Bøggild & Robert Griebler & Maria Lopatina & Dominika Mikšová & Marie Germund Nielsen & Sandra Peer & Mitj, 2022. "Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS 19 -Q12 Instrument in Seventeen Countries," IJERPH, MDPI, vol. 19(21), pages 1-31, October.
    9. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    10. David J. Hessen, 2023. "Fitting and Testing Log-Linear Subpopulation Models with Known Support," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 917-939, September.
    11. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    12. repec:jss:jstsof:36:c01 is not listed on IDEAS
    13. Alexander Robitzsch, 2021. "A Comprehensive Simulation Study of Estimation Methods for the Rasch Model," Stats, MDPI, vol. 4(4), pages 1-23, October.
    14. Georg Gittler & Gerhard Fischer, 2011. "IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€," Journal of Educational and Behavioral Statistics, , vol. 36(1), pages 33-75, February.
    15. Pedro Henrique Ribeiro Santiago & Rachel Roberts & Lisa Gaye Smithers & Lisa Jamieson, 2019. "Stress beyond coping? A Rasch analysis of the Perceived Stress Scale (PSS-14) in an Aboriginal population," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-24, May.
    16. Robert Zwitser & Gunter Maris, 2015. "Conditional Statistical Inference with Multistage Testing Designs," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 65-84, March.
    17. Jan deLeeuw & Dorota Dabrowska & Norbert Tanzer & Leo Kamp, 1987. "Reviews," Psychometrika, Springer;The Psychometric Society, vol. 52(1), pages 151-160, March.
    18. repec:jss:jstsof:35:i12 is not listed on IDEAS
    19. Carla Sabariego & Cornelia Oberhauser & Aleksandra Posarac & Jerome Bickenbach & Nenad Kostanjsek & Somnath Chatterji & Alana Officer & Michaela Coenen & Lay Chhan & Alarcos Cieza, 2015. "Measuring Disability: Comparing the Impact of Two Data Collection Approaches on Disability Rates," IJERPH, MDPI, vol. 12(9), pages 1-23, August.
    20. Gerhard Fischer, 1989. "An irt-based model for dichotomous longitudinal data," Psychometrika, Springer;The Psychometric Society, vol. 54(4), pages 599-624, September.
    21. Gerhard Fischer, 1995. "Some neglected problems in IRT," Psychometrika, Springer;The Psychometric Society, vol. 60(4), pages 459-487, December.
    22. Rikkert M. van der Lans & Ridwan Maulana & Michelle Helms-Lorenz & Carmen-María Fernández-García & Seyeoung Chun & Thelma de Jager & Yulia Irnidayanti & Mercedes Inda-Caro & Okhwa Lee & Thys Coetze, 2021. "Student Perceptions of Teaching Quality in Five Countries: A Partial Credit Model Approach to Assess Measurement Invariance," SAGE Open, , vol. 11(3), pages 21582440211, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:49:y:2024:i:3:p:403-430. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.