IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v4y2021i4p49-849d656772.html
   My bibliography  Save this article

Conditional Inference in Small Sample Scenarios Using a Resampling Approach

Author

Listed:
  • Clemens Draxler

    (Institute of Psychology, UMIT—Private University for Health Sciences Medical Informatics and Technology GmbH, 6060 Hall in Tirol, Austria)

  • Andreas Kurz

    (Institute of Psychology, UMIT—Private University for Health Sciences Medical Informatics and Technology GmbH, 6060 Hall in Tirol, Austria)

Abstract

This paper discusses a non-parametric resampling technique in the context of multidimensional or multiparameter hypothesis testing of assumptions of the Rasch model. It is based on conditional distributions and it is suggested in small sample size scenarios as an alternative to the application of asymptotic or large sample theory. The exact sampling distribution of various well-known chi-square test statistics like Wald, likelihood ratio, score, and gradient tests as well as others can be arbitrarily well approximated in this way. A procedure to compute the power function of the tests is also presented. A number of examples of scenarios are discussed in which the power function of the test does not converge to 1 with an increasing deviation of the true values of the parameters of interest from the values specified in the hypothesis to be tested. Finally, an attempt to modify the critical region of the tests is made aiming at improving the power and an R package is provided.

Suggested Citation

  • Clemens Draxler & Andreas Kurz, 2021. "Conditional Inference in Small Sample Scenarios Using a Resampling Approach," Stats, MDPI, vol. 4(4), pages 1-13, October.
    • Handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:49-849:d:656772
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/4/4/49/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/4/4/49/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clemens Draxler & Johannes Zessin, 2015. "The power function of conditional tests of the Rasch model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(3), pages 367-378, July.
    2. Mair, Patrick & Hatzinger, Reinhold, 2007. "Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i09).
    3. Norman Verhelst, 2008. "An Efficient MCMC Algorithm to Sample Binary Matrices with Fixed Marginals," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 705-728, December.
    4. Tom Snijders, 1991. "Enumeration and simulation methods for 0–1 matrices with given marginals," Psychometrika, Springer;The Psychometric Society, vol. 56(3), pages 397-417, September.
    5. Ivo Ponocny, 2001. "Nonparametric goodness-of-fit tests for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 437-459, September.
    6. Gerhard Fischer, 1981. "On the existence and uniqueness of maximum-likelihood estimates in the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 59-77, March.
    7. Clemens Draxler & Rainer Alexandrowicz, 2015. "Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 897-919, December.
    8. Yuguo Chen & Dylan Small, 2005. "Exact tests for the rasch model via sequential importance sampling," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 11-30, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Clemens Draxler & Andreas Kurz & Can Gürer & Jan Philipp Nolte, 2024. "An Improved Inferential Procedure to Evaluate Item Discriminations in a Conditional Maximum Likelihood Framework," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 403-430, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    2. Clemens Draxler & Andreas Kurz & Can Gürer & Jan Philipp Nolte, 2024. "An Improved Inferential Procedure to Evaluate Item Discriminations in a Conditional Maximum Likelihood Framework," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 403-430, June.
    3. Clemens Draxler, 2010. "Sample Size Determination for Rasch Model Tests," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 708-724, December.
    4. Clemens Draxler & Johannes Zessin, 2015. "The power function of conditional tests of the Rasch model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(3), pages 367-378, July.
    5. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    6. Yuguo Chen & Dylan Small, 2005. "Exact tests for the rasch model via sequential importance sampling," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 11-30, March.
    7. Castro, Jordi & Nasini, Stefano, 2015. "Mathematical programming approaches for classes of random network problems," European Journal of Operational Research, Elsevier, vol. 245(2), pages 402-414.
    8. Jürgen M. Pelikan & Thomas Link & Christa Straßmayr & Karin Waldherr & Tobias Alfers & Henrik Bøggild & Robert Griebler & Maria Lopatina & Dominika Mikšová & Marie Germund Nielsen & Sandra Peer & Mitj, 2022. "Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS 19 -Q12 Instrument in Seventeen Countries," IJERPH, MDPI, vol. 19(21), pages 1-31, October.
    9. Jean-Baptiste Gaborieau & Cristina Pronello, 2021. "Validation of a unidimensional and probabilistic measurement scale for pro-environmental behaviour by travellers," Transportation, Springer, vol. 48(2), pages 555-593, April.
    10. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    11. Mark S. Handcock & Adrian E. Raftery & Jeremy M. Tantrum, 2007. "Model‐based clustering for social networks," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(2), pages 301-354, March.
    12. repec:jss:jstsof:39:i08 is not listed on IDEAS
    13. Frick, Hannah & Strobl, Carolin & Leisch, Friedrich & Zeileis, Achim, 2012. "Flexible Rasch Mixture Models with Package psychomix," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i07).
    14. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    15. Cervantes, Víctor H., 2017. "DFIT: An R Package for Raju's Differential Functioning of Items and Tests Framework," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i05).
    16. repec:jss:jstsof:20:i01 is not listed on IDEAS
    17. repec:jss:jstsof:39:i12 is not listed on IDEAS
    18. Shrum, Trisha & Donovan, Christopher & Bloch, Sadie & Cripps, Emma & Boyson, Ceclia, 2024. "The REBL Score: A dynamic measure of pro-environmental behavior," OSF Preprints w92se, Center for Open Science.
    19. Bryan S. Graham, 2015. "Methods of Identification in Social Networks," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 465-485, August.
    20. van Rekom, Johan & Wierenga, Berend, 2007. "On the hierarchical nature of means-end relationships in laddering data," Journal of Business Research, Elsevier, vol. 60(4), pages 401-410, April.
    21. Gerhard Fischer, 1983. "Logistic latent trait models with linear constraints," Psychometrika, Springer;The Psychometric Society, vol. 48(1), pages 3-26, March.
    22. J. Pfanzagl, 1993. "On the consistency of conditional maximum likelihood estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 45(4), pages 703-719, December.
    23. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:49-849:d:656772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.