IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v4y2021i4p49-849d656772.html
   My bibliography  Save this article

Conditional Inference in Small Sample Scenarios Using a Resampling Approach

Author

Listed:
  • Clemens Draxler

    (Institute of Psychology, UMIT—Private University for Health Sciences Medical Informatics and Technology GmbH, 6060 Hall in Tirol, Austria)

  • Andreas Kurz

    (Institute of Psychology, UMIT—Private University for Health Sciences Medical Informatics and Technology GmbH, 6060 Hall in Tirol, Austria)

Abstract

This paper discusses a non-parametric resampling technique in the context of multidimensional or multiparameter hypothesis testing of assumptions of the Rasch model. It is based on conditional distributions and it is suggested in small sample size scenarios as an alternative to the application of asymptotic or large sample theory. The exact sampling distribution of various well-known chi-square test statistics like Wald, likelihood ratio, score, and gradient tests as well as others can be arbitrarily well approximated in this way. A procedure to compute the power function of the tests is also presented. A number of examples of scenarios are discussed in which the power function of the test does not converge to 1 with an increasing deviation of the true values of the parameters of interest from the values specified in the hypothesis to be tested. Finally, an attempt to modify the critical region of the tests is made aiming at improving the power and an R package is provided.

Suggested Citation

  • Clemens Draxler & Andreas Kurz, 2021. "Conditional Inference in Small Sample Scenarios Using a Resampling Approach," Stats, MDPI, vol. 4(4), pages 1-13, October.
    • Handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:49-849:d:656772
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/4/4/49/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/4/4/49/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clemens Draxler & Johannes Zessin, 2015. "The power function of conditional tests of the Rasch model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(3), pages 367-378, July.
    2. Mair, Patrick & Hatzinger, Reinhold, 2007. "Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i09).
    3. Norman Verhelst, 2008. "An Efficient MCMC Algorithm to Sample Binary Matrices with Fixed Marginals," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 705-728, December.
    4. Tom Snijders, 1991. "Enumeration and simulation methods for 0–1 matrices with given marginals," Psychometrika, Springer;The Psychometric Society, vol. 56(3), pages 397-417, September.
    5. Ivo Ponocny, 2001. "Nonparametric goodness-of-fit tests for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 437-459, September.
    6. Gerhard Fischer, 1981. "On the existence and uniqueness of maximum-likelihood estimates in the Rasch model," Psychometrika, Springer;The Psychometric Society, vol. 46(1), pages 59-77, March.
    7. Clemens Draxler & Rainer Alexandrowicz, 2015. "Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 897-919, December.
    8. Yuguo Chen & Dylan Small, 2005. "Exact tests for the rasch model via sequential importance sampling," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 11-30, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    2. Clemens Draxler, 2010. "Sample Size Determination for Rasch Model Tests," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 708-724, December.
    3. Clemens Draxler & Johannes Zessin, 2015. "The power function of conditional tests of the Rasch model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(3), pages 367-378, July.
    4. Yuguo Chen & Dylan Small, 2005. "Exact tests for the rasch model via sequential importance sampling," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 11-30, March.
    5. Jürgen M. Pelikan & Thomas Link & Christa Straßmayr & Karin Waldherr & Tobias Alfers & Henrik Bøggild & Robert Griebler & Maria Lopatina & Dominika Mikšová & Marie Germund Nielsen & Sandra Peer & Mitj, 2022. "Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS 19 -Q12 Instrument in Seventeen Countries," IJERPH, MDPI, vol. 19(21), pages 1-31, October.
    6. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    7. Castro, Jordi & Nasini, Stefano, 2015. "Mathematical programming approaches for classes of random network problems," European Journal of Operational Research, Elsevier, vol. 245(2), pages 402-414.
    8. Jean-Baptiste Gaborieau & Cristina Pronello, 2021. "Validation of a unidimensional and probabilistic measurement scale for pro-environmental behaviour by travellers," Transportation, Springer, vol. 48(2), pages 555-593, April.
    9. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    10. repec:jss:jstsof:39:i08 is not listed on IDEAS
    11. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    12. Cervantes, Víctor H., 2017. "DFIT: An R Package for Raju's Differential Functioning of Items and Tests Framework," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i05).
    13. repec:jss:jstsof:20:i01 is not listed on IDEAS
    14. Bryan S. Graham, 2015. "Methods of Identification in Social Networks," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 465-485, August.
    15. van Rekom, Johan & Wierenga, Berend, 2007. "On the hierarchical nature of means-end relationships in laddering data," Journal of Business Research, Elsevier, vol. 60(4), pages 401-410, April.
    16. Gerhard Fischer, 1983. "Logistic latent trait models with linear constraints," Psychometrika, Springer;The Psychometric Society, vol. 48(1), pages 3-26, March.
    17. Albert Yu & Jeffrey A. Douglas, 2023. "IRT Models for Learning With Item-Specific Learning Parameters," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 866-888, December.
    18. de Leeuw, Jan & Mair, Patrick, 2007. "An Introduction to the Special Volume on "Psychometrics in R"," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i01).
    19. repec:jss:jstsof:36:c01 is not listed on IDEAS
    20. Alexander Robitzsch, 2021. "A Comprehensive Simulation Study of Estimation Methods for the Rasch Model," Stats, MDPI, vol. 4(4), pages 1-23, October.
    21. Gerhard Tutz & Gunther Schauberger, 2015. "A Penalty Approach to Differential Item Functioning in Rasch Models," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 21-43, March.
    22. Hendrikus Kelderman, 1984. "Loglinear Rasch model tests," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 223-245, June.
    23. Georg Gittler & Gerhard Fischer, 2011. "IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€," Journal of Educational and Behavioral Statistics, , vol. 36(1), pages 33-75, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:49-849:d:656772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.