IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v36y2011i1p33-75.html
   My bibliography  Save this article

IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€

Author

Listed:
  • Georg Gittler
  • Gerhard Fischer

Abstract

The article extends and applies previous approaches by Klauer and Fischer to the statistical evaluation of ability changes in tests conforming to the Rasch model (RM). Exact uniformly most powerful unbiased (UMPU) hypothesis tests and uniformly most accurate (UMA) confidence intervals (CIs) for the amount of change can be constructed for each testee separately. Under the H 0 of no change, the individual p values of testees can be aggregated also within groups. The current results extend this method by an estimator for a group effect, an exact UMPU test of its significance, a corresponding UMA CI, and a likelihood ratio test for group comparisons. All these methods are applied to two sets of data concerning a highly controversial issue in literature: the so-called Mozart Effect (ME). As test material, a unidimensional test of spatial ability by Gittler and Arendasy was presented to two samples of testees (Studies I and II). On the basis of these data, the occurrence of a short-term effect of the experimental condition can be demonstrated which, however, seems to be related to the relaxation between pretest and posttest rather than to the musical priming.

Suggested Citation

  • Georg Gittler & Gerhard Fischer, 2011. "IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€," Journal of Educational and Behavioral Statistics, , vol. 36(1), pages 33-75, February.
    • Handle: RePEc:sae:jedbes:v:36:y:2011:i:1:p:33-75
    DOI: 10.3102/1076998610366260
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998610366260
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998610366260?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Geoff Masters, 1982. "A rasch model for partial credit scoring," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 149-174, June.
    2. Johansson, Barbro B., 2006. "Music and brain plasticity," European Review, Cambridge University Press, vol. 14(1), pages 49-64, February.
    3. Michelle Liou & Chih-Hsin Chang, 1992. "Constructing the exact significance level for a person fit statistic," Psychometrika, Springer;The Psychometric Society, vol. 57(2), pages 169-181, June.
    4. Gerhard Fischer, 1987. "Applying the principles of specific objectivity and of generalizability to the measurement of change," Psychometrika, Springer;The Psychometric Society, vol. 52(4), pages 565-587, December.
    5. Gerhard Fischer, 1995. "Some neglected problems in IRT," Psychometrika, Springer;The Psychometric Society, vol. 60(4), pages 459-487, December.
    6. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    7. Theo Eggen, 2000. "On the loss of information in conditional maximum likelihood estimation of item parameters," Psychometrika, Springer;The Psychometric Society, vol. 65(3), pages 337-362, September.
    8. Ivo Ponocny, 2001. "Nonparametric goodness-of-fit tests for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 437-459, September.
    9. Karl Klauer, 1991. "An exact and optimal standardized person test for assessing consistency with the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 213-228, June.
    10. Frederic Lord, 1983. "Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability," Psychometrika, Springer;The Psychometric Society, vol. 48(2), pages 233-245, June.
    11. Erling Andersen, 1973. "A goodness of fit test for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 38(1), pages 123-140, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Krammer, Georg, 2019. "The Andersen likelihood ratio test with a random split criterion lacks power," OSF Preprints gu8sq, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Biehler & Heinz Holling & Philipp Doebler, 2015. "Saddlepoint Approximations of the Distribution of the Person Parameter in the Two Parameter Logistic Model," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 665-688, September.
    2. Robert Zwitser & Gunter Maris, 2015. "Conditional Statistical Inference with Multistage Testing Designs," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 65-84, March.
    3. Clemens Draxler, 2010. "Sample Size Determination for Rasch Model Tests," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 708-724, December.
    4. Jürgen M. Pelikan & Thomas Link & Christa Straßmayr & Karin Waldherr & Tobias Alfers & Henrik Bøggild & Robert Griebler & Maria Lopatina & Dominika Mikšová & Marie Germund Nielsen & Sandra Peer & Mitj, 2022. "Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS 19 -Q12 Instrument in Seventeen Countries," IJERPH, MDPI, vol. 19(21), pages 1-31, October.
    5. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    6. Ivo Poncny, 2000. "Exact person fit indexes for the rasch model for arbitrary alternatives," Psychometrika, Springer;The Psychometric Society, vol. 65(1), pages 29-42, March.
    7. Xiang Liu & Zhuangzhuang Han & Matthew S. Johnson, 2018. "The UMP Exact Test and the Confidence Interval for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 182-202, March.
    8. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    9. David J. Hessen, 2023. "Fitting and Testing Log-Linear Subpopulation Models with Known Support," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 917-939, September.
    10. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    11. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.
    12. Gerhard Tutz & Gunther Schauberger, 2015. "A Penalty Approach to Differential Item Functioning in Rasch Models," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 21-43, March.
    13. Sandip Sinharay, 2015. "The Asymptotic Distribution of Ability Estimates," Journal of Educational and Behavioral Statistics, , vol. 40(5), pages 511-528, October.
    14. David Andrich, 2010. "Sufficiency and Conditional Estimation of Person Parameters in the Polytomous Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 292-308, June.
    15. Sandip Sinharay & Jens Ledet Jensen, 2019. "Higher-Order Asymptotics and Its Application to Testing the Equality of the Examinee Ability Over Two Sets of Items," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 484-510, June.
    16. Oberrauch, Luis & Kaiser, Tim, 2020. "Economic competence in early secondary school: Evidence from a large-scale assessment in Germany," International Review of Economics Education, Elsevier, vol. 35(C).
    17. Stefano Noventa & Luca Stefanutti & Giulio Vidotto, 2014. "An Analysis of Item Response Theory and Rasch Models Based on the Most Probable Distribution Method," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 377-402, July.
    18. Ogasawara, Haruhiko, 2013. "Asymptotic cumulants of ability estimators using fallible item parameters," Journal of Multivariate Analysis, Elsevier, vol. 119(C), pages 144-162.
    19. Yuguo Chen & Dylan Small, 2005. "Exact tests for the rasch model via sequential importance sampling," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 11-30, March.
    20. Sandip Sinharay, 2016. "Asymptotically Correct Standardization of Person-Fit Statistics Beyond Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 992-1013, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:36:y:2011:i:1:p:33-75. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.