IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v36y2011i1p33-75.html
   My bibliography  Save this article

IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€

Author

Listed:
  • Georg Gittler
  • Gerhard Fischer

Abstract

The article extends and applies previous approaches by Klauer and Fischer to the statistical evaluation of ability changes in tests conforming to the Rasch model (RM). Exact uniformly most powerful unbiased (UMPU) hypothesis tests and uniformly most accurate (UMA) confidence intervals (CIs) for the amount of change can be constructed for each testee separately. Under the H 0 of no change, the individual p values of testees can be aggregated also within groups. The current results extend this method by an estimator for a group effect, an exact UMPU test of its significance, a corresponding UMA CI, and a likelihood ratio test for group comparisons. All these methods are applied to two sets of data concerning a highly controversial issue in literature: the so-called Mozart Effect (ME). As test material, a unidimensional test of spatial ability by Gittler and Arendasy was presented to two samples of testees (Studies I and II). On the basis of these data, the occurrence of a short-term effect of the experimental condition can be demonstrated which, however, seems to be related to the relaxation between pretest and posttest rather than to the musical priming.

Suggested Citation

  • Georg Gittler & Gerhard Fischer, 2011. "IRT-Based Measurement of Short-Term Changes of Ability, With an Application to Assessing the “Mozart Effectâ€," Journal of Educational and Behavioral Statistics, , vol. 36(1), pages 33-75, February.
    • Handle: RePEc:sae:jedbes:v:36:y:2011:i:1:p:33-75
    DOI: 10.3102/1076998610366260
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998610366260
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998610366260?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Theo Eggen, 2000. "On the loss of information in conditional maximum likelihood estimation of item parameters," Psychometrika, Springer;The Psychometric Society, vol. 65(3), pages 337-362, September.
    2. Geoff Masters, 1982. "A rasch model for partial credit scoring," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 149-174, June.
    3. Ivo Ponocny, 2001. "Nonparametric goodness-of-fit tests for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 437-459, September.
    4. Johansson, Barbro B., 2006. "Music and brain plasticity," European Review, Cambridge University Press, vol. 14(1), pages 49-64, February.
    5. Michelle Liou & Chih-Hsin Chang, 1992. "Constructing the exact significance level for a person fit statistic," Psychometrika, Springer;The Psychometric Society, vol. 57(2), pages 169-181, June.
    6. Gerhard Fischer, 1987. "Applying the principles of specific objectivity and of generalizability to the measurement of change," Psychometrika, Springer;The Psychometric Society, vol. 52(4), pages 565-587, December.
    7. Karl Klauer, 1991. "An exact and optimal standardized person test for assessing consistency with the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 213-228, June.
    8. Frederic Lord, 1983. "Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability," Psychometrika, Springer;The Psychometric Society, vol. 48(2), pages 233-245, June.
    9. Gerhard Fischer, 1995. "Some neglected problems in IRT," Psychometrika, Springer;The Psychometric Society, vol. 60(4), pages 459-487, December.
    10. Erling Andersen, 1973. "A goodness of fit test for the rasch model," Psychometrika, Springer;The Psychometric Society, vol. 38(1), pages 123-140, March.
    11. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Krammer, Georg, 2019. "The Andersen likelihood ratio test with a random split criterion lacks power," OSF Preprints gu8sq, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Biehler & Heinz Holling & Philipp Doebler, 2015. "Saddlepoint Approximations of the Distribution of the Person Parameter in the Two Parameter Logistic Model," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 665-688, September.
    2. Timo Bechger & Gunter Maris, 2015. "A Statistical Test for Differential Item Pair Functioning," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 317-340, June.
    3. Ivo Poncny, 2000. "Exact person fit indexes for the rasch model for arbitrary alternatives," Psychometrika, Springer;The Psychometric Society, vol. 65(1), pages 29-42, March.
    4. Robert Zwitser & Gunter Maris, 2015. "Conditional Statistical Inference with Multistage Testing Designs," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 65-84, March.
    5. Clemens Draxler, 2010. "Sample Size Determination for Rasch Model Tests," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 708-724, December.
    6. Xiang Liu & Zhuangzhuang Han & Matthew S. Johnson, 2018. "The UMP Exact Test and the Confidence Interval for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 182-202, March.
    7. Jürgen M. Pelikan & Thomas Link & Christa Straßmayr & Karin Waldherr & Tobias Alfers & Henrik Bøggild & Robert Griebler & Maria Lopatina & Dominika Mikšová & Marie Germund Nielsen & Sandra Peer & Mitj, 2022. "Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS 19 -Q12 Instrument in Seventeen Countries," IJERPH, MDPI, vol. 19(21), pages 1-31, October.
    8. Janna Niens & Lisa Richter-Beuschel & Tobias C. Stubbe & Susanne Bögeholz, 2021. "Procedural Knowledge of Primary School Teachers in Madagascar for Teaching and Learning towards Land-Use- and Health-Related Sustainable Development Goals," Sustainability, MDPI, vol. 13(16), pages 1-36, August.
    9. Xiang Liu & James Yang & Hui Soo Chae & Gary Natriello, 2020. "Power Divergence Family of Statistics for Person Parameters in IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 502-525, June.
    10. Chun Wang, 2015. "On Latent Trait Estimation in Multidimensional Compensatory Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 428-449, June.
    11. Marko Böhm & Jan Barkmann & Sabina Eggert & Claus H. Carstensen & Susanne Bögeholz, 2020. "Quantitative Modelling and Perspective Taking: Two Competencies of Decision Making for Sustainable Development," Sustainability, MDPI, vol. 12(17), pages 1-32, August.
    12. David J. Hessen, 2023. "Fitting and Testing Log-Linear Subpopulation Models with Known Support," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 917-939, September.
    13. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    14. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.
    15. Haruhiko Ogasawara, 2013. "Asymptotic properties of the Bayes modal estimators of item parameters in item response theory," Computational Statistics, Springer, vol. 28(6), pages 2559-2583, December.
    16. Seonghoon Kim, 2012. "A Note on the Reliability Coefficients for Item Response Model-Based Ability Estimates," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 153-162, January.
    17. Xiao Li & Hanchen Xu & Jinming Zhang & Hua-hua Chang, 2023. "Deep Reinforcement Learning for Adaptive Learning Systems," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 220-243, April.
    18. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.
    19. Michael Brusco, 2006. "A Repetitive Branch-and-Bound Procedure for Minimum Within-Cluster Sums of Squares Partitioning," Psychometrika, Springer;The Psychometric Society, vol. 71(2), pages 347-363, June.
    20. Clemens Draxler, 2018. "Bayesian conditional inference for Rasch models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 245-262, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:36:y:2011:i:1:p:33-75. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.