IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v39y2014i3p180-202.html
   My bibliography  Save this article

Measuring Student Ability, Classifying Schools, and Detecting Item Bias at School Level, Based on Student-Level Dichotomous Items

Author

Listed:
  • Margot Bennink
  • Marcel A. Croon

    (Tilburg University)

  • Jos Keuning

    (Psychometric Research Center)

  • Jeroen K. Vermunt

    (Tilburg University)

Abstract

In educational measurement, responses of students on items are used not only to measure the ability of students, but also to evaluate and compare the performance of schools. Analysis should ideally account for the multilevel structure of the data, and school-level processes not related to ability, such as working climate and administration conditions, need to be separated from student and school ability. However, in educational studies such as Programme for International Student Assessment, Trends in International Mathematics and Science Study, and COOL 5–18 , this is hardly ever done. This study presents a model that simultaneously accounts for the nested structure, controls student ability for processes at school level, classifies schools to monitor and compare schools, and tests for school-level item bias.

Suggested Citation

  • Margot Bennink & Marcel A. Croon & Jos Keuning & Jeroen K. Vermunt, 2014. "Measuring Student Ability, Classifying Schools, and Detecting Item Bias at School Level, Based on Student-Level Dichotomous Items," Journal of Educational and Behavioral Statistics, , vol. 39(3), pages 180-202, June.
    • Handle: RePEc:sae:jedbes:v:39:y:2014:i:3:p:180-202
    DOI: 10.3102/1076998614529158
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998614529158
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998614529158?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    2. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    3. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    4. José Dias & Jeroen Vermunt, 2008. "A bootstrap-based aggregate classifier for model-based clustering," Computational Statistics, Springer, vol. 23(4), pages 643-659, October.
    5. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun-Joo Cho & Allan S. Cohen, 2010. "A Multilevel Mixture IRT Model With an Application to DIF," Journal of Educational and Behavioral Statistics, , vol. 35(3), pages 336-370, June.
    2. Sijia Huang & Li Cai, 2024. "Cross-Classified Item Response Theory Modeling With an Application to Student Evaluation of Teaching," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 311-341, June.
    3. Minjeong Jeon & Sophia Rabe-Hesketh, 2012. "Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures," Journal of Educational and Behavioral Statistics, , vol. 37(4), pages 518-542, August.
    4. Isabella Sulis & Mariano Porcu & Vincenza Capursi, 2019. "On the Use of Student Evaluation of Teaching: A Longitudinal Analysis Combining Measurement Issues and Implications of the Exercise," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 142(3), pages 1305-1331, April.
    5. Anders Skrondal & Sophia Rabe‐Hesketh, 2007. "Latent Variable Modelling: A Survey," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 712-745, December.
    6. Meredith Langi & Minjeong Jeon, 2023. "Identifying and Supporting Academically Low-Performing Schools in a Developing Country: An Application of a Specialized Multilevel IRT Model to PISA-D Assessment Data," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 332-356, March.
    7. Sophia Rabe-Hesketh & Anders Skrondal, 2007. "Multilevel and Latent Variable Modeling with Composite Links and Exploded Likelihoods," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 123-140, June.
    8. Li Cai, 2010. "High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 33-57, March.
    9. Ryan Mullins & Raj Agnihotri, 2022. "Digital selling: organizational and managerial influences for frontline readiness and effectiveness," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 800-821, July.
    10. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    11. Dinand Webbink & Pierre Koning & Sunčica Vujić & Nicholas G. Martin, 2013. "Why Are Criminals Less Educated than Non-Criminals? Evidence from a Cohort of Young Australian Twins," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 29(1), pages 115-144, February.
    12. Borghans, Lex & Meijers, Huub & ter Weel, Bas, 2013. "The importance of intrinsic and extrinsic motivation for measuring IQ," Economics of Education Review, Elsevier, vol. 34(C), pages 17-28.
    13. Christine T Cigolle & Corey L Nagel & Caroline S Blaum & Jersey Liang & Ana R Quiñones, 2018. "Inconsistency in the Self-report of Chronic Diseases in Panel Surveys: Developing an Adjudication Method for the Health and Retirement Study," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(5), pages 901-912.
    14. Pesko, Michael F. & Baum, Christopher F., 2016. "The self-medication hypothesis: Evidence from terrorism and cigarette accessibility," Economics & Human Biology, Elsevier, vol. 22(C), pages 94-102.
    15. Bambio, Yiriyibin & Bouayad Agha, Salima, 2018. "Land tenure security and investment: Does strength of land right really matter in rural Burkina Faso?," World Development, Elsevier, vol. 111(C), pages 130-147.
    16. Andrew K. Rose & Mark M. Spiegel, 2010. "Cross‐Country Causes And Consequences Of The 2008 Crisis: International Linkages And American Exposure," Pacific Economic Review, Wiley Blackwell, vol. 15(3), pages 340-363, August.
    17. Eisenkopf, Gerald & Hessami, Zohal & Fischbacher, Urs & Ursprung, Heinrich W., 2015. "Academic performance and single-sex schooling: Evidence from a natural experiment in Switzerland," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 123-143.
    18. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    19. Non, Arjan & Tempelaar, Dirk, 2016. "Time preferences, study effort, and academic performance," Economics of Education Review, Elsevier, vol. 54(C), pages 36-61.
    20. Johannes S. Kunz & Kevin E. Staub, 2016. "Subjective Completion Beliefs and the Demand for Post-Secondary Education," SOEPpapers on Multidisciplinary Panel Data Research 878, DIW Berlin, The German Socio-Economic Panel (SOEP).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:39:y:2014:i:3:p:180-202. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.