IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v46y2021i4p466-500.html
   My bibliography  Save this article

Ordinal Approaches to Decomposing Between-Group Test Score Disparities

Author

Listed:
  • David M. Quinn

    (University of Southern California)

  • Andrew D. Ho

    (Harvard Graduate School of Education)

Abstract

The estimation of test score “gaps†and gap trends plays an important role in monitoring educational inequality. Researchers decompose gaps and gap changes into within- and between-school portions to generate evidence on the role schools play in shaping these inequalities. However, existing decomposition methods assume an equal-interval test scale and are a poor fit to coarsened data such as proficiency categories. This leaves many potential data sources ill-suited for decomposition applications. We develop two decomposition approaches that overcome these limitations: an extension of V, an ordinal gap statistic, and an extension of ordered probit models. Simulations show V decompositions have negligible bias with small within-school samples. Ordered probit decompositions have negligible bias with large within-school samples but more serious bias with small within-school samples. More broadly, our methods enable analysts to (1) decompose the difference between two groups on any ordinal outcome into portions within- and between some third categorical variable and (2) estimate scale-invariant between-group differences that adjust for a categorical covariate.

Suggested Citation

  • David M. Quinn & Andrew D. Ho, 2021. "Ordinal Approaches to Decomposing Between-Group Test Score Disparities," Journal of Educational and Behavioral Statistics, , vol. 46(4), pages 466-500, August.
    • Handle: RePEc:sae:jedbes:v:46:y:2021:i:4:p:466-500
    DOI: 10.3102/1076998620967726
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620967726
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620967726?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Oaxaca, Ronald, 1973. "Male-Female Wage Differentials in Urban Labor Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(3), pages 693-709, October.
    2. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    3. Dale Ballou, 2009. "Test Scaling and Value-Added Measurement," Education Finance and Policy, MIT Press, vol. 4(4), pages 351-383, October.
    4. Ben Domingue, 2014. "Evaluating the Equal-Interval Hypothesis with Test Score Scales," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 1-19, January.
    5. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    6. Eric A. Hanushek & Steven G. Rivkin, 2006. "School Quality and the Black-White Achievement Gap," NBER Working Papers 12651, National Bureau of Economic Research, Inc.
    7. Timothy N. Bond & Kevin Lang, 2019. "The Sad Truth about Happiness Scales," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1629-1640.
    8. Eric R. Nielsen, 2015. "Achievement Gap Estimates and Deviations from Cardinal Comparability," Finance and Economics Discussion Series 2015-40, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tymon Słoczyński, 2020. "Average Gaps and Oaxaca–Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," ILR Review, Cornell University, ILR School, vol. 73(3), pages 705-729, May.
    2. Brian Jacob & Jesse Rothstein, 2016. "The Measurement of Student Ability in Modern Assessment Systems," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 85-108, Summer.
    3. Eric R. Nielsen, 2015. "The Income-Achievement Gap and Adult Outcome Inequality," Finance and Economics Discussion Series 2015-41, Board of Governors of the Federal Reserve System (U.S.).
    4. McDonough, Ian K., 2015. "Dynamics of the black–white gap in academic achievement," Economics of Education Review, Elsevier, vol. 47(C), pages 17-33.
    5. Sloczynski, Tymon, 2018. "Average Gaps and Oaxaca's Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," IZA Discussion Papers 12041, Institute of Labor Economics (IZA).
    6. Eric R. Nielsen, 2015. "Achievement Gap Estimates and Deviations from Cardinal Comparability," Finance and Economics Discussion Series 2015-40, Board of Governors of the Federal Reserve System (U.S.).
    7. Das, Jishnu & Singh, Abhijeet & Yi Chang, Andres, 2022. "Test scores and educational opportunities: Panel evidence from five low- and middle-income countries," Journal of Public Economics, Elsevier, vol. 206(C).
    8. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    9. Barber, Michael & Jones, Maggie E.C., 2021. "Inequalities in test scores between Indigenous and non-Indigenous youth in Canada," Economics of Education Review, Elsevier, vol. 83(C).
    10. Huong Thu Le & Ha Trong Nguyen, 2018. "The evolution of the gender test score gap through seventh grade: new insights from Australia using unconditional quantile regression and decomposition," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-42, December.
    11. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    12. Jesse Rothstein, 2019. "Inequality of Educational Opportunity? Schools as Mediators of the Intergenerational Transmission of Income," Journal of Labor Economics, University of Chicago Press, vol. 37(S1), pages 85-123.
    13. Bond, Timothy N. & Bulman, George & Li, Xiaoxiao & Smith, Jonathan, 2016. "Updated Expectations and College Application Portfolios," MPRA Paper 69317, University Library of Munich, Germany.
    14. Eric A. Hanushek & Steven G. Rivkin, 2009. "Harming the best: How schools affect the black-white achievement gap," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 28(3), pages 366-393.
    15. Bond, Timothy N. & Lehmann, Jee-Yeon K., 2018. "Prejudice and racial matches in employment," Labour Economics, Elsevier, vol. 51(C), pages 271-293.
    16. Andrew Leigh & Xiaodong Gong, 2009. "Estimating cognitive gaps between Indigenous and non-Indigenous Australians," Education Economics, Taylor & Francis Journals, vol. 17(2), pages 239-261.
    17. Patacchini, Eleonora & Zenou, Yves, 2007. "The Racial Test Score Gap and Parental Involvement in Britain," IZA Discussion Papers 2613, Institute of Labor Economics (IZA).
    18. Jeffrey Penney, 2017. "Racial Interaction Effects and Student Achievement," Education Finance and Policy, MIT Press, vol. 12(4), pages 447-467, Fall.
    19. Hull, Marie & Norris, Jonathan, 2020. "The skill development of children of immigrants," Economics of Education Review, Elsevier, vol. 78(C).
    20. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:46:y:2021:i:4:p:466-500. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.