IDEAS home Printed from https://ideas.repec.org/p/hhs/bergec/2017_010.html
   My bibliography  Save this paper

The Extent of Bias in Grading

Author

Listed:
  • Andersland, Leroy

    (University of Bergen, Department of Economics)

Abstract

Do biased perceptions and behaviors affect teachers’ assessment of students? To investigate this question, a number of studies use data on two different scores for the same individuals: one non-blind score based on classroom tests assessed by the student’s own teacher and one blind test score based on a national exam marked externally and anonymously. In the absence of bias in teachers’ assessments, it is argued, there should not be significant differences in the gaps in blind and non-blind scores between different groups. This article present a parsimonious econometric framework that distills out the assumptions necessary to identify group bias in teachers’ assessment from such a comparison of blind and non-blind scores. This framework lays the foundation for our empirical analysis, where data from the Norwegian school system are employed to estimate and interpret differences between nonblind and blind assessments. The results show that the relationship between the subject ability and non-blind results tends to be different from the relationship between subject ability and blind results. Evidence of this is found both when grades are recorded when teachers grade the same test and when they grade based on different assessments that are meant to test the same skill. The difference between non-blind and blind will therefore be a function of the skill tested. This leads to different estimates of the group bias when holding ability fixed.

Suggested Citation

  • Andersland, Leroy, 2017. "The Extent of Bias in Grading," Working Papers in Economics 10/17, University of Bergen, Department of Economics.
  • Handle: RePEc:hhs:bergec:2017_010
    as

    Download full text from publisher

    File URL: http://ekstern.filer.uib.no/svf/2017/Working%20Paper%2010-17.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Goldin, Claudia D. & Rouse, Cecilia, 2000. "Orchestrating Impartiality: The Impact of “Blind†Auditions on Female Musicians," Scholarly Articles 30703974, Harvard University Department of Economics.
    2. Hinnerich, Björn Tyrefors & Höglin, Erik & Johannesson, Magnus, 2011. "Are boys discriminated in Swedish high schools?," Economics of Education Review, Elsevier, vol. 30(4), pages 682-690, August.
    3. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    4. van Ewijk, Reyn, 2011. "Same work, lower grade? Student ethnicity and teachers' subjective assessments," Economics of Education Review, Elsevier, vol. 30(5), pages 1045-1058, October.
    5. Christopher Cornwell & David B. Mustard & Jessica Van Parys, 2013. "Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School," Journal of Human Resources, University of Wisconsin Press, vol. 48(1), pages 236-264.
    6. Simon Burgess & Ellen Greaves, 2013. "Test Scores, Subjective Assessment, and Stereotyping of Ethnic Minorities," Journal of Labor Economics, University of Chicago Press, vol. 31(3), pages 535-576.
    7. Maresa Sprietsma, 2013. "Discrimination in grading: experimental evidence from primary school teachers," Empirical Economics, Springer, vol. 45(1), pages 523-538, August.
    8. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    9. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    10. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    11. Bjorn Tyrefors Hinnerich & Erik H�glin & Magnus Johannesson, 2015. "Discrimination against students with foreign backgrounds: evidence from grading in Swedish public high schools," Education Economics, Taylor & Francis Journals, vol. 23(6), pages 660-676, December.
    12. Falch, Torberg & Naper, Linn Renée, 2013. "Educational evaluation schemes and gender gaps in student achievement," Economics of Education Review, Elsevier, vol. 36(C), pages 12-25.
    13. Lindahl, Erica, 2007. "Comparing teachers’ assessments and national test results – evidence from Sweden," Working Paper Series 2007:24, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andresen, Martin Eckhoff & Løkken, Sturla Andreas, 2020. "The Final straw: High school dropout for marginal students," MPRA Paper 106265, University Library of Munich, Germany.
    2. Martin Eckhoff Andresen & Sturla A. Løkken, 2019. "High school dropout for marginal students. Evidence from randomized exam form," Discussion Papers 894, Statistics Norway, Research Department.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Camille Terrier, 2014. "Giving a Little Help to Girls? Evidence on Grade Discrimination and its Effect on Students Achievement," Working Papers hal-01080834, HAL.
    2. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    3. Rangvid Beatrice Schindler, 2019. "Gender Discrimination in Exam Grading? Double Evidence from a Natural Experiment and a Field Experiment," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 19(2), pages 1-23, April.
    4. Lavy, Victor & Sand, Edith, 2018. "On the origins of gender gaps in human capital: Short- and long-term consequences of teachers' biases," Journal of Public Economics, Elsevier, vol. 167(C), pages 263-279.
    5. Victor Lavy & Rigissa Megalokonomou, 2019. "Persistency in Teachers’ Grading Bias and Effects on Longer-Term Outcomes: University Admissions Exams and Choice of Field of Study," NBER Working Papers 26021, National Bureau of Economic Research, Inc.
    6. Lavy, Victor & Sand, Edith, 2015. "On The Origins of Gender Human Capital Gaps: Short and Long Term Consequences of Teachers’ Stereotypical Biases," The Warwick Economics Research Paper Series (TWERPS) 1085, University of Warwick, Department of Economics.
    7. Rangvid, Beatrice Schindler, 2015. "Systematic differences across evaluation schemes and educational choice," Economics of Education Review, Elsevier, vol. 48(C), pages 41-55.
    8. Jansson, Joakim & Tyrefors, Björn, 2018. "Gender Grading Bias at Stockholm University: Quasi-Experimental Evidence from an Anonymous Grading Reform," Working Paper Series 1226, Research Institute of Industrial Economics.
    9. Bjorn Tyrefors Hinnerich & Erik H�glin & Magnus Johannesson, 2015. "Discrimination against students with foreign backgrounds: evidence from grading in Swedish public high schools," Education Economics, Taylor & Francis Journals, vol. 23(6), pages 660-676, December.
    10. Ferman, Bruno & Fontes, Luiz Felipe, 2022. "Assessing knowledge or classroom behavior? Evidence of teachers’ grading bias," Journal of Public Economics, Elsevier, vol. 216(C).
    11. Claudia Contreras, 2018. "Discriminación de género en las calificaciones de las escuelas públicas uruguayas," Documentos de Trabajo (working papers) 0318, Department of Economics - dECON.
    12. Marisa Bucheli & Claudia Contreras, 2018. "Discriminación de género en las calificaciones de las escuelas públicas uruguayas," Documentos de trabajo 2018008, Banco Central del Uruguay.
    13. Hinnerich, Björn Tyrefors & Höglin, Erik & Johannesson, Magnus, 2011. "Ethnic Discrimination in High School Grading: Evidence from a Field Experiment," SSE/EFI Working Paper Series in Economics and Finance 733, Stockholm School of Economics, revised 27 Jun 2011.
    14. Jan Feld & Nicolás Salamanca & Daniel S. Hamermesh, 2016. "Endophilia or Exophobia: Beyond Discrimination," Economic Journal, Royal Economic Society, vol. 126(594), pages 1503-1527, August.
    15. Cappelen, Alexander W. & Falch, Ranveig & Tungodden, Bertil, 2019. "The Boy Crisis: Experimental Evidence on the Acceptance of Males Falling Behind," Discussion Paper Series in Economics 6/2019, Norwegian School of Economics, Department of Economics, revised 01 Mar 2019.
    16. Ferman, Bruno & Fontes, Luiz Felipe, 2020. "Discriminating Behavior: Evidence from teachers’ grading bias," MPRA Paper 100400, University Library of Munich, Germany.
    17. Di Liberto, Adriana & Casula, Laura, 2016. "Teacher Assessments versus Standardized Tests: Is Acting," IZA Discussion Papers 10458, Institute of Labor Economics (IZA).
    18. Simon Burgess & Ellen Greaves, 2013. "Test Scores, Subjective Assessment, and Stereotyping of Ethnic Minorities," Journal of Labor Economics, University of Chicago Press, vol. 31(3), pages 535-576.
    19. Nathalie Greenan & Joseph Lanfranchi & Yannick L'Horty & Mathieu Narcy & Guillaume Pierne, 2018. "Do Competitive Examinations Promote Diversity in Civil Service?," Post-Print halshs-02156947, HAL.
    20. Chowdhury, Shyamal & Klauzner, Ilya & Slonim, Robert, 2020. "What's in a Name? Does Racial or Gender Discrimination in Marking Exist?," IZA Discussion Papers 13890, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    Discrimination; bias; human capital; test scores;
    All these keywords.

    JEL classification:

    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • D80 - Microeconomics - - Information, Knowledge, and Uncertainty - - - General
    • J15 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:bergec:2017_010. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kjell Erik Lommerud (email available below). General contact details of provider: https://edirc.repec.org/data/iouibno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.