IDEAS home Printed from https://ideas.repec.org/p/feb/artefa/00728.html
   My bibliography  Save this paper

What Do Names Reveal? Impacts of Blind Evaluations on Composition and Quality

Author

Listed:
  • Haruka Uchida

Abstract

Concealing candidate identities during evaluations, or "blinding", is often proposed as a tool for combatting discrimination. I study how blinding impacts candidate selection and quality, and the forms of discrimination driving these effects. I conduct a natural field experiment at an academic conference, running each submitted paper through both blind and non-blind review. Four years after the experiment, I collect proxy measures of paper quality—citations and publication statuses—for each paper and link it to the experimental data. I find that blinding significantly reduces scores for traditionally high-scoring groups, and consequently alters the composition of applicants who are accepted to the conference. Despite these compositional changes, blinding does not worsen the conference's ability to select high-quality papers. I develop a model of evaluator discrimination that allows me to rationalize these effects and decompose non-blind disparities into two distinct forms of discrimination: accurate statistical discrimination and bias.

Suggested Citation

  • Haruka Uchida, 2023. "What Do Names Reveal? Impacts of Blind Evaluations on Composition and Quality," Artefactual Field Experiments 00728, The Field Experiments Website.
  • Handle: RePEc:feb:artefa:00728
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00728.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    2. Annabelle Krause & Ulf Rinne & Klaus Zimmermann, 2012. "Anonymous job applications in Europe," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-20, December.
    3. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    4. Olof Åslund & Oskar Nordströum Skans, 2012. "Do Anonymous Job Application Procedures Level the Playing Field?," ILR Review, Cornell University, ILR School, vol. 65(1), pages 82-107, January.
    5. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    6. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    7. John A. List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," NBER Working Papers 27535, National Bureau of Economic Research, Inc.
    8. Goldin, Claudia D. & Rouse, Cecilia, 2000. "Orchestrating Impartiality: The Impact of “Blind†Auditions on Female Musicians," Scholarly Articles 30703974, Harvard University Department of Economics.
    9. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zanoni, Wladimir & Duryea, Suzanne & Paredes, Jorge, 2024. "Exploring Gender Discrimination: A Multi-Trial Field Experiment in Urban Ecuador," IDB Publications (Working Papers) 13705, Inter-American Development Bank.
    2. Filip Matejka, 2013. "Attention Discrimination: Theory and Field Experiments," 2013 Meeting Papers 798, Society for Economic Dynamics.
    3. Laura Hospido & Carlos Sanz, 2021. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 590-618, June.
    4. Ohto Kanninen & Sanni Kiviholma & Tuomo Virkola, "undated". "Anatomy of An Anonymous Hiring Pilot," Working Papers 338, Työn ja talouden tutkimus LABORE, The Labour Institute for Economic Research LABORE.
    5. Ulf Rinne, 2018. "Anonymous job applications and hiring discrimination," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-11, October.
    6. Andreas Leibbrandt & John A. List, 2018. "Do Equal Employment Opportunity Statements Backfire? Evidence From A Natural Field Experiment On Job-Entry Decisions," NBER Working Papers 25035, National Bureau of Economic Research, Inc.
    7. Jan Feld & Nicolás Salamanca & Daniel S. Hamermesh, 2016. "Endophilia or Exophobia: Beyond Discrimination," Economic Journal, Royal Economic Society, vol. 126(594), pages 1503-1527, August.
    8. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    9. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    10. Barron, Kai & Ditlmann, Ruth & Gehrig, Stefan & Schweighofer-Kodritsch, Sebastian, 2020. "Explicit and implicit belief-based gender discrimination: A hiring experiment," Discussion Papers, Research Unit: Economics of Change SP II 2020-306, WZB Berlin Social Science Center.
    11. Lavy, Victor & Sand, Edith, 2015. "On The Origins of Gender Human Capital Gaps: Short and Long Term Consequences of Teachers’ Stereotypical Biases," The Warwick Economics Research Paper Series (TWERPS) 1085, University of Warwick, Department of Economics.
    12. Bøg, Martin & Kranendonk, Erik, 2011. "Labor market discrimination of minorities? yes, but not in job offers," MPRA Paper 33332, University Library of Munich, Germany.
    13. Hamish Low & Luigi Pistaferri, 2019. "Disability Insurance: Error Rates and Gender Differences," Economics Series Working Papers 889, University of Oxford, Department of Economics.
    14. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    15. Giovanni Busetta & Fabio Fiorillo & Giulio Palomba, 2021. "The impact of attractiveness on job opportunities in Italy: a gender field experiment," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(1), pages 171-201, April.
    16. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    17. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CERGE-EI Working Papers wp644, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    18. Annabelle Krause & Ulf Rinne & Klaus Zimmermann, 2012. "Anonymous job applications in Europe," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-20, December.
    19. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    20. Laura Hospido & Carlos Sanz, 2019. "Gender gaps in the evaluation of research: evidence from submissions to economics conferences (Updated March 2020)," Working Papers 1918, Banco de España, revised Mar 2020.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:artefa:00728. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesca Pagnotta (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.