IDEAS home Printed from https://ideas.repec.org/a/bla/scandj/v114y2012i2p500-519.html
   My bibliography  Save this article

Discrimination in Scientific Review: A Natural Field Experiment on Blind versus Non‐Blind Reviews

Author

Listed:
  • Fredrik Carlsson
  • Åsa Löfgren
  • Thomas Sterner

Abstract

Using papers submitted to an international conference on economics held in Sweden in 2008, we analyze how gender, as well as other characteristics of the authors and reviewers, affects the grading of these papers by the reviewers. Correcting for other variables, including the country and research field, as well as the academic level of the author, we focus on the difference in grades between blind and non‐blind review treatments. We find that non‐blind reviewing has little effect, and there is no significant evidence of gender discrimination. Furthermore, we do not find any significant difference between the average grading by female and male reviewers.

Suggested Citation

  • Fredrik Carlsson & Åsa Löfgren & Thomas Sterner, 2012. "Discrimination in Scientific Review: A Natural Field Experiment on Blind versus Non‐Blind Reviews," Scandinavian Journal of Economics, Wiley Blackwell, vol. 114(2), pages 500-519, June.
    • Handle: RePEc:bla:scandj:v:114:y:2012:i:2:p:500-519
    DOI: j.1467-9442.2011.01690.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9442.2011.01690.x
    Download Restriction: no
    File URL: https://libkey.io/j.1467-9442.2011.01690.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Larry D. Singell & John M. McDowell & James P. Ziliak, 1999. "Cracks in the Glass Ceiling: Gender and Promotion in the Economics Profession," American Economic Review, American Economic Association, vol. 89(2), pages 392-396, May.
    2. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    3. repec:eee:labchp:v:1:y:1986:i:c:p:693-785 is not listed on IDEAS
    4. Subhra Bhattacharjee & Joseph A. Herriges & Catherine L. Kling, 2007. "The Status of Women in Environmental Economics," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 1(2), pages 212-227, Summer.
    5. Garett Jones, 2008. "What Is the Right Number of Women? Hints and Puzzles from Cognitive Ability Research," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 227-239, May.
    6. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    7. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    8. Kathy J. Hayes & Donna K. Ginther, 1999. "Gender Differences in Salary and Promotion in the Humanities," American Economic Review, American Economic Association, vol. 89(2), pages 397-402, May.
    9. John A. List, 2004. "The Nature and Extent of Discrimination in the Marketplace: Evidence from the Field," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 49-89.
    10. Christina Jonung & Ann-Charlotte Ståhlberg, 2008. "Reaching the Top? On Gender Balance in the Economics Profession," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 174-192, May.
    11. Astrid Kunze, 2008. "Gender wage gap studies: consistency and decomposition," Empirical Economics, Springer, vol. 35(1), pages 63-76, August.
    12. repec:feb:artefa:0091 is not listed on IDEAS
    13. Catherine Hakim, 2008. "Diversity in Tastes, Values, and Preferences: Comment on Jonung and Ståhlberg," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 204-218, May.
    14. John List, 2008. "Homo experimentalis evolves," Artefactual Field Experiments 00084, The Field Experiments Website.
    15. Marianne A. Ferber & Michelle Teiman, 1980. "Are Women Economists at a Disadvantage in Publishing Journal Articles?," Eastern Economic Journal, Eastern Economic Association, vol. 6(3-4), pages 189-193, Aug-Oct.
    16. Deirdre N. McCloskey, 2008. "Mr. Max and the Substantial Errors of Manly Economics," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 199-203, May.
    17. Christina Jonung & Ann-Charlotte Ståhlberg, 2009. "Does Economics Have a Gender?," Econ Journal Watch, Econ Journal Watch, vol. 6(1), pages 60-72, January.
    18. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    19. Ann Mari May, 2008. "On Gender Balance in the Economics Profession," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 193-198, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rangvid Beatrice Schindler, 2019. "Gender Discrimination in Exam Grading? Double Evidence from a Natural Experiment and a Field Experiment," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 19(2), pages 1-23, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hinnerich, Björn Tyrefors & Höglin, Erik & Johannesson, Magnus, 2011. "Ethnic Discrimination in High School Grading: Evidence from a Field Experiment," SSE/EFI Working Paper Series in Economics and Finance 733, Stockholm School of Economics, revised 27 Jun 2011.
    2. Azmat, Ghazala & Petrongolo, Barbara, 2014. "Gender and the labor market: What have we learned from field and lab experiments?," Labour Economics, Elsevier, vol. 30(C), pages 32-40.
    3. Castillo, Marco & Petrie, Ragan & Torero, Maximo & Vesterlund, Lise, 2013. "Gender differences in bargaining outcomes: A field experiment on discrimination," Journal of Public Economics, Elsevier, vol. 99(C), pages 35-48.
    4. Andreas Leibbrandt & John A. List, 2018. "Do Equal Employment Opportunity Statements Backfire? Evidence From A Natural Field Experiment On Job-Entry Decisions," NBER Working Papers 25035, National Bureau of Economic Research, Inc.
    5. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    6. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    7. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    8. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    9. Thomas Breda & Son Thierry Ly, 2012. "Do professors really perpetuate the gender gap in science? Evidence from a natural experiment in a French higher education institution," Working Papers halshs-00677438, HAL.
    10. Haruka Uchida, 2023. "What Do Names Reveal? Impacts of Blind Evaluations on Composition and Quality," Artefactual Field Experiments 00728, The Field Experiments Website.
    11. Cappelen, Alexander W. & Falch, Ranveig & Tungodden, Bertil, 2019. "The Boy Crisis: Experimental Evidence on the Acceptance of Males Falling Behind," Discussion Paper Series in Economics 6/2019, Norwegian School of Economics, Department of Economics, revised 01 Mar 2019.
    12. Bøg, Martin & Kranendonk, Erik, 2011. "Labor market discrimination of minorities? yes, but not in job offers," MPRA Paper 33332, University Library of Munich, Germany.
    13. Lars Ivar Oppedal Berge & Kjetil Bjorvatn & Bertil Tungodden, 2015. "Human and Financial Capital for Microenterprise Development: Evidence from a Field and Lab Experiment," Management Science, INFORMS, vol. 61(4), pages 707-722, April.
    14. Jeffrey Flory & Uri Gneezy & Kenneth Leonard & John List, 2012. "Sex, competitiveness, and investment in offspring: On the origin of preferences," Artefactual Field Experiments 00072, The Field Experiments Website.
    15. Katherine B. Coffman & Christine L. Exley & Muriel Niederle, 2021. "The Role of Beliefs in Driving Gender Discrimination," Management Science, INFORMS, vol. 67(6), pages 3551-3569, June.
    16. Nicolas Jacquemet & Olivier L’Haridon & Isabelle Vialle, 2014. "Marché du travail, évaluation et économie expérimentale," Revue française d'économie, Presses de Sciences-Po, vol. 0(1), pages 189-226.
    17. Azmat, Ghazala & Petrongolo, Barbara, 2014. "Gender and the labor market: What have we learned from field and lab experiments?," Labour Economics, Elsevier, vol. 30(C), pages 32-40.
    18. Anne Boschini & Anna Sjögren, 2007. "Is Team Formation Gender Neutral? Evidence from Coauthorship Patterns," Journal of Labor Economics, University of Chicago Press, vol. 25(2), pages 325-365.
    19. Thomas Breda & Son Thierry Ly, 2012. "Do Professors Really Perpetuate the Gender Gap in Science? Evidence from a Natural Experiment in a French Higher Education Institution," CEE Discussion Papers 0138, Centre for the Economics of Education, LSE.
    20. Simon Quinn & Tom Gole, 2014. "Committees and Status Quo Bias: Structural Evidence from a Randomized Field Experiment," Economics Series Working Papers 733, University of Oxford, Department of Economics.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scandj:v:114:y:2012:i:2:p:500-519. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1467-9442 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.