IDEAS home Printed from https://ideas.repec.org/a/bla/ecinqu/v61y2023i4p777-797.html
   My bibliography  Save this article

Invisible hurdles: Gender and institutional differences in the evaluation of economics papers

Author

Listed:
  • Fulya Y. Ersoy
  • Jennifer Pate

Abstract

How might the visibility of an author's name and/or institutional affiliation allow bias to enter the evaluation of economics papers? We ask highly qualified journal editors to review abstracts of solo‐authored papers which differ along the dimensions of gender and institution of the author. We exogenously vary whether editors observe the name and/or institution of the author. We identify positive name visibility effects for female economists and positive institution visibility effects for economists at the top institutions. Our results suggest that male economists at top institutions benefit the most from non‐blind evaluations, followed by female economists (regardless of their institution).

Suggested Citation

  • Fulya Y. Ersoy & Jennifer Pate, 2023. "Invisible hurdles: Gender and institutional differences in the evaluation of economics papers," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 777-797, October.
    • Handle: RePEc:bla:ecinqu:v:61:y:2023:i:4:p:777-797
    DOI: 10.1111/ecin.13145
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/ecin.13145
    Download Restriction: no
    File URL: https://libkey.io/10.1111/ecin.13145?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    2. Scott Carrell & David Figlio & Lester Lusher, 2024. "Clubs and Networks in Economics Reviewing," Journal of Political Economy, University of Chicago Press, vol. 132(9), pages 2999-3024.
    3. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    5. Susan Washburn Taylor & Blakely Fox Fender & Kimberly Gladden Burke, 2006. "Unraveling the Academic Productivity of Economists: The Opportunity Costs of Teaching and Service," Southern Economic Journal, John Wiley & Sons, vol. 72(4), pages 846-859, April.
    6. Hadavand, Aboozar & Hamermesh, Daniel S. & Wilson, Wesley W., 2021. "Publishing Economics: How Slow? Why Slow? Is Slow Productive? Fixing Slow?," IZA Discussion Papers 14643, Institute of Labor Economics (IZA).
    7. Magne Mogstad & Joseph Romano & Azeem Shaikh & Daniel Wilhelm, 2022. "Statistical Uncertainty in the Ranking of Journals and Universities," AEA Papers and Proceedings, American Economic Association, vol. 112, pages 630-634, May.
    8. Heather Sarsons & Klarita Gërxhani & Ernesto Reuben & Arthur Schram, 2021. "Gender Differences in Recognition for Group Work," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 101-147.
    9. Anusha Chari & Paul Goldsmith-Pinkham, 2017. "Gender Representation in Economics Across Topics and Time: Evidence from the NBER Summer Institute," NBER Working Papers 23953, National Bureau of Economic Research, Inc.
    10. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    11. Daniel S. Hamermesh, 2013. "Six Decades of Top Economics Publishing: Who and How?," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 162-172, March.
    12. Jennifer L. Doleac & Erin Hengel & Elizabeth Pancotti, 2021. "Diversity in Economics Seminars: Who Gives Invited Talks?," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 55-59, May.
    13. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    14. Donna K. Ginther & Shulamit Kahn, 2021. "Women in Academic Economics: Have We Made Progress?," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 138-142, May.
    15. repec:hal:spmain:info:hdl:2441/67ft27s7u58ocangahl1jigu6p is not listed on IDEAS
    16. M. Fourcade & E. Ollion & Y. Algan, 2015. "The Superiority of Economists," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 7.
    17. Marieke Kleemans & Rebecca L. Thornton, 2021. "Who Belongs? The Determinants of Selective Membership into the National Bureau of Economic Research," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 117-122, May.
    18. Eva Sierminska & Ronald L. Oaxaca, 2021. "Field Specializations among Beginning Economists: Are There Gender Differences?," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 86-91, May.
    19. Erin Hengel, 2022. "Publishing While Female: are Women Held to Higher Standards? Evidence from Peer Review," The Economic Journal, Royal Economic Society, vol. 132(648), pages 2951-2991.
    20. Dennis L Murray & Douglas Morris & Claude Lavoie & Peter R Leavitt & Hugh MacIsaac & Michael E J Masson & Marc-Andre Villard, 2016. "Bias in Research Grant Evaluation Has Dire Consequences for Small Universities," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-19, June.
    21. Anusha Chari & Paul Goldsmith-Pinkham, 2017. "Gender representation in economics across topics and time: evidence from the NBER," Staff Reports 825, Federal Reserve Bank of New York.
    22. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    23. M. Fourcade & E. Ollion & Y. Algan., 2015. "The Superiority of Economists," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 7.
    24. Marlène Koffi, 2021. "Gendered Citations at Top Economic Journals," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 60-64, May.
    25. Colleen Manchester & Debra Barbezat, 2013. "The Effect of Time Use in Explaining Male–Female Productivity Differences Among Economists," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 52(1), pages 53-77, January.
    26. Benjamin F. Jones, 2021. "The Rise of Research Teams: Benefits and Costs in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(2), pages 191-216, Spring.
    27. Susan Washburn Taylor & Blakely Fox Fender & Kimberly Gladden Burke, 2006. "Unraveling the Academic Productivity of Economists: The Opportunity Costs of Teaching and Service," Southern Economic Journal, John Wiley & Sons, vol. 72(4), pages 846-859, April.
    28. Andrew Hussey & Sheena Murray & Wendy Stock, 2022. "Gender, coauthorship, and academic outcomes in economics," Economic Inquiry, Western Economic Association International, vol. 60(2), pages 465-484, April.
    29. Cynthia L. Harter & William E. Becker & Michael Watts, 2011. "Time Allocations and Reward Structures for US Academic Economists from 1955–2005: Evidence from Three National Surveys," International Review of Economic Education, Economics Network, University of Bristol, vol. 10(2), pages 6-27.
    30. Johan Lyhagen & Per Ahlgren, 2020. "Uncertainty and the ranking of economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2545-2560, December.
    31. Nicole Fortin & Thomas Lemieux & Marit Rehavi, 2021. "Gender Differences in Fields of Specialization and Placement Outcomes among PhDs in Economics," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 74-79, May.
    32. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    33. John M. McDowell & Larry D. Singell & Mark Stater, 2006. "Two to Tango? Gender Differences in the Decisions to Publish and Coauthor," Economic Inquiry, Western Economic Association International, vol. 44(1), pages 153-168, January.
    34. Donna K. Ginther & Shulamit Kahn, 2004. "Women in Economics: Moving Up or Falling Off the Academic Career Ladder?," Journal of Economic Perspectives, American Economic Association, vol. 18(3), pages 193-214, Summer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Franklin G. Mixon & Kamal P. Upadhyaya, 2024. "When forgiveness beats permission: Exploring the scholarly ethos of clinical faculty in economics," American Journal of Economics and Sociology, Wiley Blackwell, vol. 83(1), pages 75-91, January.
    2. Gauri Kartini Shastry & Olga Shurchkov, 2024. "Reject or revise: Gender differences in persistence and publishing in economics," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 933-956, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donna K. Ginther & Rina Na, 2021. "Does Mentoring Increase the Collaboration Networks of Female Economists? An Evaluation of the CeMENT Randomized Trial," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 80-85, May.
    2. Jenny Bourne & Nathan Grawe & Nathan D. Grawe & Michael Hemesath & Maya Jensen, 2022. "Scholarly Activity among Economists at Liberal Arts Colleges: A Life Cycle Analysis," Working Papers 2022-01, Carleton College, Department of Economics.
    3. Biermann, Marcus, 2024. "Remote talks: Changes to economics seminars during COVID-19," European Economic Review, Elsevier, vol. 163(C).
    4. Jenny Bourne & Nathan D. Grawe & Michael Hemesath & Prathi Seneviratne & Maya Jensen, 2024. "The Disappearing Gender Gap in Scholarly Publication of Economists at Liberal Arts Colleges," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 50(1), pages 117-134, January.
    5. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2023. "Gender and Collaboration," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1366-1378, November.
    6. Deepa Dhume Datta & Robert J. Vigfusson, 2024. "Measuring Inclusion: Gender and Coauthorship at the Federal Reserve Board," Finance and Economics Discussion Series 2024-091, Board of Governors of the Federal Reserve System (U.S.).
    7. Lucia Foster & Erika McEntarfer & Danielle H. Sandler, 2022. "Diversity and Labor Market Outcomes in the Economics Profession," Working Papers 22-26, Center for Economic Studies, U.S. Census Bureau.
    8. Davies, Benjamin, 2022. "Sex-based sorting among economists: Evidence from the NBER," SocArXiv zeb7a, Center for Open Science.
    9. Verónica Amarante & Marisa Bucheli & María Inés Moraes & Tatiana Pérez, 2021. "Women in Research in Economics in Uruguay," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 763-790, October.
    10. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2022. "Gender Differences in Peer Recognition by Economists," Econometrica, Econometric Society, vol. 90(5), pages 1937-1971, September.
    11. Sierminska, Eva & Oaxaca, Ronald L., 2022. "Gender differences in economics PhD field specializations with correlated choices," Labour Economics, Elsevier, vol. 79(C).
    12. Davies, Benjamin, 2022. "Gender sorting among economists: Evidence from the NBER," Economics Letters, Elsevier, vol. 217(C).
    13. Ductor, Lorenzo & Prummer, Anja, 2024. "Gender homophily, collaboration, and output," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 477-492.
    14. Bateman, Victoria & Hengel, Erin, 2023. "The gender gap in UK academic economics 1996-2018: progress, stagnation and retreat," LSE Research Online Documents on Economics 118205, London School of Economics and Political Science, LSE Library.
    15. Martina Cioni & Giovanni Federico & Michelangelo Vasta, 2023. "Is economic history changing its nature? Evidence from top journals," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 17(1), pages 23-48, January.
    16. Emily C. Marshall & Brian O’Roark, 2023. "Journal Authorship by Gender: A Comparison of Economic Education, General Interest, and Fields From 2009 to 2019," The American Economist, Sage Publications, vol. 68(1), pages 100-109, March.
    17. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    18. Barron, Kai & Ditlmann, Ruth & Gehrig, Stefan & Schweighofer-Kodritsch, Sebastian, 2020. "Explicit and implicit belief-based gender discrimination: A hiring experiment," Discussion Papers, Research Unit: Economics of Change SP II 2020-306, WZB Berlin Social Science Center.
    19. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    20. Deepa Dhume Datta & Nitzan Tzur-Ilan, 2024. "Gender Gaps in the Federal Reserve System," Working Papers 2417, Federal Reserve Bank of Dallas.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ecinqu:v:61:y:2023:i:4:p:777-797. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/weaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.