IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12494.html
   My bibliography  Save this paper

Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences

Author

Listed:
  • Hospido, Laura

    (Bank of Spain)

  • Sanz, Carlos

    (Bank of Spain)

Abstract

We study gender differences in the evaluation of submissions to economics conferences. Using data from the Annual Congress of the European Economic Association (2015-2017), the Annual Meeting of the Spanish Economic Association (2012-2017), and the Spring Meeting of Young Economists (2017), we find that all-female-authored papers are 3.2 p.p. (6.8%) less likely to be accepted than all-male-authored papers. This gap is present after controlling for (i) number of authors, (ii) referee fixed effects, (iii) field, (iv) cites of the paper at submission year, (v) previous publication record of the authors, and (vi) the quality of the affiliations of the authors. We also find that the gap is entirely driven by male referees - female referees evaluate male and female-authored papers similarly, but male referees are more favorable towards papers written by men.

Suggested Citation

  • Hospido, Laura & Sanz, Carlos, 2019. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," IZA Discussion Papers 12494, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp12494
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12494.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Raquel Campos & Fernanda Leon & Ben McQuillin, 2018. "Lost in the Storm: The Academic Collaborations That Went Missing in Hurricane ISSAC," Economic Journal, Royal Economic Society, vol. 128(610), pages 995-1018, May.
    2. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    3. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    4. Heather Sarsons & Klarita Gërxhani & Ernesto Reuben & Arthur Schram, 2021. "Gender Differences in Recognition for Group Work," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 101-147.
    5. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    6. Krawczyk, Michał & Smyk, Magdalena, 2016. "Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," European Economic Review, Elsevier, vol. 90(C), pages 326-335.
    7. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    8. Maria De Paola & Vincenzo Scoppa, 2015. "Gender Discrimination and Evaluators’ Gender: Evidence from Italian Academia," Economica, London School of Economics and Political Science, vol. 82(325), pages 162-188, January.
    9. David Blackaby & Alison L Booth & Jeff Frank, 2005. "Outside Offers And The Gender Pay Gap: Empirical Evidence From the UK Academic Labour Market," Economic Journal, Royal Economic Society, vol. 115(501), pages 81-107, February.
    10. Anusha Chari & Paul Goldsmith-Pinkham, 2017. "Gender Representation in Economics Across Topics and Time: Evidence from the NBER Summer Institute," Working Papers 2017-081, Human Capital and Economic Opportunity Working Group.
    11. Combes, Pierre-Philippe & Linnemer, Laurent & Visser, Michael, 2008. "Publish or peer-rich? The role of skills and networks in hiring economics professors," Labour Economics, Elsevier, vol. 15(3), pages 423-441, June.
    12. Bagues, Manuel & Campa, Pamela, 2021. "Can gender quotas in candidate lists empower women? Evidence from a regression discontinuity design," Journal of Public Economics, Elsevier, vol. 194(C).
    13. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    14. Jason Abrevaya & Daniel S. Hamermesh, 2012. "Charity and Favoritism in the Field: Are Female Economists Nicer (To Each Other)?," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 202-207, February.
    15. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    16. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2018. "Gender & Collaboration," Working Papers 856, Queen Mary University of London, School of Economics and Finance.
    17. Amanda Bayer & Cecilia Elena Rouse, 2016. "Diversity in the Economics Profession: A New Attack on an Old Problem," Journal of Economic Perspectives, American Economic Association, vol. 30(4), pages 221-242, Fall.
    18. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2023. "Gender and Collaboration," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1366-1378, November.
    19. Natalia Zinovyeva & Manuel Bagues, 2015. "The Role of Connections in Academic Promotions," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 264-292, April.
    20. Moses Shayo & Asaf Zussman, 2011. "Judicial Ingroup Bias in the Shadow of Terrorism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(3), pages 1447-1484.
    21. Ruben Durante & Giovanna Labartino & Roberto Perotti, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," NBER Working Papers 17572, National Bureau of Economic Research, Inc.
    22. Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
    23. Pierre Deschamps, 2024. "Gender Quotas in Hiring Committees: A Boon or a Bane for Women?," Management Science, INFORMS, vol. 70(11), pages 7486-7505, November.
    24. Manuel F. Bagues & Berta Esteve-Volart, 2010. "Can Gender Parity Break the Glass Ceiling? Evidence from a Repeated Randomized Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(4), pages 1301-1328.
    25. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," Post-Print hal-03393117, HAL.
    26. Boring, Anne, 2017. "Gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 145(C), pages 27-41.
    27. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    28. Christiana Hilmer & Michael Hilmer, 2007. "Women Helping Women, Men Helping Women? Same-Gender Mentoring, Initial Job Placements, and Early Career Publishing Success for Economics PhDs," American Economic Review, American Economic Association, vol. 97(2), pages 422-426, May.
    29. Shelly Lundberg & Jenna Stearns, 2019. "Women in Economics: Stalled Progress," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 3-22, Winter.
    30. Anne Boschini & Anna Sjögren, 2007. "Is Team Formation Gender Neutral? Evidence from Coauthorship Patterns," Journal of Labor Economics, University of Chicago Press, vol. 25(2), pages 325-365.
    31. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2017. "Does the Gender Composition of Scientific Committees Matter?," American Economic Review, American Economic Association, vol. 107(4), pages 1207-1238, April.
    32. Hengel, E., 2017. "Publishing while Female. Are women held to higher standards? Evidence from peer review," Cambridge Working Papers in Economics 1753, Faculty of Economics, University of Cambridge.
    33. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    34. Paredes, Valentina & Paserman, M. Daniele & Pino, Francisco J., 2020. "Does Economics Make You Sexist?," IZA Discussion Papers 13223, Institute of Labor Economics (IZA).
    35. Heather Sarsons, 2017. "Recognition for Group Work: Gender Differences in Academia," American Economic Review, American Economic Association, vol. 107(5), pages 141-145, May.
    36. Marianne Bertrand, 2013. "Career, Family, and the Well-Being of College-Educated Women," American Economic Review, American Economic Association, vol. 103(3), pages 244-250, May.
    37. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    38. Goldin, Claudia D. & Rouse, Cecilia, 2000. "Orchestrating Impartiality: The Impact of “Blind†Auditions on Female Musicians," Scholarly Articles 30703974, Harvard University Department of Economics.
    39. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    40. Marc F. Bellemare & Casey J. Wichman, 2020. "Elasticities and the Inverse Hyperbolic Sine Transformation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(1), pages 50-61, February.
    41. Pierre-Philippe Combes & Laurent Linnemer & Michael Visser, 2008. "Publish or Peer-rich," Post-Print hal-00558189, HAL.
    42. Broder, Ivy E, 1993. "Review of NSF Economics Proposals: Gender and Institutional Patterns," American Economic Review, American Economic Association, vol. 83(4), pages 964-970, September.
    43. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    44. Juan Dolado & Florentino Felgueroso & Miguel Almunia, 2012. "Are men and women-economists evenly distributed across research fields? Some new empirical evidence," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(3), pages 367-393, September.
    45. repec:hal:spmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2022. "Gender Differences in Peer Recognition by Economists," Econometrica, Econometric Society, vol. 90(5), pages 1937-1971, September.
    2. Moritz Drechsel-Grau & Felix Holub, 2020. "Gender Gaps and the Role of Bosses," CRC TR 224 Discussion Paper Series crctr224_2020_237, University of Bonn and University of Mannheim, Germany.
    3. Lena Janys, 2021. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," Papers 2109.14343, arXiv.org, revised Nov 2021.
    4. Farré, Lídia & Ortega, Francesc, 2021. "Family Ties, Geographic Mobility and the Gender Gap in Academic Aspirations," IZA Discussion Papers 14561, Institute of Labor Economics (IZA).
    5. Asier Minondo, 2020. "Who presents and where? An analysis of research seminars in US economics departments," Papers 2001.10561, arXiv.org, revised May 2020.
    6. Paredes, Valentina & Paserman, M. Daniele & Pino, Francisco J., 2020. "Does Economics Make You Sexist?," IZA Discussion Papers 13223, Institute of Labor Economics (IZA).
    7. Biermann, Marcus, 2021. "Remote talks: changes to economics seminars during Covid-19," LSE Research Online Documents on Economics 114429, London School of Economics and Political Science, LSE Library.
    8. Feld, Jan & Lines, Corinna & Ross, Libby, 2024. "Writing matters," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 378-397.
    9. De, Anusha & Miehe, Caroline & Van Campenhout, Bjorn, 2024. "Gender bias in customer perceptions: The case of agro-input dealers in Uganda," Agricultural Systems, Elsevier, vol. 217(C).
    10. Marcus Biermann, 2021. "Remote talks: changes to economics seminars during Covid-19," CEP Discussion Papers dp1759, Centre for Economic Performance, LSE.
    11. Arceo-Gomez, Eva O. & Campos-Vazquez, Raymundo M., 2022. "Gender Bias in Evaluation Processes," Economics of Education Review, Elsevier, vol. 89(C).
    12. Jenny Bourne & Nathan D. Grawe & Michael Hemesath & Prathi Seneviratne & Maya Jensen, 2024. "The Disappearing Gender Gap in Scholarly Publication of Economists at Liberal Arts Colleges," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 50(1), pages 117-134, January.
    13. Gamage, Danula K. & Sevilla, Almudena & Smith, Sarah, 2020. "Women in Economics: A UK Perspective," IZA Discussion Papers 13477, Institute of Labor Economics (IZA).
    14. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    15. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    16. Roberto Asmat & Karol J. Borowiecki & Marc T. Law, 2024. "Competing for Equality: Gender Bias Among Juries in International Piano Competitions, 1890-2023," ACEI Working Paper Series AWP-03-2024, Association for Cultural Economics International.
    17. Auriol, Emmanuelle & Friebel, Guido & Weinberger, Alisa & ,, 2021. "Women in Economics: Europe and the World," CEPR Discussion Papers 16686, C.E.P.R. Discussion Papers.
    18. Lena Janys, 2022. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," ECONtribute Discussion Papers Series 165, University of Bonn and University of Cologne, Germany.
    19. Kathleen Segerson & Catherine L. Kling & Nancy E. Bockstael, 2022. "Contributions of women at the intersection of agricultural economics and environmental and natural resource economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(1), pages 38-53, March.
    20. Markus Eberhardt & Giovanni Facchini & Valeria Rueda, 2023. "Gender Differences in Reference Letters: Evidence from the Economics Job Market," The Economic Journal, Royal Economic Society, vol. 133(655), pages 2676-2708.
    21. Andrew Hussey & Sheena Murray & Wendy Stock, 2022. "Gender, coauthorship, and academic outcomes in economics," Economic Inquiry, Western Economic Association International, vol. 60(2), pages 465-484, April.
    22. Gauri Kartini Shastry & Olga Shurchkov, 2024. "Reject or revise: Gender differences in persistence and publishing in economics," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 933-956, July.
    23. Nikolaos Theodoropoulos & John Forth & Alex Bryson, 2022. "Are Women Doing It for Themselves? Female Managers and the Gender Wage Gap," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1329-1355, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura Hospido & Carlos Sanz, 2019. "Gender gaps in the evaluation of research: evidence from submissions to economics conferences (Updated March 2020)," Working Papers 1918, Banco de España, revised Mar 2020.
    2. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    3. Pierre Deschamps, 2024. "Gender Quotas in Hiring Committees: A Boon or a Bane for Women?," Management Science, INFORMS, vol. 70(11), pages 7486-7505, November.
    4. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," Post-Print hal-03393117, HAL.
    5. Verónica Amarante & Marisa Bucheli & María Inés Moraes & Tatiana Pérez, 2021. "Women in Research in Economics in Uruguay," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 763-790, October.
    6. Bosquet, Clément & Combes, Pierre-Philippe & Garcia-Penalosa, Cecilia, 2013. "Gender and competition: evidence from academic promotions in France," LSE Research Online Documents on Economics 58350, London School of Economics and Political Science, LSE Library.
    7. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2014. "Do gender quotas pass the test ? Evidence from academic evaluations in Italy," LEM Papers Series 2014/14, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    8. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," SciencePo Working papers hal-03393117, HAL.
    9. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2017. "Does the Gender Composition of Scientific Committees Matter?," American Economic Review, American Economic Association, vol. 107(4), pages 1207-1238, April.
    10. Clément Bosquet & Pierre‐Philippe Combes & Cecilia García‐Peñalosa, 2019. "Gender and Promotions: Evidence from Academic Economists in France," Scandinavian Journal of Economics, Wiley Blackwell, vol. 121(3), pages 1020-1053, July.
    11. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    12. Auriol, Emmanuelle & Friebel, Guido & Weinberger, Alisa & ,, 2021. "Women in Economics: Europe and the World," CEPR Discussion Papers 16686, C.E.P.R. Discussion Papers.
    13. Bukstein, Daniel & Gandelman, Néstor, 2019. "Glass ceilings in research: Evidence from a national program in Uruguay," Research Policy, Elsevier, vol. 48(6), pages 1550-1563.
    14. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    15. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
    16. Bao, Zhengyang & Huang, Difang, 2024. "Gender-specific favoritism in science," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 94-109.
    17. repec:spo:wpmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    18. repec:hal:spmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    19. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    20. Martina Viarengo & Ugo Panizza & Enrico Nano, 2021. "A Generation of Italian Economists," CID Working Papers 400, Center for International Development at Harvard University.
    21. Paredes, Valentina & Paserman, M. Daniele & Pino, Francisco J., 2020. "Does Economics Make You Sexist?," IZA Discussion Papers 13223, Institute of Labor Economics (IZA).
    22. Mallory Avery & Andreas Leibbrandt & Joseph Vecci, 2023. "Does Artificial Intelligence Help or Hurt Gender Diversity? Evidence from Two Field Experiments on Recruitment in Tech," Monash Economics Working Papers 2023-09, Monash University, Department of Economics.

    More about this item

    Keywords

    economics profession; academic labor market; gender;
    All these keywords.

    JEL classification:

    • A1 - General Economics and Teaching - - General Economics
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12494. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.