IDEAS home Printed from https://ideas.repec.org/p/not/notgep/2023-02.html
   My bibliography  Save this paper

Gender differences in reference letters: Evidence from the Economics job market

Author

Listed:
  • Markus Eberhardt
  • Giovanni Facchini
  • Valeria Rueda

Abstract

Academia, and economics in particular, faces increased scrutiny because of gender imbalance. This paper studies the job market for entry-level faculty positions. We employ machine learning methods to analyze gendered patterns in the text of 12,000 reference letters written in support of over 3,700 candidates. Using both supervised and unsupervised techniques, we document widespread differences in the attributes emphasized. Women are systematically more likely to be described using ‘grindstone’ terms and at times less likely to be praised for their ability. Using information on initial placement we highlight the mplications of these gendered descriptors for the quality of academic placement.

Suggested Citation

  • Markus Eberhardt & Giovanni Facchini & Valeria Rueda, 2023. "Gender differences in reference letters: Evidence from the Economics job market," Discussion Papers 2023-02, University of Nottingham, GEP.
  • Handle: RePEc:not:notgep:2023-02
    as

    Download full text from publisher

    File URL: https://www.nottingham.ac.uk/gep/documents/papers/2023/23-02.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Shoshana Grossbard & Tansel Yilmazer & Lingrui Zhang, 2021. "The gender gap in citations of articles published in two demographic economics journals," Review of Economics of the Household, Springer, vol. 19(3), pages 677-697, September.
    2. Peter Coles & John Cawley & Phillip B. Levine & Muriel Niederle & Alvin E. Roth & John J. Siegfried, 2010. "The Job Market for New Economists: A Market Design Perspective," Journal of Economic Perspectives, American Economic Association, vol. 24(4), pages 187-206, Fall.
    3. Clément Bosquet & Pierre‐Philippe Combes & Cecilia García‐Peñalosa, 2019. "Gender and Promotions: Evidence from Academic Economists in France," Scandinavian Journal of Economics, Wiley Blackwell, vol. 121(3), pages 1020-1053, July.
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    5. Grimmer, Justin & Stewart, Brandon M., 2013. "Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts," Political Analysis, Cambridge University Press, vol. 21(3), pages 267-297, July.
    6. Ash, Elliott & Chen, Daniel L. & Ornaghi, Arianna, 2020. "Gender Attitudes in the Judiciary:Evidence from U.S. Circuit Courts," CAGE Online Working Paper Series 462, Competitive Advantage in the Global Economy (CAGE).
    7. Laura Hospido & Carlos Sanz, 2021. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 590-618, June.
    8. Alice H. Wu, 2018. "Gendered Language on the Economics Job Market Rumors Forum," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 175-179, May.
    9. Gianni De Fraja & Giovanni Facchini & John Gathergood, 2019. "Academic salaries and public evaluation of university research: Evidence from the UK Research Excellence Framework," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 34(99), pages 523-583.
    10. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    11. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    12. Elliott Ash & Daniel L. Chen & Suresh Naidu, 2022. "Ideas Have Consequences : The Impact of Law and Economics on American Justice," Working Papers hal-03899739, HAL.
    13. Shulamit Kahn & Donna Ginther, 2017. "Women and STEM," NBER Working Papers 23525, National Bureau of Economic Research, Inc.
    14. Ash, Elliott & Chen, Daniel L. & Ornaghi, Arianna, 2021. "Gender Attitudes in the Judiciary : Evidence from U.S. Circuit Courts," The Warwick Economics Research Paper Series (TWERPS) 08, University of Warwick, Department of Economics.
    15. Amanda Bayer & Cecilia Elena Rouse, 2016. "Diversity in the Economics Profession: A New Attack on an Old Problem," Journal of Economic Perspectives, American Economic Association, vol. 30(4), pages 221-242, Fall.
    16. Donna K. Ginther & Shulamit Kahn, 2004. "Women in Economics: Moving Up or Falling Off the Academic Career Ladder?," Journal of Economic Perspectives, American Economic Association, vol. 18(3), pages 193-214, Summer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cai, Xiqian & Chen, Shuai & Cheng, Zhengquan, 2024. "The #Metoo Movement and Judges' Gender Gap in Decisions," IZA Discussion Papers 17115, Institute of Labor Economics (IZA).
    2. Biermann, Marcus, 2024. "Remote talks: Changes to economics seminars during COVID-19," European Economic Review, Elsevier, vol. 163(C).
    3. Ahrens, Achim & Hansen, Christian B. & Schaffer, Mark E & Wiemann, Thomas, 2024. "Model Averaging and Double Machine Learning," IZA Discussion Papers 16714, Institute of Labor Economics (IZA).
    4. Joanna Tyrowicz & Lucas Augusto van der Velde & Magdalena Smyk, 2024. "Gender-neutral hiring of junior scholars," GRAPE Working Papers 94, GRAPE Group for Research in Applied Economics.
    5. Cai, Xiqian & Chen, Shuai & Cheng, Zhengquan, 2024. "The #MeToo Movement and Judges' Gender Gap in Decisions," GLO Discussion Paper Series 1453, Global Labor Organization (GLO).
    6. Sona Badalyan & Darya Korlyakova & Rastislav Rehak, 2023. "Disclosure Discrimination: An Experiment Focusing on Communication in the Hiring Process," CERGE-EI Working Papers wp743, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    7. Ronald B. Davies & Zuzanna Studnicka, 2023. "A review of submissions to International Tax and Public Finance, 2010–2020," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 30(4), pages 1185-1201, August.
    8. Nicolás Ajzenman & Bruno Ferman & Sant’Anna Pedro C., 2023. "Discrimination in the Formation of Academic Networks: A Field Experiment on #EconTwitter," Working Papers 235, Red Nacional de Investigadores en Economía (RedNIE).
    9. Niels Johannesen & Simon Muchardt, 2024. "Is the Bar Higher for Female Scholars? Evidence from Career Steps in Economics," CESifo Working Paper Series 11101, CESifo.
    10. Piera Bello & Alessandra Casarico & Debora Nozza, 2023. "Research Similarity and Women in Academia," CESifo Working Paper Series 10657, CESifo.
    11. Baltrunaite, Audinga & Casarico, Alessandra & Rizzica, Lucia, 2022. "Women in economics: the role of gendered references at entry in the profession," CEPR Discussion Papers 17474, C.E.P.R. Discussion Papers.
    12. Gauri Kartini Shastry & Olga Shurchkov, 2024. "Reject or revise: Gender differences in persistence and publishing in economics," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 933-956, July.
    13. Gonzalez, Felipe & Coy, Felipe & Prem, Mounu & von Dessauer, Cristine, 2022. "Uncertainty from dictatorship to democracy: Evidence from business communications," SocArXiv gz934, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gamage, Danula K. & Sevilla, Almudena & Smith, Sarah, 2020. "Women in Economics: A UK Perspective," IZA Discussion Papers 13477, Institute of Labor Economics (IZA).
    2. Gauri Kartini Shastry & Olga Shurchkov, 2024. "Reject or revise: Gender differences in persistence and publishing in economics," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 933-956, July.
    3. Biermann, Marcus, 2024. "Remote talks: Changes to economics seminars during COVID-19," European Economic Review, Elsevier, vol. 163(C).
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2022. "Gender Differences in Peer Recognition by Economists," Econometrica, Econometric Society, vol. 90(5), pages 1937-1971, September.
    5. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    6. Davies, Benjamin, 2022. "Gender sorting among economists: Evidence from the NBER," Economics Letters, Elsevier, vol. 217(C).
    7. Jenny Bourne & Nathan D. Grawe & Michael Hemesath & Prathi Seneviratne & Maya Jensen, 2024. "The Disappearing Gender Gap in Scholarly Publication of Economists at Liberal Arts Colleges," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 50(1), pages 117-134, January.
    8. Ductor, Lorenzo & Prummer, Anja, 2024. "Gender homophily, collaboration, and output," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 477-492.
    9. Paredes, Valentina & Paserman, M. Daniele & Pino, Francisco J., 2020. "Does Economics Make You Sexist?," IZA Discussion Papers 13223, Institute of Labor Economics (IZA).
    10. Jihui Chen & Qihong Liu & Myongjin Kim, 2022. "Gender gap in tenure and promotion: Evidence from the economics Ph.D. class of 2008," Southern Economic Journal, John Wiley & Sons, vol. 88(4), pages 1277-1312, April.
    11. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    12. Auriol, Emmanuelle & Friebel, Guido & Weinberger, Alisa & ,, 2021. "Women in Economics: Europe and the World," CEPR Discussion Papers 16686, C.E.P.R. Discussion Papers.
    13. Lena Janys, 2021. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," Papers 2109.14343, arXiv.org, revised Nov 2021.
    14. Morris, J., 2023. "The Impact of Qualitative Reviews on Racial Statistical Discrimination: Evidence from Airbnb," Cambridge Working Papers in Economics 2331, Faculty of Economics, University of Cambridge.
    15. Davies, Benjamin, 2022. "Sex-based sorting among economists: Evidence from the NBER," SocArXiv zeb7a, Center for Open Science.
    16. Lena Janys, 2022. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," ECONtribute Discussion Papers Series 165, University of Bonn and University of Cologne, Germany.
    17. Verónica Amarante & Marisa Bucheli & María Inés Moraes & Tatiana Pérez, 2021. "Women in Research in Economics in Uruguay," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 763-790, October.
    18. Baltrunaite, Audinga & Casarico, Alessandra & Rizzica, Lucia, 2022. "Women in economics: the role of gendered references at entry in the profession," CEPR Discussion Papers 17474, C.E.P.R. Discussion Papers.
    19. Martina Viarengo & Ugo Panizza & Enrico Nano, 2021. "A Generation of Italian Economists," CID Working Papers 400, Center for International Development at Harvard University.
    20. Asier Minondo, 2020. "Who presents and where? An analysis of research seminars in US economics departments," Papers 2001.10561, arXiv.org, revised May 2020.

    More about this item

    Keywords

    gender; natural language processing; diversity;
    All these keywords.

    JEL classification:

    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination
    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:not:notgep:2023-02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Hilary Hughes (email available below). General contact details of provider: https://edirc.repec.org/data/cgnotuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.