IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v43y2014i6p990-1001.html
   My bibliography  Save this article

Gender and the evaluation of research

Author

Listed:
  • Brooks, Chris
  • Fenton, Evelyn M.
  • Walker, James T.

Abstract

This study examines if and how gender relates to research evaluation via panel assessment and journal ratings lists. Using data from UK business schools we find no evidence that the proportion of women in a submission for panel assessment affected the score received by the submitting institution. However, we do find that women on average receive lower scores according to some journal ratings lists. There are important differences in the rated quality of journals that men and women publish in across the sub-disciplines with men publishing significantly more research in the highest rated accountancy, information management and strategy journals. In addition, women who are able to utilise networks to co-author with individuals outside their institution are able to publish in higher-rated journals, although the same is not true for men; women who are attributed with “individual staff circumstances” (e.g. maternity leave or part-time working) have lower scores according to journal ratings lists.

Suggested Citation

  • Brooks, Chris & Fenton, Evelyn M. & Walker, James T., 2014. "Gender and the evaluation of research," Research Policy, Elsevier, vol. 43(6), pages 990-1001.
    • Handle: RePEc:eee:respol:v:43:y:2014:i:6:p:990-1001
    DOI: 10.1016/j.respol.2013.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733313002242
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2013.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paul Nightingale & Alister Scott, 2007. "Peer review and the relevance gap: Ten suggestions for policy-makers," Science and Public Policy, Oxford University Press, vol. 34(8), pages 543-553, October.
    2. Deryl Northcott & Simon Linacre, 2010. "Producing Spaces for Academic Discourse: The Impact of Research Assessment Exercises and Journal Quality Rankings," Australian Accounting Review, CPA Australia, vol. 20(1), pages 38-54, March.
    3. David Blackaby & Alison L Booth & Jeff Frank, 2005. "Outside Offers And The Gender Pay Gap: Empirical Evidence From the UK Academic Labour Market," Economic Journal, Royal Economic Society, vol. 115(501), pages 81-107, February.
    4. Jane Broadbent, 2010. "The UK Research Assessment Exercise: Performance Measurement and Resource Allocation," Australian Accounting Review, CPA Australia, vol. 20(1), pages 14-23, March.
    5. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    6. David Blackaby & Alison L Booth & Jeff Frank, 2005. "Outside Offers And The Gender Pay Gap: Empirical Evidence From the UK Academic Labour Market," Economic Journal, Royal Economic Society, vol. 115(501), pages 81-107, February.
    7. Henk F Moed, 2007. "The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review," Science and Public Policy, Oxford University Press, vol. 34(8), pages 575-583, October.
    8. Browning, Martin, 1992. "Children and Household Economic Behavior," Journal of Economic Literature, American Economic Association, vol. 30(3), pages 1434-1475, September.
    9. Pezzoni, Michele & Sterzi, Valerio & Lissoni, Francesco, 2012. "Career progress in centralized academic systems: Social capital and institutions in France and Italy," Research Policy, Elsevier, vol. 41(4), pages 704-719.
    10. Claire Donovan, 2007. "The qualitative future of research evaluation," Science and Public Policy, Oxford University Press, vol. 34(8), pages 585-597, October.
    11. Donna K. Ginther & Shulamit Kahn, 2004. "Women in Economics: Moving Up or Falling Off the Academic Career Ladder?," Journal of Economic Perspectives, American Economic Association, vol. 18(3), pages 193-214, Summer.
    12. James Walker & Anna Vignoles & Mark Collins, 2010. "Higher education academic salaries in the UK," Oxford Economic Papers, Oxford University Press, vol. 62(1), pages 12-35, January.
    13. Melanie E. Ward, 2001. "Gender and Promotion in the Academic Profession," Scottish Journal of Political Economy, Scottish Economic Society, vol. 48(3), pages 283-302, August.
    14. Linda Butler, 2007. "Assessing university research: A plea for a balanced approach," Science and Public Policy, Oxford University Press, vol. 34(8), pages 565-574, October.
    15. Jane Waldfogel, 1998. "Understanding the "Family Gap" in Pay for Women with Children," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 137-156, Winter.
    16. Andreas G. F. Hoepner & Jeffrey Unerman, 2012. "Explicit and Implicit Subject Bias in the ABS Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 21(1), pages 3-15, December.
    17. Bozeman, Barry & Gaughan, Monica, 2011. "How do men and women differ in research collaborations? An analysis of the collaborative motives and strategies of academic researchers," Research Policy, Elsevier, vol. 40(10), pages 1393-1402.
    18. Tom Coupé & Victor Ginsburgh & Abdul Noury, 2010. "Are leading papers of better quality? Evidence from a natural experiment," Oxford Economic Papers, Oxford University Press, vol. 62(1), pages 1-11, January.
    19. Melanie Ward, 2001. "The gender salary gap in British academia," Applied Economics, Taylor & Francis Journals, vol. 33(13), pages 1669-1681.
    20. Stuart Macdonald & Jacqueline Kam, 2007. "Ring a Ring o’ Roses: Quality Journals and Gamesmanship in Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 44(4), pages 640-655, June.
    21. Debra A. Barbezat, 1987. "Salary Differentials by Sex in the Academic Labor Market," Journal of Human Resources, University of Wisconsin Press, vol. 22(3), pages 422-428.
    22. Millimet, Daniel L, 2000. "The Impact of Children on Wages, Job Tenure, and the Division of Household Labour," Economic Journal, Royal Economic Society, vol. 110(462), pages 139-157, March.
    23. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large-scale study of Norwegian scientists," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    24. Vivien Beattie & Alan Goodacre, 2012. "Publication records of accounting and finance faculty promoted to professor: evidence from the UK," Accounting and Business Research, Taylor & Francis Journals, vol. 42(2), pages 197-231, June.
    25. Waldfogel, Jane, 1998. "The Family Gap for Young Women in the United States and Britain: Can Maternity Leave Make a Difference?," Journal of Labor Economics, University of Chicago Press, vol. 16(3), pages 505-545, July.
    26. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large‐scale study of Norwegian scientists," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    27. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tullio Jappelli & Carmela Anna Nappi & Roberto Torrini, 2015. "Research Quality and Gender Gap in Research Assessment," CSEF Working Papers 418, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    2. Bryce, Cormac & Dowling, Michael & Lucey, Brian, 2020. "The journal quality perception gap," Research Policy, Elsevier, vol. 49(5).
    3. Thelwall, Mike, 2018. "Do females create higher impact research? Scopus citations and Mendeley readers for articles from five countries," Journal of Informetrics, Elsevier, vol. 12(4), pages 1031-1041.
    4. Andersen, Jens Peter & Nielsen, Mathias Wullum, 2018. "Google Scholar and Web of Science: Examining gender differences in citation coverage across five scientific disciplines," Journal of Informetrics, Elsevier, vol. 12(3), pages 950-959.
    5. Tartari, Valentina & Salter, Ammon, 2015. "The engagement gap:," Research Policy, Elsevier, vol. 44(6), pages 1176-1191.
    6. Brooks, Chris & Fenton, Evelyn & Schopohl, Lisa & Walker, James, 2019. "Why does research in finance have so little impact?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 58(C), pages 24-52.
    7. Tanya Araújo & Elsa Fontainha, 2018. "Are scientific memes inherited differently from gendered authorship?," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 953-972, November.
    8. Steven T. Joanis & Vivek H. Patil, 2022. "First-author gender differentials in business journal publishing: top journals versus the rest," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 733-761, February.
    9. Auschra, Carolin & Bartosch, Julia & Lohmeyer, Nora, 2022. "Differences in female representation in leading management and organization journals: Establishing a benchmark," Research Policy, Elsevier, vol. 51(3).
    10. Jappelli, Tullio & Nappi, Carmela Anna & Torrini, Roberto, 2017. "Gender effects in research evaluation," Research Policy, Elsevier, vol. 46(5), pages 911-924.
    11. Simoes, Nadia & Crespo, Nuno, 2020. "Self-Citations and scientific evaluation: Leadership, influence, and performance," Journal of Informetrics, Elsevier, vol. 14(1).
    12. Lerchenmueller, Marc J. & Sorenson, Olav, 2018. "The gender gap in early career transitions in the life sciences," Research Policy, Elsevier, vol. 47(6), pages 1007-1017.
    13. Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).
    14. Horbach, Serge P.J.M. & Schneider, Jesper W. & Sainte-Marie, Maxime, 2022. "Ungendered writing: Writing styles are unlikely to account for gender differences in funding rates in the natural and technical sciences," Journal of Informetrics, Elsevier, vol. 16(4).
    15. Marcelo S. Perlin & Takeyoshi Imasato & Denis Borenstein, 2018. "Is predatory publishing a real threat? Evidence from a large database study," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 255-273, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana Maria Takahashi & Shingo Takahashi & Thomas Maloney, 2015. "Gender salary and promotion gaps in Japanese academia: Results from science and engineering," Working Papers EMS_2015_02, Research Institute, International University of Japan.
    2. Joan Daouli & Eirini Konstantina Nikolatou, 2015. "The Market for Ph.D. Holders in Greece: Probit and Multinomial Logit Analysis of their Employment Status," South-Eastern Europe Journal of Economics, Association of Economic Universities of South and Eastern Europe and the Black Sea Region, vol. 13(1), pages 47-74.
    3. Shingo Takahashi & Ana Maria Takahashi, 2009. "Gender Promotion Differences in Economics Departments in Japan: A Semi-parametric Duration Analysis," Working Papers EMS_2009_09, Research Institute, International University of Japan.
    4. Booth, Alison L., 2009. "Gender and competition," Labour Economics, Elsevier, vol. 16(6), pages 599-606, December.
    5. Karen Mumford & Cristina Sechel, 2017. "Pay, Rank and Job Satisfaction amongst Academic Economists in the UK," Discussion Papers 17/17, Department of Economics, University of York.
    6. Karen Mumford & Cristina Sechel, 2020. "Pay and Job Rank among Academic Economists in the UK: Is Gender Relevant?," British Journal of Industrial Relations, London School of Economics, vol. 58(1), pages 82-113, March.
    7. Simonsen, Marianne & Skipper, Lars, 2012. "The family gap in wages: What wombmates reveal," Labour Economics, Elsevier, vol. 19(1), pages 102-112.
    8. Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015. "Bibliometric evaluation vs. informed peer review: Evidence from Italy," Research Policy, Elsevier, vol. 44(2), pages 451-466.
    9. Christopher Worswick & Frances Woolley & Casey Warman, 2006. "The Evolution Of Male-female Wages Differentials In Canadian Universities: 1970-2001," Working Paper 1099, Economics Department, Queen's University.
    10. Bateman, Victoria & Hengel, Erin, 2023. "The gender gap in UK academic economics 1996-2018: progress, stagnation and retreat," LSE Research Online Documents on Economics 118205, London School of Economics and Political Science, LSE Library.
    11. Takahashi, Ana Maria & Takahashi, Shingo, 2015. "Gender promotion differences in economics departments in Japan: A duration analysis," Journal of Asian Economics, Elsevier, vol. 41(C), pages 1-19.
    12. Michael C. Calver & Maggie Lilith & Christopher R. Dickman, 2013. "A ‘perverse incentive’ from bibliometrics: could National Research Assessment Exercises (NRAEs) restrict literature availability for nature conservation?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 243-255, April.
    13. Ioana Boiciuc, 2015. "The Effects of Fiscal Policy on Emerging Economies. A TVP- VAR Approach," South-Eastern Europe Journal of Economics, Association of Economic Universities of South and Eastern Europe and the Black Sea Region, vol. 13(1), pages 75-84.
    14. Takahashi, Ana Maria & Takahashi, Shingo, 2011. "Gender salary differences in economics departments in Japan," Economics of Education Review, Elsevier, vol. 30(6), pages 1306-1319.
    15. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    16. Nitzan Peri-Rotem, 2019. "Gendered Career Pathways among Doctoral Graduates in the United Kingdom," Social Sciences, MDPI, vol. 8(11), pages 1-14, November.
    17. Bosquet, Clément & Combes, Pierre-Philippe & Garcia-Penalosa, Cecilia, 2013. "Gender and competition: evidence from academic promotions in France," LSE Research Online Documents on Economics 58350, London School of Economics and Political Science, LSE Library.
    18. Laura Hospido & Luc Laeven & Ana Lamo, 2022. "The Gender Promotion Gap: Evidence from Central Banking," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 981-996, December.
    19. Elisabeth Hermann Frederiksen, 2006. "An Equilibrium Analysis of the Gender Wage Gap," EPRU Working Paper Series 06-08, Economic Policy Research Unit (EPRU), University of Copenhagen. Department of Economics.
    20. Arnaud Dupuy & Daniel Fernandez-Kranz, 2011. "International differences in the family gap in pay: the role of labour market institutions," Applied Economics, Taylor & Francis Journals, vol. 43(4), pages 413-438.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:43:y:2014:i:6:p:990-1001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.