IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i4d10.1007_s11192-023-04666-w.html
   My bibliography  Save this article

Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis

Author

Listed:
  • Yongchao Ma

    (Huazhong University of Science & Technology
    City University of Hong Kong)

  • Ying Teng

    (City University of Hong Kong)

  • Zhongzhun Deng

    (Sichuan University)

  • Li Liu

    (Huazhong University of Science & Technology)

  • Yi Zhang

    (Huazhong University of Science & Technology)

Abstract

“Achieve gender equality and empower all women and girls” is essential to reduce gender disparity and improve the status of women. But it remains a challenge to narrow gender differences and improve gender equality in academic research. In this paper, we propose that the impact of articles is lower and writing style of articles is less positive when the article’s first author is female relative to male first authors, and writing style mediates this relationship. Focusing on the positive writing style, we attempt to contribute and explain the research on gender differences in research performance. We use BERT-based textual sentiment analysis to analyse 87 years of 9820 articles published in the top four marketing journals and prove our hypotheses. We also consider a set of control variables and conduct a set of robustness checks to ensure the robustness of our findings. We discuss the theoretical and managerial implications of our findings for researchers.

Suggested Citation

  • Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:4:d:10.1007_s11192-023-04666-w
    DOI: 10.1007/s11192-023-04666-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04666-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04666-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhu, Dong Hong & Deng, Zhong Zhun & Chang, Ya Ping, 2020. "Understanding the influence of submission devices on online consumer reviews:A comparison between smartphones and PCs," Journal of Retailing and Consumer Services, Elsevier, vol. 54(C).
    2. Mahmood Khosrowjerdi & Lutz Bornmann, 2019. "Is culture related to strong science? An empirical investigation," Papers 1909.04521, arXiv.org, revised Apr 2021.
    3. Zhu, Bangzhu & Xu, Chenxin & Wang, Ping & Zhang, Lin, 2022. "How does internal carbon pricing affect corporate environmental performance?," Journal of Business Research, Elsevier, vol. 145(C), pages 65-77.
    4. Horbach, Serge P.J.M. & Schneider, Jesper W. & Sainte-Marie, Maxime, 2022. "Ungendered writing: Writing styles are unlikely to account for gender differences in funding rates in the natural and technical sciences," Journal of Informetrics, Elsevier, vol. 16(4).
    5. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    6. Kyle R. Myers & Wei Yang Tham & Yian Yin & Nina Cohodes & Jerry G. Thursby & Marie C. Thursby & Peter Schiffer & Joseph T. Walsh & Karim R. Lakhani & Dashun Wang, 2020. "Unequal effects of the COVID-19 pandemic on scientists," Nature Human Behaviour, Nature, vol. 4(9), pages 880-883, September.
    7. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    8. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    9. Zhu, Nibing & Liu, Chang & Yang, Zhilin, 2021. "Team Size, Research Variety, and Research Performance: Do Coauthors’ Coauthors Matter?," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Jiang, Ling (Alice) & Zhu, Nibing & Yang, Zhilin & Xu, Shen & Jun, Minjoon, 2018. "The relationships between distance factors and international collaborative research outcomes: A bibliometric examination," Journal of Informetrics, Elsevier, vol. 12(3), pages 618-630.
    11. Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
    12. Natalia Restrepo & Alfonso Unceta & Xabier Barandiaran, 2021. "Gender Diversity in Research and Innovation Projects: The Proportion of Women in the Context of Higher Education," Sustainability, MDPI, vol. 13(9), pages 1-21, May.
    13. United Nations UN, 2015. "Transforming our World: the 2030 Agenda for Sustainable Development," Working Papers id:7559, eSocialSciences.
    14. Liu, Meijun & Zhang, Ning & Hu, Xiao & Jaiswal, Ajay & Xu, Jian & Chen, Hong & Ding, Ying & Bu, Yi, 2022. "Further divided gender gaps in research productivity and collaboration during the COVID-19 pandemic: Evidence from coronavirus-related literature," Journal of Informetrics, Elsevier, vol. 16(2).
    15. Jesus Palomo & Cristina Figueroa-Domecq & Pilar Laguna, 2017. "Women, peace and security state-of-art: a bibliometric analysis in social sciences based on SCOPUS database," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 123-148, October.
    16. Vincent Larivière & Rodrigo Costas, 2016. "How Many Is Too Many? On the Relationship between Research Productivity and Impact," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-10, September.
    17. Yoo, Boonghee, 2009. "Developing an overall ranking of 79 marketing journals: An introduction of PRINQUAL to marketing," Australasian marketing journal, Elsevier, vol. 17(3), pages 160-174.
    18. Yuanyuan Shang & Gunnar Sivertsen & Zhe Cao & Lin Zhang, 2022. "Gender differences among first authors in research focused on the Sustainable Development Goal of Gender Equality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4769-4796, August.
    19. Khosrowjerdi, Mahmood & Bornmann, Lutz, 2021. "Is culture related to strong science? An empirical investigation," Journal of Informetrics, Elsevier, vol. 15(4).
    20. Mike Thelwall, 2018. "Do gendered citation advantages influence field participation? Four unusual fields in the USA 1996–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 2133-2144, December.
    21. Ju Wen & Lei Lei, 2022. "Adjectives and adverbs in life sciences across 50 years: implications for emotions and readability in academic texts," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4731-4749, August.
    22. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    23. repec:oup:jconrs:v:47:y:2021:i:5:p:675-697. is not listed on IDEAS
    24. Ana Jesús López & Dolores Pereira, 2021. "The Value of Transfer of Knowledge in Bridging the Gender Gap in STEM," Sustainability, MDPI, vol. 13(10), pages 1-15, May.
    25. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    26. Zhang, Mengya & Zhang, Gupeng & Liu, Yun & Zhai, Xiaorong & Han, Xinying, 2020. "Scientists’ genders and international academic collaboration: An empirical study of Chinese universities and research institutes," Journal of Informetrics, Elsevier, vol. 14(4).
    27. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    28. Thelwall, Mike & Bailey, Carol & Makita, Meiko & Sud, Pardeep & Madalli, Devika P., 2019. "Gender and research publishing in India: Uniformly high inequality?," Journal of Informetrics, Elsevier, vol. 13(1), pages 118-131.
    29. Lerchenmueller, Marc J. & Sorenson, Olav, 2018. "The gender gap in early career transitions in the life sciences," Research Policy, Elsevier, vol. 47(6), pages 1007-1017.
    30. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2015. "Should the research performance of scientists be distinguished by gender?," Journal of Informetrics, Elsevier, vol. 9(1), pages 25-38.
    31. Xinshu Zhao & John G. Lynch & Qimei Chen, 2010. "Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 197-206, August.
    32. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    33. Zhou-min Yuan & Mingxin Yao, 2022. "Is academic writing becoming more positive? A large-scale diachronic case study of Science research articles across 25 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6191-6207, November.
    34. Sabrina J. Mayer & Justus M. K. Rathmann, 2018. "How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1663-1693, December.
    35. Stefan Stremersch & Peter C. Verhoef, 2005. "Globalization of Authorship in the Marketing Discipline: Does It Help or Hinder the Field?," Marketing Science, INFORMS, vol. 24(4), pages 585-594, February.
    36. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2019. "The collaboration behavior of top scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 215-232, January.
    37. Anthony Salerno & Juliano Laran & Chris Janiszewski & Darren W Dahl & Linda L Price & Cait Lamberton, 2019. "The Bad Can Be Good: When Benign and Malicious Envy Motivate Goal Pursuit," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(2), pages 388-405.
    38. Julian Kolev & Yuly Fuentes-Medel & Fiona Murray, 2019. "Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation," NBER Working Papers 25759, National Bureau of Economic Research, Inc.
    39. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    40. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2019. "A gender analysis of top scientists’ collaboration behavior: evidence from Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 405-418, August.
    41. Elba Mauleón & María Bordons, 2006. "Productivity, impact and publication habits by gender in the area of Materials Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 199-218, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    2. Dengsheng Wu & Huidong Wu & Jianping Li, 2024. "Citation advantage of positive words: predictability, temporal evolution, and universality in varied quality journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4275-4293, July.
    3. Yining Wang & Qiang Wu & Liangyu Li, 2024. "Examining the influence of women scientists on scientific impact and novelty: insights from top business journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3517-3542, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nakajima, Kazuki & Liu, Ruodan & Shudo, Kazuyuki & Masuda, Naoki, 2023. "Quantifying gender imbalance in East Asian academia: Research career and citation practice," Journal of Informetrics, Elsevier, vol. 17(4).
    2. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    3. Dengsheng Wu & Huidong Wu & Jianping Li, 2024. "Citation advantage of positive words: predictability, temporal evolution, and universality in varied quality journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4275-4293, July.
    4. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    5. Hajibabaei, Anahita & Schiffauerova, Andrea & Ebadi, Ashkan, 2022. "Gender-specific patterns in the artificial intelligence scientific ecosystem," Journal of Informetrics, Elsevier, vol. 16(2).
    6. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    7. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    8. Wenxuan Shi & Renli Wu, 2024. "Women’s strength in science: exploring the influence of female participation on research impact and innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4529-4551, July.
    9. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    10. Thamyres T. Choji & Manuel J. Cobo & Jose A. Moral-Munoz, 2024. "Is the scientific impact of the LIS themes gender-biased? A bibliometric analysis of the evolution, scientific impact, and relative contribution by gender from 2007 to 2022," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 6023-6047, October.
    11. Zhang, Lin & Shang, Yuanyuan & HUANG, Ying & Sivertsen, Gunnar, 2021. "Gender differences among active reviewers: an investigation based on Publons," SocArXiv 4z6w8, Center for Open Science.
    12. Shen, Hongquan & Xie, Juan & Ao, Weiyi & Cheng, Ying, 2022. "The continuity and citation impact of scientific collaboration with different gender composition," Journal of Informetrics, Elsevier, vol. 16(1).
    13. Shen, Hongquan & Cheng, Ying & Ju, Xiufang & Xie, Juan, 2022. "Rethinking the effect of inter-gender collaboration on research performance for scholars," Journal of Informetrics, Elsevier, vol. 16(4).
    14. Hamid R. Jamali & Alireza Abbasi, 2023. "Gender gaps in Australian research publishing, citation and co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2879-2893, May.
    15. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    16. Marek Kwiek & Wojciech Roszka, 2021. "Gender Disparities In International Research Collaboration: A Study Of 25,000 University Professors," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1344-1380, December.
    17. Liu, Meijun & Zhang, Ning & Hu, Xiao & Jaiswal, Ajay & Xu, Jian & Chen, Hong & Ding, Ying & Bu, Yi, 2022. "Further divided gender gaps in research productivity and collaboration during the COVID-19 pandemic: Evidence from coronavirus-related literature," Journal of Informetrics, Elsevier, vol. 16(2).
    18. Zhang, Lin & Sivertsen, Gunnar & Du, Huiying & HUANG, Ying & Glänzel, Wolfgang, 2021. "Gender differences in the aims and impacts of research," SocArXiv 9n347, Center for Open Science.
    19. Marina Pilkina & Andrey Lovakov, 2022. "Gender disparities in Russian academia: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3577-3591, June.
    20. Loarne-Lemaire, Séverine Le & Bertrand, Gaël & Razgallah, Meriam & Maalaoui, Adnane & Kallmuenzer, Andreas, 2021. "Women in innovation processes as a solution to climate change: A systematic literature review and an agenda for future research," Technological Forecasting and Social Change, Elsevier, vol. 164(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:4:d:10.1007_s11192-023-04666-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.