IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i10d10.1007_s11192-024-04959-8.html
   My bibliography  Save this article

Do research assessment systems have the potential to hinder scientists from diversifying their research pursuits?

Author

Listed:
  • Giovanni Abramo

    (Universitas Mercatorum)

  • Ciriaco Andrea D’Angelo

    (University of Rome “Tor Vergata”)

  • Flavia Costa

    (Universitas Mercatorum)

Abstract

A possible side effect of several research evaluation schemes adopted by governments and research organizations is the discouragement of research diversification and cross-discipline fertilization, which are crucial for major global scientific challenges. This work intends to contribute to the literature stream investigating such initiatives’ effects on scientists’ specialization/diversification strategies. To this purpose, we analyze the response of academics to the introduction of the national scientific accreditation (ASN) for professorship introduced in Italy in 2012. We will conduct a longitudinal disciplinary analysis of the publications of each Italian university professor in the sciences (over 25.000), accounting for those individual and contextual variables that might moderate the opportunistic response to the ASN incentive scheme.

Suggested Citation

  • Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2024. "Do research assessment systems have the potential to hinder scientists from diversifying their research pursuits?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 5915-5935, October.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:10:d:10.1007_s11192-024-04959-8
    DOI: 10.1007/s11192-024-04959-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-04959-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-04959-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
    2. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    3. Chakraborty, Tanmoy & Tammana, Vihar & Ganguly, Niloy & Mukherjee, Animesh, 2015. "Understanding and modeling diverse scientific careers of researchers," Journal of Informetrics, Elsevier, vol. 9(1), pages 69-78.
    4. Stefanie Haustein & Vincent Larivière, 2015. "The Use of Bibliometrics for Assessing Research: Possibilities, Limitations and Adverse Effects," Springer Books, in: Isabell M. Welpe & Jutta Wollersheim & Stefanie Ringelhan & Margit Osterloh (ed.), Incentives and Performance, edition 127, pages 121-139, Springer.
    5. Frank Nagle & Florenta Teodoridis, 2020. "Jack of all trades and master of knowledge: The role of diversification in new distant knowledge integration," Strategic Management Journal, Wiley Blackwell, vol. 41(1), pages 55-85, January.
    6. Fontana, Magda & Iori, Martina & Leone Sciabolazza, Valerio & Souza, Daniel, 2022. "The interdisciplinarity dilemma: Public versus private interests," Research Policy, Elsevier, vol. 51(7).
    7. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "Diversification versus specialization in scientific research: Which strategy pays off?," Technovation, Elsevier, vol. 82, pages 51-57.
    8. Belkhouja, Mustapha & Fattoum, Senda & Yoon, Hyungseok (David), 2021. "Does greater diversification increase individual productivity? The moderating effect of attention allocation," Research Policy, Elsevier, vol. 50(6).
    9. Daniel S. Nagin & James B. Rebitzer & Seth Sanders & Lowell J. Taylor, 2002. "Monitoring, Motivation, and Management: The Determinants of Opportunistic Behavior in a Field Experiment," American Economic Review, American Economic Association, vol. 92(4), pages 850-873, September.
    10. van Rijnsoever, Frank J. & Hessels, Laurens K., 2011. "Factors associated with disciplinary and interdisciplinary research collaboration," Research Policy, Elsevier, vol. 40(3), pages 463-472, April.
    11. Chiara Franzoni & Cristina Rossi-Lamastra, 2017. "Academic tenure, risk-taking and the diversification of scientific research," Industry and Innovation, Taylor & Francis Journals, vol. 24(7), pages 691-712, October.
    12. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Zhang, Lin, 2018. "A comparison of two approaches for measuring interdisciplinary research output: The disciplinary diversity of authors vs the disciplinary diversity of the reference list," Journal of Informetrics, Elsevier, vol. 12(4), pages 1182-1193.
    13. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    14. An Zeng & Zhesi Shen & Jianlin Zhou & Ying Fan & Zengru Di & Yougui Wang & H. Eugene Stanley & Shlomo Havlin, 2019. "Increasing trend of scientists to switch between topics," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    15. Antonis Sidiropoulos & Dimitrios Katsaros & Yannis Manolopoulos, 2007. "Generalized Hirsch h-index for disclosing latent facts in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 253-280, August.
    16. Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
    17. Ciriaco Andrea D'Angelo & Cristiano Giuffrida & Giovanni Abramo, 2011. "A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 257-269, February.
    18. Schuitema, Geertje & D. Sintov, Nicole, 2017. "Should we quit our jobs? Challenges, barriers and recommendations for interdisciplinary energy research," Energy Policy, Elsevier, vol. 101(C), pages 246-250.
    19. Josephine V. Rekers & Teis Hansen, 2015. "Interdisciplinary research and geography: Overcoming barriers through proximity," Science and Public Policy, Oxford University Press, vol. 42(2), pages 242-254.
    20. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2018. "The effects of gender, age and academic rank on research diversification," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 373-387, February.
    21. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    22. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Charemza, Wojciech & Lewandowski, Michał & Woźny, Łukasz, 2024. "On journal rankings and researchers' abilities," Journal of Informetrics, Elsevier, vol. 18(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    2. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "Diversification versus specialization in scientific research: Which strategy pays off?," Technovation, Elsevier, vol. 82, pages 51-57.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    4. Xin Liu & Yi Bu & Ming Li & Jiang Li, 2024. "Monodisciplinary collaboration disrupts science more than multidisciplinary collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(1), pages 59-78, January.
    5. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    6. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.
    7. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    8. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    9. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp, Center for Open Science.
    10. Francesco Giovanni Avallone & Alberto Quagli & Paola Ramassa, 2022. "Interdisciplinary research by accounting scholars: An exploratory study," FINANCIAL REPORTING, FrancoAngeli Editore, vol. 2022(2), pages 5-34.
    11. Seokbeom Kwon & Kazuyuki Motohashi & Kenta Ikeuchi, 2022. "Chasing two hares at once? Effect of joint institutional change for promoting commercial use of university knowledge and scientific research," The Journal of Technology Transfer, Springer, vol. 47(4), pages 1242-1272, August.
    12. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    13. Junping Qiu & Yunlong Yu & Shiji Chen & Teng Zhao & Shanshan Wang, 2024. "Effect of Scientific Collaboration on Interdisciplinarity in Climate Change From a Scientometric Perspective," SAGE Open, , vol. 14(2), pages 21582440241, April.
    14. Shengli Deng & Sudi Xia, 2020. "Mapping the interdisciplinarity in information behavior research: a quantitative study using diversity measure and co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 489-513, July.
    15. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    16. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2019. "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient," Journal of Informetrics, Elsevier, vol. 13(1), pages 255-269.
    17. Zhang, Lin & Qi, Fan & Sivertsen, Gunnar & Liang, Liming & Campbell, David, 2023. "Gender differences in the patterns and consequences of changing specialization in scientific careers," SocArXiv ep5bx, Center for Open Science.
    18. Li, Meiling & Wang, Yang & Du, Haifeng & Bai, Aruhan, 2024. "Motivating innovation: The impact of prestigious talent funding on junior scientists," Research Policy, Elsevier, vol. 53(9).
    19. Lina Xu & Steven Dellaportas & Jin Wang, 2022. "A study of interdisciplinary accounting research: analysing the diversity of cited references," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(2), pages 2131-2162, June.
    20. Zhao, Yi & Liu, Lifan & Zhang, Chengzhi, 2022. "Is coronavirus-related research becoming more interdisciplinary? A perspective of co-occurrence analysis and diversity measure of scientific articles," Technological Forecasting and Social Change, Elsevier, vol. 175(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:10:d:10.1007_s11192-024-04959-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.