IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i8d10.1007_s11192-023-04753-y.html
   My bibliography  Save this article

Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics

Author

Listed:
  • Giovanni Abramo

    (National Research Council of Italy)

  • Ciriaco Andrea D’Angelo

    (National Research Council of Italy
    University of Rome “Tor Vergata”)

  • Myroslava Hladchenko

    (Leiden University)

Abstract

This article aims to explore the effects of Ukrainian policy reform, introducing Scopus and WoS publication requirements for professorship, on the publication behaviour and research performance of professors. Our analysis reveals a better scientific profile, at the time of promotion, of those who obtained professorship after the reform as compared to those who obtained it before. Also, we observe a bandwagon effect since the research performance gap between the two observed cohorts decreased after the introduction of the publication requirements. The statistical difference in differences tests revealed that in general, the incentive to produce more indexed publications worked. Nevertheless, it did not always led to higher research performance. Evidently, in several cases, the increase in research output was obtained at the expense of research impact. The effects of the reform could be far greater if combined with initiatives aimed at assessing Ukrainian professor performance regularly and extending the requirements and assessment to the impact of research.

Suggested Citation

  • Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:8:d:10.1007_s11192-023-04753-y
    DOI: 10.1007/s11192-023-04753-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04753-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04753-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jiri Vanecek & Ondrej Pecha, 2020. "Fast growth of the number of proceedings papers in atypical fields in the Czech Republic is a likely consequence of the national performance-based research funding system," Research Evaluation, Oxford University Press, vol. 29(3), pages 245-262.
    2. Diana Hicks, 1999. "The difficulty of achieving full coverage of international social science literature and the bibliometric consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(2), pages 193-215, February.
    3. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    4. Vincent Larivière & Éric Archambault & Yves Gingras & Étienne Vignola‐Gagné, 2006. "The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 997-1004, June.
    5. Francisco Collazo-Reyes, 2014. "Growth of the number of indexed journals of Latin America and the Caribbean: the effect on the impact of each country," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 197-209, January.
    6. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    7. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
    8. Linda Butler, 2003. "Modifying publication practices in response to funding formulas," Research Evaluation, Oxford University Press, vol. 12(1), pages 39-46, April.
    9. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Martin Grančay & Jolita Vveinhardt & Ērika Šumilo, 2017. "Publish or perish: how Central and Eastern European economists have dealt with the ever-increasing academic publishing requirements 2000–2015," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1813-1837, June.
    11. Marta De Philippis, 2021. "Multi-Task Agents and Incentives: The Case of Teaching and Research for University Professors," The Economic Journal, Royal Economic Society, vol. 131(636), pages 1643-1681.
    12. Bagues, Manuel & Sylos-Labini, Mauro & Zinovyeva, Natalia, 2019. "A walk on the wild side: ‘Predatory’ journals and information asymmetries in scientific evaluations," Research Policy, Elsevier, vol. 48(2), pages 462-477.
    13. Serhii Nazarovets, 2020. "Controversial practice of rewarding for publications in national journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 813-818, July.
    14. Peter Ingwersen & Birger Larsen, 2014. "Influence of a performance indicator on Danish research production and citation impact 2000–12," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1325-1344, November.
    15. Zaida Chinchilla-Rodríguez & Sandra Miguel & Félix Moya-Anegón, 2015. "What factors affect the visibility of Argentinean publications in humanities and social sciences in Scopus? Some evidence beyond the geographic realm of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 789-810, January.
    16. Demir, Selcuk Besir, 2018. "Predatory journals: Who publishes in them and why?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1296-1311.
    17. Truyken L. B. Ossenblok & Tim C. E. Engels & Gunnar Sivertsen, 2012. "The representation of the social sciences and humanities in the Web of Science--a comparison of publication patterns and incentive structures in Flanders and Norway (2005--9)," Research Evaluation, Oxford University Press, vol. 21(4), pages 280-290, September.
    18. Jesper W. Schneider & Kaare Aagaard & Carter W. Bloch, 2016. "What happens when national research funding is linked to differentiated publication counts? A comparison of the Australian and Norwegian publication-based funding models," Research Evaluation, Oxford University Press, vol. 25(3), pages 244-256.
    19. Myroslava Hladchenko & Henk F. Moed, 2021. "National orientation of Ukrainian journals: means-ends decoupling in a semi-peripheral state," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2365-2389, March.
    20. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2014. "How do you define and measure research productivity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1129-1144, November.
    21. Declan Butler, 2013. "Investigating journals: The dark side of publishing," Nature, Nature, vol. 495(7442), pages 433-435, March.
    22. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    23. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    24. Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
    25. Quynh Anh Le, 2016. "The Impact of Globalisation on the Reform of Higher Education inVietnam," International Journal of Business and Economic Affairs (IJBEA), Sana N. Maswadeh, vol. 1(1), pages 29-35.
    26. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    27. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    28. Vít Macháček & Martin Srholec, 2021. "RETRACTED ARTICLE: Predatory publishing in Scopus: evidence on cross-country differences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 1897-1921, March.
    29. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    30. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    31. Jiri Vanecek, 2014. "The effect of performance-based research funding on output of R&D results in the Czech Republic," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 657-681, January.
    32. Shevchenko, Valentina V., 2019. "The reform of the higher education of Ukraine in the conditions of the military-political crisis," International Journal of Educational Development, Elsevier, vol. 65(C), pages 237-253.
    33. Barbara Good & Niki Vermeulen & Brigitte Tiefenthaler & Erik Arnold, 2015. "Counting quality? The Czech performance-based research funding system," Research Evaluation, Oxford University Press, vol. 24(2), pages 91-105.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vasile Cernat, 2024. "The unprincipled principal: how Romania’s inconsistent research reform impacted scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5557-5575, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    2. Andrea Mervar & Maja Jokić, 2022. "Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5793-5817, October.
    3. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    4. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    5. Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
    6. Andrey Lovakov & Anna Panova & Maria Yudkevich, 2022. "Global visibility of nationally published research output: the case of the post-Soviet region," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2643-2659, May.
    7. Yaşar Tonta & Müge Akbulut, 2020. "Does monetary support increase citation impact of scholarly papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1617-1641, November.
    8. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    9. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    10. Mohamed Boufarss & Mikael Laakso, 2020. "Open Sesame? Open access priorities, incentives, and policies among higher education institutions in the United Arab Emirates," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1553-1577, August.
    11. van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
    12. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    13. Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
    14. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    15. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp, Center for Open Science.
    16. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    17. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    18. Selcuk Besir Demir, 2018. "Pros and cons of the new financial support policy for Turkish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2053-2068, September.
    19. Daniella Bayle Deutz & Thea Marie Drachen & Dorte Drongstrup & Niels Opstrup & Charlotte Wien, 2021. "Quantitative quality: a study on how performance-based measures may change the publication patterns of Danish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3303-3320, April.
    20. Vasile Cernat, 2024. "The unprincipled principal: how Romania’s inconsistent research reform impacted scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5557-5575, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:8:d:10.1007_s11192-023-04753-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.