IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i12d10.1007_s11192-022-04385-8.html
   My bibliography  Save this article

Research performance and scholarly communication profile of competitive research funding: the case of Academy of Finland

Author

Listed:
  • Janne Pölönen

    (Federation of Finnish Learned Societies)

  • Otto Auranen

    (Academy of Finland)

Abstract

The Academy of Finland (AKA), Finland’s major public research funding agency, uses a Web of Science (WoS) based bibliometric indicator to assess the performance of research it has funded. We use an alternative methodology to compare (1) the research performance and (2) the scholarly communication profile of AKA-funded research to the Finnish universities’ entire output across the major fields of arts and sciences. Our data consists of 142,742 publications (years 2015–2018) registered in the national information service, which integrates Current Research Information System (CRIS) data of 13 Finnish universities. Research performance is analyzed using the Finnish community-curated expert-based rating of publication channels (so-called JUFO). Our results show that compared to the Finnish universities’ entire output a larger share of AKA-funded research is published in leading JUFO rated journals and book publishers. JUFO and WoS-based indicators produced consonant results regarding the performance of AKA-funded research. Analysis of publication profiles shows that AKA-funded research is more focused than the universities’ output on using peer-reviewed publications, articles published in journals, English language, foreign publishers and open access publishing. We conclude that the CRIS-based publication data can support multidimensional assessments of research performance and scholarly communication profiles, potentially also in other countries and institutions. CRIS development and maintenance require multi-stakeholder commitment, resources and incentives to ensure data quality and coverage. To fully recognize diverse open science practices and to enable international comparisons, CRISs need further development and integration as data sources.

Suggested Citation

  • Janne Pölönen & Otto Auranen, 2022. "Research performance and scholarly communication profile of competitive research funding: the case of Academy of Finland," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7415-7433, December.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:12:d:10.1007_s11192-022-04385-8
    DOI: 10.1007/s11192-022-04385-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04385-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04385-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jörg Neufeld, 2016. "Determining effects of individual research grants on publication output and impact: The case of the Emmy Noether Programme (German Research Foundation)," Research Evaluation, Oxford University Press, vol. 25(1), pages 50-61.
    2. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    3. Rachel Heyard & Hanna Hottenrott, 2020. "The Impact of Research Funding on Knowledge Creation and Dissemination: A study of SNSF Research Grants," Papers 2011.11274, arXiv.org, revised Aug 2021.
    4. Thed N. Leeuwen & Erik Wijk & Paul F. Wouters, 2016. "Bibliometric analysis of output and impact based on CRIS data: a case study on the registered output of a Dutch university," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 1-16, January.
    5. Liv Langfeldt & Carter Walter Bloch & Gunnar Sivertsen, 2015. "Options and limitations in measuring the impact of research grants—evidence from Denmark and Norway," Research Evaluation, Oxford University Press, vol. 24(3), pages 256-270.
    6. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    7. Otmane Azeroual & Joachim Schöpfel, 2019. "Quality Issues of CRIS Data: An Exploratory Investigation with Universities from Twelve Countries," Publications, MDPI, vol. 7(1), pages 1-18, February.
    8. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    9. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    10. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    11. Richard Van Noorden, 2016. "Controversial impact factor gets a heavyweight rival," Nature, Nature, vol. 540(7633), pages 325-326, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
    2. Corinna Ghirelli & Enkelejda Havari & Elena Meroni & Stefano Verzillo, 2023. "The long-term causal effects of winning an ERC grant," Working Papers 2313, Banco de España.
    3. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    4. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    5. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    6. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    7. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    8. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    9. Anesu D. Gumbo & Evison Kapangaziwiri & Fhumulani I. Mathivha, 2022. "A Systematic Study Site Selection Protocol to Determine Environmental Flows in the Headwater Catchments of the Vhembe Biosphere Reserve," IJERPH, MDPI, vol. 19(10), pages 1-12, May.
    10. Fernando Almeida & José Morais & José Duarte Santos, 2022. "A Bibliometric Analysis of the Scientific Outcomes of European Projects on the Digital Transformation of SMEs," Publications, MDPI, vol. 10(4), pages 1-18, September.
    11. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    12. Muhammad Dimyati & Adhi Indra Hermanu, 2023. "Evaluating Research Efficiency in Indonesian Higher Education Institution," Evaluation Review, , vol. 47(2), pages 155-181, April.
    13. Robert A. Buckle & John Creedy & Ashley Ball, 2021. "Fifteen Years of a PBRFS in New Zealand: Incentives and Outcomes," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(2), pages 208-230, June.
    14. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    15. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    16. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    17. Dzieżyc, Maciej & Kazienko, Przemysław, 2022. "Effectiveness of research grants funded by European Research Council and Polish National Science Centre," Journal of Informetrics, Elsevier, vol. 16(1).
    18. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    19. David A. Pendlebury, 2019. "Charting a path between the simple and the false and the complex and unusable: Review of Henk F. Moed, Applied Evaluative Informetrics [in the series Qualitative and Quantitative Analysis of Scientifi," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 549-560, April.
    20. Salter, Ammon & Salandra, Rossella & Walker, James, 2017. "Exploring preferences for impact versus publications among UK business and management academics," Research Policy, Elsevier, vol. 46(10), pages 1769-1782.

    More about this item

    Keywords

    Research performance; Current research information system; Competitive research funding; Open access; Scholarly publishing; Science communication;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:12:d:10.1007_s11192-022-04385-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.