IDEAS home Printed from https://ideas.repec.org/a/bla/jinfst/v74y2023i1p50-66.html
   My bibliography  Save this article

Do funding sources complement or substitute? Examining the impact of cancer research publications

Author

Listed:
  • Daniele Rotolo
  • Michael Hopkins
  • Nicola Grassano

Abstract

Academic research often draws on multiple funding sources. This paper investigates whether complementarity or substitutability emerges when different types of funding are used. Scholars have examined this phenomenon at the university and scientist levels, but not at the publication level. This gap is significant since acknowledgement sections in scientific papers indicate publications are often supported by multiple funding sources. To address this gap, we examine the extent to which different funding types are jointly used in publications, and to what extent certain combinations of funding are associated with higher academic impact (citation count). We focus on three types of funding accessed by UK‐based researchers: national, international, and industry. The analysis builds on data extracted from all UK cancer‐related publications in 2011, thus providing a 10‐year citation window. Findings indicate that, although there is complementarity between national and international funding in terms of their co‐occurrence (where these are acknowledged in the same publication), when we evaluate funding complementarity in relation to academic impact (we employ the supermodularity framework), we found no evidence of such a relationship. Rather, our results suggest substitutability between national and international funding. We also observe substitutability between international and industry funding.

Suggested Citation

  • Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
  • Handle: RePEc:bla:jinfst:v:74:y:2023:i:1:p:50-66
    DOI: 10.1002/asi.24726
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/asi.24726
    Download Restriction: no

    File URL: https://libkey.io/10.1002/asi.24726?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael J. Stringer & Marta Sales‐Pardo & Luís A. Nunes Amaral, 2010. "Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(7), pages 1377-1385, July.
    2. Mohnen, Pierre & Roller, Lars-Hendrik, 2005. "Complementarities in innovation policy," European Economic Review, Elsevier, vol. 49(6), pages 1431-1450, August.
    3. David, Paul A. & Hall, Bronwyn H. & Toole, Andrew A., 2000. "Is public R&D a complement or substitute for private R&D? A review of the econometric evidence," Research Policy, Elsevier, vol. 29(4-5), pages 497-529, April.
    4. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    5. Grimpe, Christoph, 2012. "Extramural research grants and scientists’ funding strategies: Beggars cannot be choosers?," Research Policy, Elsevier, vol. 41(8), pages 1448-1460.
    6. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    7. Ballot, Gérard & Fakhfakh, Fathi & Galia, Fabrice & Salter, Ammon, 2015. "The fateful triangle: Complementarities in performance between product, process and organizational innovation in France and the UK," Research Policy, Elsevier, vol. 44(1), pages 217-232.
    8. Ciarli, Tommaso & Ràfols, Ismael, 2019. "The relation between research priorities and societal demands: The case of rice," Research Policy, Elsevier, vol. 48(4), pages 949-967.
    9. Toke Reichstein & Ammon Salter, 2006. "Investigating the sources of process innovation among UK manufacturing firms," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 15(4), pages 653-682, August.
    10. M’hand Fares & Saqlain Raza & Alban Thomas, 2018. "Is There Complementarity Between Certified Labels and Brands? Evidence from Small French Cooperatives," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 53(2), pages 367-395, September.
    11. Payne A. Abigail & Siow Aloysius, 2003. "Does Federal Research Funding Increase University Research Output?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 3(1), pages 1-24, May.
    12. Liu, Weishu, 2021. "Caveats for the use of Web of Science Core Collection in old literature retrieval and historical bibliometric analysis," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    13. David Kaplan & Nicola Lacetera & Celia Kaplan, 2008. "Sample Size and Precision in NIH Peer Review," PLOS ONE, Public Library of Science, vol. 3(7), pages 1-3, July.
    14. Milgrom, Paul & Roberts, John, 1995. "Complementarities and fit strategy, structure, and organizational change in manufacturing," Journal of Accounting and Economics, Elsevier, vol. 19(2-3), pages 179-208, April.
    15. Mika Nieminen, 2009. "Influence of research funding and science policy on university research performance: A comparison of five countries," Science and Public Policy, Oxford University Press, vol. 36(6), pages 419-430, July.
    16. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    17. Hottenrott, Hanna & Lawson, Cornelia, 2017. "Fishing for complementarities: Research grants and research productivity," International Journal of Industrial Organization, Elsevier, vol. 51(C), pages 1-38.
    18. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    19. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    20. Gulbrandsen, Magnus & Smeby, Jens-Christian, 2005. "Industry funding and university professors' research performance," Research Policy, Elsevier, vol. 34(6), pages 932-950, August.
    21. Muscio, Alessandro & Quaglione, Davide & Vallanti, Giovanna, 2013. "Does government funding complement or substitute private research funding to universities?," Research Policy, Elsevier, vol. 42(1), pages 63-75.
    22. Daniele Fanelli & Vincent Larivière, 2016. "Researchers’ Individual Publication Rate Has Not Increased in a Century," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-12, March.
    23. Stijn Kelchtermans & Reinhilde Veugelers, 2011. "The great divide in scientific productivity: why the average scientist does not exist," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 20(1), pages 295-336, February.
    24. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    25. Confraria, Hugo & Wang, Lili, 2020. "Medical research versus disease burden in Africa," Research Policy, Elsevier, vol. 49(3).
    26. Defazio, Daniela & Lockett, Andy & Wright, Mike, 2009. "Funding incentives, collaborative dynamics and scientific productivity: Evidence from the EU framework program," Research Policy, Elsevier, vol. 38(2), pages 293-305, March.
    27. Connolly, Laura S., 1997. "Does external funding of academic research crowd out institutional support?," Journal of Public Economics, Elsevier, vol. 64(3), pages 389-406, June.
    28. David, Paul A. & Hall, Bronwyn H., 2000. "Heart of darkness: modeling public-private funding interactions inside the R&D black box," Research Policy, Elsevier, vol. 29(9), pages 1165-1183, December.
    29. Daniele Rotolo & Loet Leydesdorff, 2015. "Matching Medline/PubMed data with Web of Science: A routine in R language," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2155-2159, October.
    30. Abdullah Gök & John Rigby & Philip Shapira, 2016. "The impact of research funding on scientific outputs: Evidence from six smaller European countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 715-730, March.
    31. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    32. Michael J. Stringer & Marta Sales-Pardo & Luís A. Nunes Amaral, 2010. "Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(7), pages 1377-1385, July.
    33. John Rigby, 2013. "Looking for the impact of peer review: does count of funding acknowledgements really predict research impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 57-73, January.
    34. Andrea Bonaccorsi & Cinzia Daraio & Léopold Simar, 2006. "Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 389-410, February.
    35. Bornmann, Lutz & Leydesdorff, Loet & Van den Besselaar, Peter, 2010. "A meta-evaluation of scientific research proposals: Different ways of comparing rejected to awarded applications," Journal of Informetrics, Elsevier, vol. 4(3), pages 211-220.
    36. Ben R Martin, 2011. "The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster?," Research Evaluation, Oxford University Press, vol. 20(3), pages 247-254, September.
    37. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    38. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    39. Mattia Cattaneo & Michele Meoli & Andrea Signori, 2016. "Performance-based funding and university research productivity: the moderating effect of university legitimacy," The Journal of Technology Transfer, Springer, vol. 41(1), pages 85-104, February.
    40. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    41. Li Tang & Guangyuan Hu & Weishu Liu, 2017. "Funding acknowledgment analysis: Queries and caveats," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 790-794, March.
    42. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    43. Van Looy, Bart & Ranga, Marina & Callaert, Julie & Debackere, Koenraad & Zimmermann, Edwin, 2004. "Combining entrepreneurial and scientific performance in academia: towards a compounded and reciprocal Matthew-effect?," Research Policy, Elsevier, vol. 33(3), pages 425-441, April.
    44. Wang, Jian, 2014. "Unpacking the Matthew effect in citations," Journal of Informetrics, Elsevier, vol. 8(2), pages 329-339.
    45. Bozeman, Barry & Corley, Elizabeth, 2004. "Scientists' collaboration strategies: implications for scientific and technical human capital," Research Policy, Elsevier, vol. 33(4), pages 599-616, May.
    46. Ubfal, Diego & Maffioli, Alessandro, 2011. "The impact of funding on research collaboration: Evidence from a developing country," Research Policy, Elsevier, vol. 40(9), pages 1269-1279.
    47. Arora, Ashish & Gambardella, Alfonso, 1990. "Complementarity and External Linkages: The Strategies of the Large Firms in Biotechnology," Journal of Industrial Economics, Wiley Blackwell, vol. 38(4), pages 361-379, June.
    48. Lorenzo Cappellari & Stephen P. Jenkins, 2003. "Multivariate probit regression using simulated maximum likelihood," Stata Journal, StataCorp LP, vol. 3(3), pages 278-294, September.
    49. Grant Lewison & Richard Sullivan, 2015. "Conflicts of interest statements on biomedical papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2151-2159, March.
    50. Davide Antonioli & Alberto Marzucchi & Maria Savona, 2017. "Pain shared, pain halved? Cooperation as a coping strategy for innovation barriers," The Journal of Technology Transfer, Springer, vol. 42(4), pages 841-864, August.
    51. Rebora, Gianfranco & Turri, Matteo, 2013. "The UK and Italian research assessment exercises face to face," Research Policy, Elsevier, vol. 42(9), pages 1657-1666.
    52. Diego Ubfal & Alessandro Maffioli, 2010. "The Impact of Funding on Research Collaboration: Evidence from Argentina," SPD Working Papers 1006, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    53. J. Edler & L. Georghiou & K. Blind & E. Uyarra, 2012. "Evaluating the demand side: New challenges for evaluation," Research Evaluation, Oxford University Press, vol. 21(1), pages 33-47, February.
    54. Rodrigo Costas & Thed N. van Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    55. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    56. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    57. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    2. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    3. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    4. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).
    5. Zhou Mo & Zhang Yujie & Lei Jiasu & Tan Xiaowen, 2022. "Early firm engagement, government research funding, and the privatization of public knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4797-4826, August.
    6. Byeongwoo Kang & Kazuyuki Motohashi, 2020. "Academic contribution to industrial innovation by funding type," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 169-193, July.
    7. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    8. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    9. Ebadi, Ashkan & Schiffauerova, Andrea, 2015. "How to become an important player in scientific collaboration networks?," Journal of Informetrics, Elsevier, vol. 9(4), pages 809-825.
    10. Muscio, Alessandro & Quaglione, Davide & Vallanti, Giovanna, 2013. "Does government funding complement or substitute private research funding to universities?," Research Policy, Elsevier, vol. 42(1), pages 63-75.
    11. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    12. Migheli, Matteo & Zotti, Roberto, 2020. "The strange case of the Matthew effect and beauty contests: Research evaluation and specialisation in Italian universities," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    13. Wang, Jian & Lee, You-Na & Walsh, John P., 2018. "Funding model and creativity in science: Competitive versus block funding and status contingency effects," Research Policy, Elsevier, vol. 47(6), pages 1070-1083.
    14. Yu, Nannan & Dong, Yueyan & de Jong, Martin, 2022. "A helping hand from the government? How public research funding affects academic output in less-prestigious universities in China," Research Policy, Elsevier, vol. 51(10).
    15. Ashkan Ebadi & Andrea Schiffauerova, 2015. "How to Receive More Funding for Your Research? Get Connected to the Right People!," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-19, July.
    16. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    17. Melanie Wiener & Daniela Maresch & Robert J. Breitenecker, 2020. "The shift towards entrepreneurial universities and the relevance of third-party funding of business and economics units in Austria: a research note," Review of Managerial Science, Springer, vol. 14(2), pages 345-363, April.
    18. Domenico A. Maisano & Luca Mastrogiacomo & Fiorenzo Franceschini, 2020. "Short-term effects of non-competitive funding to single academic researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1261-1280, June.
    19. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    20. Kyoungmi Lee & Sunglok Choi & Jae-Suk Yang, 2021. "Can expensive research equipment boost research and development performances?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7715-7742, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jinfst:v:74:y:2023:i:1:p:50-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.