IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i6d10.1007_s11192-023-04706-5.html
   My bibliography  Save this article

Knowledge-integrated research is more disruptive when supported by homogeneous funding sources: a case of US federally funded research in biomedical and life sciences

Author

Listed:
  • Seolmin Yang

    (Korea Advanced Institute of Science and Technology)

  • So Young Kim

    (Korea Advanced Institute of Science and Technology)

Abstract

Governments commonly support scientific research integrating knowledge of various areas and fields, expecting this to lead to disruptive research. However, empirical evidence is relatively scant regarding whether knowledge-integrated research with government funding disrupts sciences. This study explores the quality of government-funded research in terms of knowledge integration and disruption. Knowledge integration is measured as the degree to which a paper combines different research subjects in three dimensions of diversity—variety, balance, and disparity. Disruption is calculated based on paper citation networks, thereby capturing how the paper challenges existing research streams and provides new directions of scientific research. Our analysis demonstrates that the relationship between knowledge integration and disruption varies by government funding sources, using bibliometric data from US federally funded research published between 1975 and 2005 in biomedical and life sciences. The empirical findings show that: (1) knowledge-integrated research is more disruptive when supported by funding agencies of the same government department rather than of different government departments; and (2) while the effect of knowledge integration on long-term citations is positive and becomes stronger for the studies funded by homogeneous government funding sources, its effect on short-term citations is negative regardless of the source of government funding. These results highlight the potential value of knowledge-integrated research that is hard to capture through short-term performance, which holds significant policy implications for current practices in research evaluations that are driven by short-term evaluation.

Suggested Citation

  • Seolmin Yang & So Young Kim, 2023. "Knowledge-integrated research is more disruptive when supported by homogeneous funding sources: a case of US federally funded research in biomedical and life sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3257-3282, June.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:6:d:10.1007_s11192-023-04706-5
    DOI: 10.1007/s11192-023-04706-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04706-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04706-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Romer, Paul M, 1986. "Increasing Returns and Long-run Growth," Journal of Political Economy, University of Chicago Press, vol. 94(5), pages 1002-1037, October.
    2. Shibayama, Sotaro, 2019. "Sustainable development of science and scientists: Academic training in life science labs," Research Policy, Elsevier, vol. 48(3), pages 676-692.
    3. Lingfei Wu & Dashun Wang & James A. Evans, 2019. "Large teams develop and small teams disrupt science and technology," Nature, Nature, vol. 566(7744), pages 378-382, February.
    4. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    5. Ismael Rafols & Martin Meyer, 2010. "Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 263-287, February.
    6. Catherine Lyall & Ann Bruce & Wendy Marsden & Laura Meagher, 2013. "The role of funding agencies in creating interdisciplinary knowledge," Science and Public Policy, Oxford University Press, vol. 40(1), pages 62-71, January.
    7. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    8. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    9. James Cunningham & Paul O'Reilly & Conor O'Kane & Vincent Mangematin, 2014. "The inhibiting factors that principal investigators experience in leading publicly funded research projects," Grenoble Ecole de Management (Post-Print) hal-00756228, HAL.
    10. Ronald Rousseau, 2018. "The repeat rate: from Hirschman to Stirling," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 645-653, July.
    11. Daniele Fanelli & Wolfgang Glänzel, 2013. "Bibliometric Evidence for a Hierarchy of the Sciences," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-11, June.
    12. Loet Leydesdorff & Tobias Opthof, 2013. "Citation analysis with medical subject Headings (MeSH) using the Web of Knowledge: A new routine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(5), pages 1076-1080, May.
    13. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    14. John Rigby, 2013. "Looking for the impact of peer review: does count of funding acknowledgements really predict research impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 57-73, January.
    15. Alfredo Yegros-Yegros & Ismael Rafols & Pablo D’Este, 2015. "Does Interdisciplinary Research Lead to Higher Citation Impact? The Different Effect of Proximal and Distal Interdisciplinarity," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    16. Dietmar Braun & David H Guston, 2003. "Principal-agent theory and research policy: An introduction," Science and Public Policy, Oxford University Press, vol. 30(5), pages 302-308, October.
    17. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    18. Grit Laudel, 2006. "Conclave in the Tower of Babel: how peers review interdisciplinary research proposals," Research Evaluation, Oxford University Press, vol. 15(1), pages 57-68, April.
    19. Leydesdorff, Loet & Rafols, Ismael, 2011. "Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations," Journal of Informetrics, Elsevier, vol. 5(1), pages 87-100.
    20. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    21. Caroline S. Wagner & Jeffrey Alexander, 2013. "Evaluating transformative research programmes: A case study of the NSF Small Grants for Exploratory Research programme," Research Evaluation, Oxford University Press, vol. 22(3), pages 187-197, June.
    22. Elizabeth Shove, 2003. "Principals, agents and research programmes," Science and Public Policy, Oxford University Press, vol. 30(5), pages 371-381, October.
    23. Braun, Dietmar, 1993. "Who Governs Intermediary Agencies? Principal-Agent Relations in Research Policy-Making," Journal of Public Policy, Cambridge University Press, vol. 13(2), pages 135-162, April.
    24. Loet Leydesdorff & Daniele Rotolo & Ismael Rafols, 2012. "Bibliometric perspectives on medical innovation using the medical subject Headings of PubMed," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(11), pages 2239-2253, November.
    25. James Cunningham & Paul O’Reilly & Conor O’Kane & Vincent Mangematin, 2014. "The inhibiting factors that principal investigators experience in leading publicly funded research," The Journal of Technology Transfer, Springer, vol. 39(1), pages 93-110, February.
    26. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    27. Jacqueline N. Lane & Ina Ganguli & Patrick Gaule & Eva Guinan & Karim R. Lakhani, 2021. "Engineering serendipity: When does knowledge sharing lead to knowledge production?," Strategic Management Journal, Wiley Blackwell, vol. 42(6), pages 1215-1244, June.
    28. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2019. "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient," Journal of Informetrics, Elsevier, vol. 13(1), pages 255-269.
    29. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    30. Lindell Bromham & Russell Dinnage & Xia Hua, 2016. "Interdisciplinary research has consistently lower funding success," Nature, Nature, vol. 534(7609), pages 684-687, June.
    31. Russell J. Funk & Jason Owen-Smith, 2017. "A Dynamic Network Measure of Technological Change," Management Science, INFORMS, vol. 63(3), pages 791-817, March.
    32. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    33. Thomas W. Steele & Jeffrey C. Stier, 2000. "The impact of interdisciplinary research in the environmental sciences: a forestry case study," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(5), pages 476-484.
    34. James Cunningham & Paul O'Reilly & Conor O'Kane & Vincent Mangematin, 2014. "The inhibiting factors that principal investigators experience in leading publicly funded research projects," Post-Print hal-00756228, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    2. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    3. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    4. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    5. Fei Shu & Jesse David Dinneen & Shiji Chen, 2022. "Measuring the disparity among scientific disciplines using Library of Congress Subject Headings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3613-3628, June.
    6. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    7. Kwon, Seokbeom, 2022. "Interdisciplinary knowledge integration as a unique knowledge source for technology development and the role of funding allocation," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    8. Xiaojing Cai & Xiaozan Lyu & Ping Zhou, 2023. "The relationship between interdisciplinarity and citation impact—a novel perspective on citation accumulation," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    9. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    10. Jingjing Ren & Fang Wang & Minglu Li, 2023. "Dynamics and characteristics of interdisciplinary research in scientific breakthroughs: case studies of Nobel-winning research in the past 120 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4383-4419, August.
    11. Magda Fontana & Martina Iori & Fabio Montobbio & Roberta Sinatra, 2018. "A bridge over troubled water: Interdisciplinarity, Novelty, and Impact," DISCE - Quaderni del Dipartimento di Politica Economica dipe0002, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    12. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    13. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.
    14. Wolfgang Glänzel & Koenraad Debackere, 2022. "Various aspects of interdisciplinarity in research and how to quantify and measure those," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5551-5569, September.
    15. Feng Shi & James Evans, 2023. "Surprising combinations of research contents and contexts are related to impact and emerge with scientific outsiders from distant disciplines," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    16. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    17. Chen, Shiji & Arsenault, Clément & Larivière, Vincent, 2015. "Are top-cited papers more interdisciplinary?," Journal of Informetrics, Elsevier, vol. 9(4), pages 1034-1046.
    18. Sander Zwanenburg & Maryam Nakhoda & Peter Whigham, 2022. "Toward greater consistency and validity in measuring interdisciplinarity: a systematic and conceptual evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7769-7788, December.
    19. Fontana, Magda & Iori, Martina & Montobbio, Fabio & Sinatra, Roberta, 2020. "New and atypical combinations: An assessment of novelty and interdisciplinarity," Research Policy, Elsevier, vol. 49(7).
    20. Núria Bautista-Puig & Jorge Mañana-Rodríguez & Antonio Eleazar Serrano-López, 2021. "Role taxonomy of green and sustainable science and technology journals: exportation, importation, specialization and interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3871-3892, May.

    More about this item

    Keywords

    Knowledge integration; Disruption; Citations; Government funding; Biomedical and life sciences; Research evaluation;
    All these keywords.

    JEL classification:

    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:6:d:10.1007_s11192-023-04706-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.