IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v13y2019i1p226-237.html
   My bibliography  Save this article

Are NIH-funded publications fulfilling the proposed research? An examination of concept-matchedness between NIH research grants and their supported publications

Author

Listed:
  • Li, Kai
  • Yan, Erjia

Abstract

The conceptual connections between scientific grants and publications are important, yet often overlooked in quantitative studies of science. An analysis of such connections could offer important insights into how science is conducted by individual researchers and research teams under the social and economic conditions of science. This study aims to offer the first piece of evidence towards this endeavor by analyzing the ratio of keyword matchedness between accepted NIH research grants from 2008 to 2015 and their funded publications. By applying linear regression method, we identified and examined three identified predictors of the outcome: 1) the funding rate of an NIH research program in a specific year, 2) the year difference between grant and publication, and 3) the funding size of a grant. Our findings suggest that these three factors contribute to the outcome in different capacities. Moreover, all of them may have different performances in individual funding programs, which highlights the importance of understanding the differences among individual funding mechanisms.

Suggested Citation

  • Li, Kai & Yan, Erjia, 2019. "Are NIH-funded publications fulfilling the proposed research? An examination of concept-matchedness between NIH research grants and their supported publications," Journal of Informetrics, Elsevier, vol. 13(1), pages 226-237.
  • Handle: RePEc:eee:infome:v:13:y:2019:i:1:p:226-237
    DOI: 10.1016/j.joi.2019.01.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157718303717
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.joi.2019.01.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Etzkowitz, Henry & Leydesdorff, Loet, 2000. "The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations," Research Policy, Elsevier, vol. 29(2), pages 109-123, February.
    2. Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
    3. Beaudry, Catherine & Allaoui, Sedki, 2012. "Impact of public and private research funding on scientific production: The case of nanotechnology," Research Policy, Elsevier, vol. 41(9), pages 1589-1606.
    4. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    5. Ashish Arora & Alfonso Gambardella, 2010. "The Impact of NSF Support for Basic Research in Economics," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 91-115, National Bureau of Economic Research, Inc.
    6. Loet Leydesdorff & Henry Etzkowitz, 1996. "Emergence of a Triple Helix of university—industry—government relations," Science and Public Policy, Oxford University Press, vol. 23(5), pages 279-286, October.
    7. Hanna Hottenrott & Cornelia Lawson, 2014. "Research grants, sources of ideas and the effects on academic research," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 23(2), pages 109-133, March.
    8. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    9. Marianne Hörlesberger & Ivana Roche & Dominique Besagni & Thomas Scherngell & Claire François & Pascal Cuxac & Edgar Schiebel & Michel Zitt & Dirk Holste, 2013. "A concept for inferring ‘frontier research’ in grant proposals," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 129-148, November.
    10. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of NIH postdoctoral training grants on scientific productivity," Research Policy, Elsevier, vol. 40(6), pages 864-874, July.
    11. Kevin W. Boyack & Caleb Smith & Richard Klavans, 2018. "Toward predicting research proposal success," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 449-461, February.
    12. repec:adr:anecst:y:2005:i:79-80:p:04 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Jinqing & Bu, Yi & Lu, Wei & Huang, Yong & Hu, Jiming & Huang, Shengzhi & Zhang, Li, 2022. "Identifying keyword sleeping beauties: A perspective on the knowledge diffusion process," Journal of Informetrics, Elsevier, vol. 16(1).
    2. Ba, Zhichao & Liang, Zhentao, 2021. "A novel approach to measuring science-technology linkage: From the perspective of knowledge network coupling," Journal of Informetrics, Elsevier, vol. 15(3).
    3. Sepideh Fahimifar & Elmira Janavi & Fatemeh Fadaei, 2024. "Awakening the beauty: a journey through dormant gems in strategic management literature," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(4), pages 3331-3362, August.
    4. Ba, Zhichao & Meng, Kai & Ma, Yaxue & Xia, Yikun, 2024. "Discovering technological opportunities by identifying dynamic structure-coupling patterns and lead-lag distance between science and technology," Technological Forecasting and Social Change, Elsevier, vol. 200(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    2. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    3. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    4. Annita Nugent & Ho Fai Chan & Uwe Dulleck, 2022. "Government funding of university-industry collaboration: exploring the impact of targeted funding on university patent activity," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 29-73, January.
    5. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    6. Adriana Bin & Sergio Salles-Filho & Ana Carolina Spatti & Jesús Pascual Mena-Chalco & Fernando Antonio Basile Colugnati, 2022. "How much does a Ph.D. scholarship program impact an emerging economy research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6935-6960, December.
    7. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    8. Chaojiang Wu & Erjia Yan & Yongjun Zhu & Kai Li, 2021. "Gender imbalance in the productivity of funded projects: A study of the outputs of National Institutes of Health R01 grants," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(11), pages 1386-1399, November.
    9. Park, Hyunwoo & Lee, Jeongsik (Jay) & Kim, Byung-Cheol, 2015. "Project selection in NIH: A natural experiment from ARRA," Research Policy, Elsevier, vol. 44(6), pages 1145-1159.
    10. Ben Zhang & Xiaohong Wang, 2017. "Empirical study on influence of university-industry collaboration on research performance and moderating effect of social capital: evidence from engineering academics in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 257-277, October.
    11. Ryazanova, Olga & Jaskiene, Jolanta, 2022. "Managing individual research productivity in academic organizations: A review of the evidence and a path forward," Research Policy, Elsevier, vol. 51(2).
    12. Graddy-Reed, Alexandra & Lanahan, Lauren & D'Agostino, Jesse, 2021. "Training across the academy: The impact of R&D funding on graduate students," Research Policy, Elsevier, vol. 50(5).
    13. Győrffy, Balázs & Herman, Péter & Szabó, István, 2020. "Research funding: past performance is a stronger predictor of future scientific output than reviewer scores," Journal of Informetrics, Elsevier, vol. 14(3).
    14. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    15. Benavente, José Miguel & Crespi, Gustavo & Figal Garone, Lucas & Maffioli, Alessandro, 2012. "The impact of national research funds: A regression discontinuity approach to the Chilean FONDECYT," Research Policy, Elsevier, vol. 41(8), pages 1461-1475.
    16. Li, Yin & Arora, Sanjay & Youtie, Jan & Shapira, Philip, 2018. "Using web mining to explore Triple Helix influences on growth in small and mid-size firms," Technovation, Elsevier, vol. 76, pages 3-14.
    17. Marco Cozzi, 2020. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 1809, Department of Economics, University of Victoria.
    18. Munari, Federico & Toschi, Laura, 2021. "The impact of public funding on science valorisation: an analysis of the ERC Proof-of-Concept Programme," Research Policy, Elsevier, vol. 50(6).
    19. Chandler, Vincent, 2018. "Short and long-term impacts of an increase in graduate funding," Economics of Education Review, Elsevier, vol. 62(C), pages 104-112.
    20. Devrim Goktepe, 2003. "The Triple Helix as a model to analyze Israeli Magnet Program and lessons for late-developing countries like Turkey," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(2), pages 219-239, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:13:y:2019:i:1:p:226-237. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.