IDEAS home Printed from https://ideas.repec.org/a/bla/jamist/v54y2003i5p447-461.html
   My bibliography  Save this article

Indicator‐assisted evaluation and funding of research: Visualizing the influence of grants on the number and citation counts of research papers

Author

Listed:
  • Kevin W. Boyack
  • Katy Börner

Abstract

This article reports research on analyzing and visualizing the impact of governmental funding on the amount and citation counts of research publications. For the first time, grant and publication data appear interlinked in one map. We start with an overview of related work and a discussion of available techniques. A concrete example—grant and publication data from Behavioral and Social Science Research, one of four extramural research programs at the National Institute on Aging (NIA)—is analyzed and visualized using the VxInsight® visualization tool. The analysis also illustrates current existing problems related to the quality and existence of data, data analysis, and processing. The article concludes with a list of recommendations on how to improve the quality of grant‐publication maps and a discussion of research challenges for indicator‐assisted evaluation and funding of research.

Suggested Citation

  • Kevin W. Boyack & Katy Börner, 2003. "Indicator‐assisted evaluation and funding of research: Visualizing the influence of grants on the number and citation counts of research papers," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(5), pages 447-461, March.
    • Handle: RePEc:bla:jamist:v:54:y:2003:i:5:p:447-461
    DOI: 10.1002/asi.10230
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/asi.10230
    Download Restriction: no
    File URL: https://libkey.io/10.1002/asi.10230?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2023. "Data-driven support for policy and decision-making in university research management: A case study from Germany," European Journal of Operational Research, Elsevier, vol. 308(1), pages 353-368.
    2. Xianwen Wang & Di Liu & Kun Ding & Xinran Wang, 2012. "Science funding and research output: a study on 10 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 591-599, May.
    3. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    4. Yan Yan & Shanwu Tian & Jingjing Zhang, 2020. "The impact of a paper’s new combinations and new components on its citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 895-913, February.
    5. Amin Mazloumian & Young-Ho Eom & Dirk Helbing & Sergi Lozano & Santo Fortunato, 2011. "How Citation Boosts Promote Scientific Paradigm Shifts and Nobel Prizes," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-6, May.
    6. Jamal El-Ouahi, 2024. "Research funding in the Middle East and North Africa: analyses of acknowledgments in scientific publications indexed in the Web of Science (2008–2021)," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 2933-2968, June.
    7. Jue Wang & Philip Shapira, 2011. "Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 563-586, June.
    8. Chen, Wei & Yan, Yan, 2023. "New components and combinations: The perspective of the internal collaboration networks of scientific teams," Journal of Informetrics, Elsevier, vol. 17(2).
    9. Kazuki Nakajima & Kazuyuki Shudo & Naoki Masuda, 2023. "Higher-order rich-club phenomenon in collaborative research grant networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2429-2446, April.
    10. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    11. Shanwu Tian & Xiurui Xu & Ping Li, 2021. "Acknowledgement network and citation count: the moderating role of collaboration network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7837-7857, September.
    12. Salterio, Steven E. & Hoang, Kris & Luo, Yi, 2021. "Communication is a two-way street: Analyzing practices undertaken to systematically transfer audit research knowledge to policymakers," Accounting, Organizations and Society, Elsevier, vol. 94(C).
    13. Chakraborty, Tanmoy & Tammana, Vihar & Ganguly, Niloy & Mukherjee, Animesh, 2015. "Understanding and modeling diverse scientific careers of researchers," Journal of Informetrics, Elsevier, vol. 9(1), pages 69-78.
    14. Yu, Dejian & Yan, Zhaoping, 2023. "Main path analysis considering citation structure and content: Case studies in different domains," Journal of Informetrics, Elsevier, vol. 17(1).
    15. Huub Spiertz, 2013. "Challenges for Crop Production Research in Improving Land Use, Productivity and Sustainability," Sustainability, MDPI, vol. 5(4), pages 1-13, April.
    16. Zhang, Xinyuan & Xie, Qing & Song, Min, 2021. "Measuring the impact of novelty, bibliometric, and academic-network factors on citation count using a neural network," Journal of Informetrics, Elsevier, vol. 15(2).
    17. Andrea Bonaccorsi & Brigida Blasi & Carmela Anna Nappi & Sandra Romagnosi, 2022. "Quality of research as source and signal: revisiting the valorization process beyond substitution vs complementarity," The Journal of Technology Transfer, Springer, vol. 47(2), pages 407-434, April.
    18. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2017. "Is scientific performance a function of funds?," SFB 649 Discussion Papers 2017-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    19. Pin Li & Guoli Yang & Chuanqi Wang, 2019. "Visual topical analysis of library and information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1753-1791, December.
    20. S. Phineas Upham & Lori Rosenkopf & Lyle H. Ungar, 2010. "Innovating knowledge communities," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 525-554, May.
    21. S. Phineas Upham & Henry Small, 2010. "Emerging research fronts in science and technology: patterns of new knowledge development," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 15-38, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jamist:v:54:y:2003:i:5:p:447-461. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.