IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v18y1994i1p11-19.html
   My bibliography  Save this article

Assessing Research Impact

Author

Listed:
  • Ronald N. Kostoff

    (Office of Naval Research)

Abstract

Three types of semiquantitative methods used by the federal government in research impact assessment are presented. These include the classic retrospective method (Project Hindsight), another retrospective approach (Project TRACES andfollow-ons), and accomplishments books used by selected research-sponsoring organizations (Office of Naval Research, Air Force Office of Scientific Research, Department of Energy Office of Health and Environmental Research, Department of Energy High Energy Physics Program, Defense Advanced Research Projects Agency). The strengths and weaknesses of each approach are discussed. One goal of all the studies presented was to identify the products of research and some of their impacts. In addition, the Hindsight, the technology in retrospect and critical events in science (TRACES), and the Defense Advanced Research Projects Agency (DARPA) studies tried to identify factors that influenced the productivity and impact of research. The following general conclusions about the role and impact of basic research were reached: (1) the majority of basic research events that directly affected technologies or systems were nonmission oriented and occurred many decades before the technology or the system emerged; (2) the cumulative indirect impacts of basic research were not accounted for by any of the retrospective approaches published; (3) an advanced pool of knowledge must be developed in many fields before synthesis leading to an innovation can occur; and (4) allocation of benefits among researchers, organizations, and funding agencies to determine economic returns from basic research is very difficult and arbitrary, especially at the microlevel.

Suggested Citation

  • Ronald N. Kostoff, 1994. "Assessing Research Impact," Evaluation Review, , vol. 18(1), pages 11-19, February.
    • Handle: RePEc:sae:evarev:v:18:y:1994:i:1:p:11-19
    DOI: 10.1177/0193841X9401800102
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X9401800102
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X9401800102?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mansfield, Edwin, 1991. "Academic research and industrial innovation," Research Policy, Elsevier, vol. 20(1), pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wipo, 2011. "World Intellectual Property Report 2011- The Changing Face of Innovation," WIPO Economics & Statistics Series, World Intellectual Property Organization - Economics and Statistics Division, number 2011:944, April.
    2. Subhra Saha & Joseph Staudt & Bruce Weinbergx, 2017. "Estimating the Local Productivity Spillovers from Science," Working Papers 17-56, Center for Economic Studies, U.S. Census Bureau.
    3. Yi-Min Chen, 2008. "How Much Does Country Matter?," International Regional Science Review, , vol. 31(4), pages 404-435, October.
    4. David Grosse Kathoefer & Jens Leker, 2012. "Knowledge transfer in academia: an exploratory study on the Not-Invented-Here Syndrome," The Journal of Technology Transfer, Springer, vol. 37(5), pages 658-675, October.
    5. Federico Caviggioli & Alessandra Colombelli & Antonio De Marco & Giuseppe Scellato & Elisa Ughetto, 2023. "Co-evolution patterns of university patenting and technological specialization in European regions," The Journal of Technology Transfer, Springer, vol. 48(1), pages 216-239, February.
    6. Grandi, Alessandro & Grimaldi, Rosa, 2005. "Academics' organizational characteristics and the generation of successful business ideas," Journal of Business Venturing, Elsevier, vol. 20(6), pages 821-845, November.
    7. Cassiman, Bruno & Veugelers, Reinhilde & Zuniga, Pluvia, 2009. "Diversity of science linkages and innovation performance: some empirical evidence from Flemish firms," Economics Discussion Papers 2009-30, Kiel Institute for the World Economy (IfW Kiel).
    8. Aschhoff, Birgit & Sofka, Wolfgang, 2008. "Successful Patterns of Scientific Knowledge Sourcing: Mix and Match," ZEW Discussion Papers 08-033 [rev.], ZEW - Leibniz Centre for European Economic Research.
    9. R. J. W. Tussen & R. K. Buter & Th. N. van Leeuwen, 2000. "Technological Relevance of Science: An Assessment of Citation Linkages between Patents and Research Papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 389-412, February.
    10. Blind, Knut & Grupp, Hariolf, 1999. "Interdependencies between the science and technology infrastructure and innovation activities in German regions: empirical findings and policy consequences," Research Policy, Elsevier, vol. 28(5), pages 451-468, June.
    11. Watzinger, Martin & Schnitzer, Monika, 2019. "Standing on the Shoulders of Science," Rationality and Competition Discussion Paper Series 215, CRC TRR 190 Rationality and Competition.
    12. Bronwyn H. Hall & Albert N. Link & John T. Scott, 2003. "Universities as Research Partners," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 485-491, May.
    13. Gersbach, Hans & Sorger, Gerhard & Amon, Christian, 2018. "Hierarchical growth: Basic and applied research," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 434-459.
    14. Luengo, María Jesús & Obeso, María, 2013. "Efeito da hélice tríplice em desempenho de inovação," RAE - Revista de Administração de Empresas, FGV-EAESP Escola de Administração de Empresas de São Paulo (Brazil), vol. 53(4), July.
    15. Kokko, Ari & Tingvall, Patrik Gustavsson & Videnord, Josefin, 2015. "The growth effects of R&D spending in the EU: A meta-analysis," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 9, pages 1-26.
    16. Casas, Rosalba & de Gortari, Rebeca & Santos, Ma. Josefa, 2000. "The building of knowledge spaces in Mexico: a regional approach to networking," Research Policy, Elsevier, vol. 29(2), pages 225-241, February.
    17. James Adams & Zvi Griliches, 1996. "Measuring Science: An Exploration," NBER Working Papers 5478, National Bureau of Economic Research, Inc.
    18. Eva Mora-Valentín & Marta Ortiz-de-Urbina-Criado, 2009. "Improving the effectiveness of academic-business models: an analysis of obstacles in R&D activities in service industries," Service Business, Springer;Pan-Pacific Business Association, vol. 3(4), pages 395-413, December.
    19. Mahmut Yaşar & Catherine Paul, 2012. "Firm performance and knowledge spillovers from academic, industrial and foreign linkages: the case of China," Journal of Productivity Analysis, Springer, vol. 38(3), pages 237-253, December.
    20. Bekkers, Rudi & Bodas Freitas, Isabel Maria, 2008. "Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter?," Research Policy, Elsevier, vol. 37(10), pages 1837-1853, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:18:y:1994:i:1:p:11-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.