IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/10875.html
   My bibliography  Save this paper

Standing on Academic Shoulders: Measuring Scientific Influence in Universities

Author

Listed:
  • James D. Adams
  • J. Roger Clemmons
  • Paula E. Stephan

Abstract

This article measures scientific influence by means of citations to academic papers. The data source is the Institute for Scientific Information (ISI); the scientific institutions included are the top 110 U.S. research universities; the 12 main fields that classify the data cover nearly all of science; and the time period is 1981-1999. Altogether the database includes 2.4 million papers and 18.8 million citations. Thus the evidence underlying our findings accounts for much of the basic research conducted in the United States during the last quarter of the 20th century. This research in turn contributes a significant part of knowledge production in the U.S. during the same period. The citation measure used is the citation probability, which equals actual citations divided by potential citations, and captures average utilization of cited literature by individual citing articles. The mean citation probability within fields is on the order of 10-5. Cross-field citation probabilities are one-tenth to one-hundredth as large, or 10-6 to 10-7. Citations between pairs of citing and cited fields are significant in less than one-fourth of the possible cases. It follows that citations are largely bounded by field, with corresponding implications for the limits of scientific influence. Cross-field citation probabilities appear to be symmetric for mutually citing fields. Scientific influence is asymmetric within fields, and occurs primarily from top institutions to those less highly ranked. Still, there is significant reverse influence on higher-ranked schools. We also find that top institutions are more often cited by peer institutions than lower-ranked institutions are cited by their peers. Overall the results suggest that knowledge spillovers in basic science research are important, but are circumscribed by field and by intrinsic relevance. Perhaps the most important implication of the results are the limits that they seem to impose on the returns to scale in the knowledge production function for basic research, namely the proportion of available knowledge that spills over from one scientist to another.

Suggested Citation

  • James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2004. "Standing on Academic Shoulders: Measuring Scientific Influence in Universities," NBER Working Papers 10875, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:10875
    Note: PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w10875.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Wesley M. Cohen & Richard R. Nelson & John P. Walsh, 2003. "Links and Impacts: The Influence of Public Research on Industrial R&D," Chapters, in: Aldo Geuna & Ammon J. Salter & W. Edward Steinmueller (ed.), Science and Innovation, chapter 4, Edward Elgar Publishing.
    2. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    3. Adams, James D, 1990. "Fundamental Stocks of Knowledge and Productivity Growth," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 673-702, August.
    4. Jaffe, Adam B, 1986. "Technological Opportunity and Spillovers of R&D: Evidence from Firms' Patents, Profits, and Market Value," American Economic Review, American Economic Association, vol. 76(5), pages 984-1001, December.
    5. Michael L. Darby & Lynne G. Zucker, 2010. "Grilichesian Breakthroughs: Inventions of Methods of Inventing and Firm Entry in Nanotechnology," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 143-164, National Bureau of Economic Research, Inc.
    6. Zucker, Lynne G & Darby, Michael R & Brewer, Marilynn B, 1998. "Intellectual Human Capital and the Birth of U.S. Biotechnology Enterprises," American Economic Review, American Economic Association, vol. 88(1), pages 290-306, March.
    7. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    8. Marie Thursby & Richard Jensen, 2001. "Proofs and Prototypes for Sale: The Licensing of University Inventions," American Economic Review, American Economic Association, vol. 91(1), pages 240-259, March.
    9. Audretsch, David B & Stephan, Paula E, 1996. "Company-Scientist Locational Links: The Case of Biotechnology," American Economic Review, American Economic Association, vol. 86(3), pages 641-652, June.
    10. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    11. David, Paul A, 1998. "Common Agency Contracting and the Emergence of "Open Science" Institutions," American Economic Review, American Economic Association, vol. 88(2), pages 15-21, May.
    12. David Popp, 2002. "Induced Innovation and Energy Prices," American Economic Review, American Economic Association, vol. 92(1), pages 160-180, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andrei Dubovik & Clemens Fiedler & Alexei Parakhonyak, 2022. "Temporal Patterns in Economics Research," CPB Discussion Paper 440, CPB Netherlands Bureau for Economic Policy Analysis.
    2. Hans Lööf & Anders Broström, 2008. "Does knowledge diffusion between university and industry increase innovativeness?," The Journal of Technology Transfer, Springer, vol. 33(1), pages 73-90, February.
    3. Popp, David, 2012. "The role of technological change in green growth," Policy Research Working Paper Series 6239, The World Bank.
    4. Daniel Teodorescu & Tudorel Andrei, 2014. "An examination of “citation circles” for social sciences journals in Eastern European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 209-231, May.
    5. David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," CESifo Working Paper Series 5442, CESifo.
    6. Dean Hendrix, 2009. "Institutional self-citation rates: A three year study of universities in the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 321-331, November.
    7. James Adams & J. Roger Clemmons, 2008. "Science And Industry: Tracing The Flow Of Basic Research Through Manufacturing And Trade," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(5), pages 473-495.
    8. David Popp, 2012. "The Role of Technological Change in Green Growth," NBER Working Papers 18506, National Bureau of Economic Research, Inc.
    9. David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," NBER Working Papers 21415, National Bureau of Economic Research, Inc.
    10. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gersbach, Hans & Sorger, Gerhard & Amon, Christian, 2018. "Hierarchical growth: Basic and applied research," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 434-459.
    2. Cassiman, Bruno & Veugelers, Reinhilde & Zuniga, Pluvia, 2009. "Diversity of science linkages and innovation performance: some empirical evidence from Flemish firms," Economics Discussion Papers 2009-30, Kiel Institute for the World Economy (IfW Kiel).
    3. Albino, Vito & Ardito, Lorenzo & Dangelico, Rosa Maria & Messeni Petruzzelli, Antonio, 2014. "Understanding the development trends of low-carbon energy technologies: A patent analysis," Applied Energy, Elsevier, vol. 135(C), pages 836-854.
    4. Zoltán J. Ács & Pontus Braunerhjelm & David B. Audretsch & Bo Carlsson, 2015. "The knowledge spillover theory of entrepreneurship," Chapters, in: Global Entrepreneurship, Institutions and Incentives, chapter 7, pages 129-144, Edward Elgar Publishing.
    5. Gersbach, Hans & Sorger, Gerhard & Amon, Christian, 2018. "Hierarchical growth: Basic and applied research," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 434-459.
    6. Cassiman, Bruno & Veugelers, Reinhilde & Zuniga, Pluvia, 2007. "Science linkages and innovation performance: An analysis on CIS-3 firms in Belgium," IESE Research Papers D/671, IESE Business School.
    7. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 217-273, Elsevier.
    8. James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2006. "How Rapidly Does Science Leak Out?," NBER Working Papers 11997, National Bureau of Economic Research, Inc.
    9. James D. Adams, 2000. "Endogenous R&D Spillovers and Industrial Research Productivity," NBER Working Papers 7484, National Bureau of Economic Research, Inc.
    10. Cohen, Wesley M., 2010. "Fifty Years of Empirical Studies of Innovative Activity and Performance," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 129-213, Elsevier.
    11. Saul Lach & Mark Schankerman, 2008. "Incentives and invention in universities," RAND Journal of Economics, RAND Corporation, vol. 39(2), pages 403-433, June.
    12. Christoph Meister & Bart Verspagen & Guntram B. Wolff, 2006. "European Productivity Gaps: Is R&D the Solution?," Chapters, in: Susanne Mundschenk & Michael H. Stierle & Ulrike Stierle-von Schütz & Iulia Traistaru-Siedschlag (ed.), Competitiveness and Growth in Europe, chapter 8, Edward Elgar Publishing.
    13. Lee Branstetter & Kwon Hyeog Ug, 2004. "The Restructuring Of Japanese Research And Development: The Increasing Impact Of Science On Japanese R&D," Discussion papers 04021, Research Institute of Economy, Trade and Industry (RIETI).
    14. Dominique Guellec & Bruno Van Pottelsberghe de la Potterie, 2004. "From R&D to Productivity Growth: Do the Institutional Settings and the Source of Funds of R&D Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(3), pages 353-378, July.
    15. Rene Belderbos & Victor Gilsing & Shinya Suzuki, 2015. "Direct and mediated ties to universities: ‘Scientific’ absorptive capacity and innovation performance of pharmaceutical firms," Working Papers of Department of Management, Strategy and Innovation, Leuven 504836, KU Leuven, Faculty of Economics and Business (FEB), Department of Management, Strategy and Innovation, Leuven.
    16. Michelle Gittelman & Bruce Kogut, 2003. "Does Good Science Lead to Valuable Knowledge? Biotechnology Firms and the Evolutionary Logic of Citation Patterns," Management Science, INFORMS, vol. 49(4), pages 366-382, April.
    17. Quatraro, Francesco & Scandura, Alessandra, 2019. "Academic Inventors and the Antecedents of Green Technologies. A Regional Analysis of Italian Patent Data," Ecological Economics, Elsevier, vol. 156(C), pages 247-263.
    18. Nelson, Andrew J., 2012. "Putting university research in context: Assessing alternative measures of production and diffusion at Stanford," Research Policy, Elsevier, vol. 41(4), pages 678-691.
    19. James P. LeSage & Manfred M. Fischer, 2012. "Estimates of the Impact of Static and Dynamic Knowledge Spillovers on Regional Factor Productivity," International Regional Science Review, , vol. 35(1), pages 103-127, January.
    20. G Medda & C. Piga, 2004. "R&S e spillover industriali: un'analisi sulle imprese italiane," Working Paper CRENoS 200406, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.

    More about this item

    JEL classification:

    • L30 - Industrial Organization - - Nonprofit Organizations and Public Enterprise - - - General
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:10875. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.