IDEAS home Printed from https://ideas.repec.org/a/kap/jtecht/v45y2020i2d10.1007_s10961-018-09713-w.html
   My bibliography  Save this article

Modernizing federal technology transfer metrics

Author

Listed:
  • Vidita Choudhry

    (Naval Medical Research Center)

  • Todd A. Ponzio

    (Naval Medical Research Center)

Abstract

Nearly 40 years ago Congress laid the foundation for federal agencies to engage in technology transfer activities with a primary goal to make federal laboratory research outcomes widely available. Since then, agencies generally rely on universal metrics such as licensing income and number of patents to measure the benefit of their technology transfer program. However, such metrics do not address the requirements set by the current and previous administrations, which require agencies to better gauge the effectiveness and return on investment of their technology programs. Here we evaluate two metrics, filing ratio and transfer rate, and empirically evaluate these metrics using data from Department of the Navy’s most transactionally active laboratory, as well as recently released agency-reported data available from the FY 2015 annual technology transfer report (15 U.S.C. Section 3710). We additionally propose other federally-relevant metrics for which agency data are not currently available. Results presented here indicate that these modernized metrics may potentially fulfill the requirements set by executive guidance. The study findings also point out to other metrics that are relevant to practitioners, program managers, and policymakers in the evaluation of technology transfer programs for better measurement of effectiveness, efficiency, and return on investment.

Suggested Citation

  • Vidita Choudhry & Todd A. Ponzio, 2020. "Modernizing federal technology transfer metrics," The Journal of Technology Transfer, Springer, vol. 45(2), pages 544-559, April.
    • Handle: RePEc:kap:jtecht:v:45:y:2020:i:2:d:10.1007_s10961-018-09713-w
    DOI: 10.1007/s10961-018-09713-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10961-018-09713-w
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10961-018-09713-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Adam B. Jaffe & Josh Lerner, 2006. "Innovation and its Discontents," NBER Chapters, in: Innovation Policy and the Economy, Volume 6, pages 27-66, National Bureau of Economic Research, Inc.
    2. Siegel, Donald S. & Waldman, David & Link, Albert, 2003. "Assessing the impact of organizational practices on the relative productivity of university technology transfer offices: an exploratory study," Research Policy, Elsevier, vol. 32(1), pages 27-48, January.
    3. Markman, Gideon D. & Gianiodis, Peter T. & Phan, Phillip H. & Balkin, David B., 2005. "Innovation speed: Transferring university technology to market," Research Policy, Elsevier, vol. 34(7), pages 1058-1075, September.
    4. Paul Swamidass & Venubabu Vulasa, 2009. "Why university inventions rarely produce income? Bottlenecks in university technology transfer," The Journal of Technology Transfer, Springer, vol. 34(4), pages 343-363, August.
    5. Ham, Rose Marie & Mowery, David C., 1998. "Improving the effectiveness of public-private R&D collaboration: case studies at a US weapons laboratory," Research Policy, Elsevier, vol. 26(6), pages 661-675, February.
    6. Jaffe, Adam B & Lerner, Josh, 2001. "Reinventing Public R&D: Patent Policy and the Commercialization of National Laboratory Technologies," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 167-198, Spring.
    7. Mark A. Lemley & Robin Feldman, 2016. "Patent Licensing, Technology Transfer, and Innovation," American Economic Review, American Economic Association, vol. 106(5), pages 188-192, May.
    8. James D. Adams & Eric P. Chiang & Jeffrey L. Jensen, 2003. "The Influence of Federal Laboratory R&D on Industrial Research," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 1003-1020, November.
    9. Tsvi Vinig & David Lips, 2015. "Measuring the performance of university technology transfer using meta data approach: the case of Dutch universities," The Journal of Technology Transfer, Springer, vol. 40(6), pages 1034-1049, December.
    10. Adam B. Jaffe & Josh Lerner & Scott Stern, 2006. "Innovation Policy and the Economy, Volume 6," NBER Books, National Bureau of Economic Research, Inc, number jaff06-1.
    11. Nicolas van Zeebroeck, 2011. "The puzzle of patent value indicators," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 20(1), pages 33-62.
    12. Jill Sorensen & Donald Chambers, 2008. "Evaluating academic technology transfer performance by how well access to knowledge is facilitated––defining an access metric," The Journal of Technology Transfer, Springer, vol. 33(5), pages 534-547, October.
    13. Adam B. Jaffe & Josh Lerner & Scott Stern, 2006. "Introduction to "Innovation Policy and the Economy, Volume 6"," NBER Chapters, in: Innovation Policy and the Economy, Volume 6, pages -5, National Bureau of Economic Research, Inc.
    14. Link, Albert N. & Siegel, Donald S. & Van Fleet, David D., 2011. "Public science and public innovation: Assessing the relationship between patenting at U.S. National Laboratories and the Bayh-Dole Act," Research Policy, Elsevier, vol. 40(8), pages 1094-1099, October.
    15. Markus A. Kirchberger & Larissa Pohl, 2016. "Technology commercialization: a literature review of success factors and antecedents across different contexts," The Journal of Technology Transfer, Springer, vol. 41(5), pages 1077-1112, October.
    16. Bessen, James, 2008. "The value of U.S. patents by owner and patent characteristics," Research Policy, Elsevier, vol. 37(5), pages 932-945, June.
    17. Adam B. Jaffe & Michael S. Fogarty & Bruce A. Banks, 1998. "Evidence from Patents and Patent Citations on the Impact of NASA and Other Federal Labs on Commercial Innovation," Journal of Industrial Economics, Wiley Blackwell, vol. 46(2), pages 183-205, June.
    18. Hicks, Diana & Breitzman, Tony & Olivastro, Dominic & Hamilton, Kimberly, 2001. "The changing composition of innovative activity in the US -- a portrait based on patent analysis," Research Policy, Elsevier, vol. 30(4), pages 681-703, April.
    19. Narin, Francis & Hamilton, Kimberly S. & Olivastro, Dominic, 1997. "The increasing linkage between U.S. technology and public science," Research Policy, Elsevier, vol. 26(3), pages 317-330, October.
    20. Greiner, Michael A & Franza, Richard M, 2003. "Barriers and Bridges for Successful Environmental Technology Transfer," The Journal of Technology Transfer, Springer, vol. 28(2), pages 167-177, April.
    21. Hsu, David W.L. & Shen, Yung-Chi & Yuan, Benjamin J.C. & Chou, Chiyan James, 2015. "Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 25-39.
    22. Adam B. Jaffe & Josh Lerner & Scott Stern (ed.), 2006. "Innovation Policy and the Economy, Volume 6," MIT Press Books, The MIT Press, edition 1, volume 6, number 0262101181, April.
    23. Hertzfeld, Henry R, 2002. "Measuring the Economic Returns from Successful NASA Life Sciences Technology Transfers," The Journal of Technology Transfer, Springer, vol. 27(4), pages 311-320, December.
    24. Philip L. Gardner & Ann Y. Fong & Roshena L. Huang, 2010. "Measuring the impact of knowledge transfer from public research organisations: a comparison of metrics used around the world," International Journal of Learning and Intellectual Capital, Inderscience Enterprises Ltd, vol. 7(3/4), pages 318-327.
    25. Chuchu Chen & Albert N. Link & Zachary T. Oliver, 2018. "U.S. federal laboratories and their research partners: a quantitative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 501-517, April.
    26. Laura Diaz Anadon & Gabriel Chan & Amitai Y. Bin-Nun & Venkatesh Narayanamurti, 2016. "The pressing energy innovation challenge of the US National Laboratories," Nature Energy, Nature, vol. 1(10), pages 1-8, October.
    27. Bozeman, Barry & Rimes, Heather & Youtie, Jan, 2015. "The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model," Research Policy, Elsevier, vol. 44(1), pages 34-49.
    28. Jisun Kim & Timothy Anderson & Tugrul Daim, 2008. "Assessing University Technology Transfer: A Measure Of Efficiency Patterns," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 495-526.
    29. Donald S. Siegel & Reinhilde Veugelers & Mike Wright, 2007. "Technology transfer offices and commercialization of university intellectual property: performance and policy implications," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 23(4), pages 640-660, Winter.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albert N. Link, 2021. "Technology Transfer at U.S. Federal Laboratories: R&D Disclosures Patent Applications," International Studies in Entrepreneurship, in: Maribel Guerrero & David Urbano (ed.), Technology Transfer and Entrepreneurial Innovations, chapter 0, pages 45-58, Springer.
    2. Petra Karanikic & Heri Bezic, 2021. "Measuring The Knowledge Transfer Performance At Universities," Economic Thought and Practice, Department of Economics and Business, University of Dubrovnik, vol. 30(1), pages 189-203, june.
    3. Juan Antonio Dip, 2021. "What does U-multirank tell us about knowledge transfer and research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3011-3039, April.
    4. David P. Leech & John T. Scott, 2023. "Copyrights for the technology transfer of government software," The Journal of Technology Transfer, Springer, vol. 48(6), pages 2161-2178, December.
    5. K. A. Khor & L. G. Yu, 2020. "Revealing key topics shifts in thermal barrier coatings (TBC) as indicators of technological developments for aerospace engines," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1763-1781, November.
    6. Carazza, Luís & Silveira Neto, Raul da Mota, 2021. "Evaluating the Regional Expansion of Brazil’s Federal System of Vocational and Technological Education," Revista Brasileira de Estudos Regionais e Urbanos, Associação Brasileira de Estudos Regionais e Urbanos (ABER), vol. 15(2), pages 212-246.
    7. Albert N. Link & John T. Scott, 2021. "Scientific publications at U.S. federal research laboratories," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2227-2248, March.
    8. David P. Leech & John T. Scott, 2022. "Foreign patents for the technology transfer from laboratories of U.S. federal agencies," The Journal of Technology Transfer, Springer, vol. 47(4), pages 937-978, August.
    9. Siegel, Donald & Bogers, Marcel L.A.M. & Jennings, P. Devereaux & Xue, Lan, 2023. "Technology transfer from national/federal labs and public research institutes: Managerial and policy implications," Research Policy, Elsevier, vol. 52(1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael J. Hall, 2022. "New technology transfer metrics for the National Institute of Standards and Technology," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1573-1583, October.
    2. Bozeman, Barry & Rimes, Heather & Youtie, Jan, 2015. "The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model," Research Policy, Elsevier, vol. 44(1), pages 34-49.
    3. Joao J. M. Ferreira & Cristina Fernandes & Vanessa Ratten, 2019. "The effects of technology transfers and institutional factors on economic growth: evidence from Europe and Oceania," The Journal of Technology Transfer, Springer, vol. 44(5), pages 1505-1528, October.
    4. Kadigia Faccin & Christle Beer & Bibiana Volkmer Martins & Grabriela Zanandrea & Neta Kela & Corne Schutte, 2022. "What really matters for TTOs efficiency? An analysis of TTOs in developed and developing economies," The Journal of Technology Transfer, Springer, vol. 47(4), pages 1135-1161, August.
    5. Battaglia, Daniele & Landoni, Paolo & Rizzitelli, Francesco, 2017. "Organizational structures for external growth of University Technology Transfer Offices: An explorative analysis," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 45-56.
    6. Laura Kreiling & Ahmed Bounfour, 2020. "A practice-based maturity model for holistic TTO performance management: development and initial use," The Journal of Technology Transfer, Springer, vol. 45(6), pages 1718-1747, December.
    7. James A. Cunningham & Matthias Menter & Chris Young, 2017. "A review of qualitative case methods trends and themes used in technology transfer research," The Journal of Technology Transfer, Springer, vol. 42(4), pages 923-956, August.
    8. Benjamin Yeo, 2019. "What Drives University Technological Innovation Outcomes? A Re-Vitalised Investigation," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 18(03), pages 1-28, September.
    9. Jason Coupet & Yuhao Ba, 2022. "Benchmarking university technology transfer performance with external research funding: a stochastic frontier analysis," The Journal of Technology Transfer, Springer, vol. 47(2), pages 605-620, April.
    10. Meng, Qiaoyu & Li, Yi & Cao, Qinwei, 2024. "The paradox analysis and functional mechanism between R&D efficiency and transformation effect: Evidence from key universities in China," Technovation, Elsevier, vol. 130(C).
    11. María García-Vega & Óscar Vicente-Chirivella, 2020. "The effect of technology transfers from public research institutes and universities on firm innovativeness," Discussion Papers 2020-10, University of Nottingham, GEP.
    12. Giuri, Paola & Munari, Federico & Scandura, Alessandra & Toschi, Laura, 2019. "The strategic orientation of universities in knowledge transfer activities," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 261-278.
    13. Shin, Seungryul Ryan & Lee, Jisoo & Jung, Yura Rosemary & Hwang, Junseok, 2022. "The diffusion of scientific discoveries in government laboratories: The role of patents filed by government scientists," Research Policy, Elsevier, vol. 51(5).
    14. Esteban Lafuente & Jasmina Berbegal-Mirabent, 2019. "Assessing the productivity of technology transfer offices: an analysis of the relevance of aspiration performance and portfolio complexity," The Journal of Technology Transfer, Springer, vol. 44(3), pages 778-801, June.
    15. Link, Albert N. & Siegel, Donald S. & Van Fleet, David D., 2011. "Public science and public innovation: Assessing the relationship between patenting at U.S. National Laboratories and the Bayh-Dole Act," Research Policy, Elsevier, vol. 40(8), pages 1094-1099, October.
    16. Good, Matthew & Knockaert, Mirjam & Soppe, Birthe & Wright, Mike, 2019. "The technology transfer ecosystem in academia. An organizational design perspective," Technovation, Elsevier, vol. 82, pages 35-50.
    17. Christos Kalantaridis & Merle Küttim, 2021. "University ownership and information about the entrepreneurial opportunity in commercialisation: a systematic review and realist synthesis of the literature," The Journal of Technology Transfer, Springer, vol. 46(5), pages 1487-1513, October.
    18. Chuchu Chen & Albert N. Link & Zachary T. Oliver, 2018. "U.S. federal laboratories and their research partners: a quantitative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 501-517, April.
    19. O’Kane, Conor, 2018. "Technology transfer executives' backwards integration: An examination of interactions between university technology transfer executives and principal investigators," Technovation, Elsevier, vol. 76, pages 64-77.
    20. Samira Yusef Araújo Falani Bezerra & Ana Lúcia Vitale Torkomian, 2024. "Technology Transfer Offices: a Systematic Review of the Literature and Future Perspective," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 4455-4488, March.

    More about this item

    Keywords

    Metrics; Technology transfer; Federal; Performance; CRADA;
    All these keywords.

    JEL classification:

    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • H11 - Public Economics - - Structure and Scope of Government - - - Structure and Scope of Government

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jtecht:v:45:y:2020:i:2:d:10.1007_s10961-018-09713-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.