IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/x78ys_v1.html
   My bibliography  Save this paper

The Missing 15 Percent of Patent Citations

Author

Listed:
  • Verluise, Cyril
  • Cristelli, Gabriele
  • Higham, Kyle
  • de Rassenfosse, Gaetan

Abstract

Patent citations are one of the most commonly-used metrics in the innovation literature. Leading uses of patent-to-patent citations are associated with the quantification of inventions' quality and the measurement of knowledge flows. Due to their widespread availability, scholars have exploited citations listed on the front-page of patent documents. Citations appearing in the full-text of patent documents have been neglected. We apply modern machine learning methods to extract these citations from the text of USPTO patent documents. Overall, we are able to recover an additional 15 percent of patent citations that could not be found using only front-page data. We show that "in-text" citations bring a different type of information compared to front-page citations. They exhibit higher text-similarity to the citing patents and alter the ranking of patent importance. The dataset is available at patcit.io (CC-BY-4).

Suggested Citation

  • Verluise, Cyril & Cristelli, Gabriele & Higham, Kyle & de Rassenfosse, Gaetan, 2020. "The Missing 15 Percent of Patent Citations," SocArXiv x78ys_v1, Center for Open Science.
    • Handle: RePEc:osf:socarx:x78ys_v1
    DOI: 10.31219/osf.io/x78ys_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/5fe988c51e6d9702072faba1/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/x78ys_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Adam B. Jaffe & Michael S. Fogarty & Bruce A. Banks, 1998. "Evidence from Patents and Patent Citations on the Impact of NASA and Other Federal Labs on Commercial Innovation," Journal of Industrial Economics, Wiley Blackwell, vol. 46(2), pages 183-205, June.
    2. Christopher L Benson & Christopher L Magee, 2015. "Quantitative Determination of Technological Improvement from Patent Data," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-23, April.
    3. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    4. Petra Moser & Tom Nicholas, 2004. "Was Electricity a General Purpose Technology? Evidence from Historical Patent Citations," American Economic Review, American Economic Association, vol. 94(2), pages 388-394, May.
    5. Bronwyn H. Hall & Adam Jaffe & Manuel Trajtenberg, 2005. "Market Value and Patent Citations," RAND Journal of Economics, The RAND Corporation, vol. 36(1), pages 16-38, Spring.
    6. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    7. Florian Seliger & Gaéran de Rassenfosse & Jan Kozak, 2019. "Geocoding of worldwide patent data," KOF Working papers 19-458, KOF Swiss Economic Institute, ETH Zurich.
    8. Martin Meyer, 2000. "What is Special about Patent Citations? Differences between Scientific and Patent Citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 93-123, August.
    9. Sam Arts & Bruno Cassiman & Juan Carlos Gomez, 2018. "Text matching to measure patent similarity," Strategic Management Journal, Wiley Blackwell, vol. 39(1), pages 62-84, January.
    10. Rajshree Agarwal & Martin Ganco & Rosemarie H. Ziedonis, 2009. "Reputations for toughness in patent enforcement: implications for knowledge spillovers via inventor mobility," Strategic Management Journal, Wiley Blackwell, vol. 30(13), pages 1349-1374, December.
    11. Manuel Trajtenberg & Adam B. Jaffe & Michael S. Fogarty, 2000. "Knowledge Spillovers and Patent Citations: Evidence from a Survey of Inventors," American Economic Review, American Economic Association, vol. 90(2), pages 215-218, May.
    12. Audretsch, David B, 1998. "Agglomeration and the Location of Innovative Activity," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 14(2), pages 18-29, Summer.
    13. Jonathan Eaton & Samuel Kortum, 1996. "Measuring Technology Diffusion and the International Sources of Growth," Eastern Economic Journal, Eastern Economic Association, vol. 22(4), pages 401-410, Fall.
    14. Matt Marx & Aaron Fuegi, 2020. "Reliance on Science by Inventors: Hybrid Extraction of In-text Patent-to-Article Citations," NBER Working Papers 27987, National Bureau of Economic Research, Inc.
    15. Jean O. Lanjouw & Mark Schankerman, 2004. "Patent Quality and Research Productivity: Measuring Innovation with Multiple Indicators," Economic Journal, Royal Economic Society, vol. 114(495), pages 441-465, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cyril Verluise & Gabriele Cristelli & Kyle Higham & Gaetan de Rassenfosse, 2020. "The Missing 15 Percent of Patent Citations," Working Papers 13, Chair of Science, Technology, and Innovation Policy.
    2. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    3. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    4. Emanuele Bacchiocchi & Fabio Montobbio, 2010. "International Knowledge Diffusion and Home‐bias Effect: Do USPTO and EPO Patent Citations Tell the Same Story?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 112(3), pages 441-470, September.
    5. Higham, Kyle & de Rassenfosse, Gaetan & Jaffe, Adam B, 2020. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," SocArXiv 49qxk_v1, Center for Open Science.
    6. RAITERI Emilio, 2015. "A time to nourish? Evaluating the impact of innovative public procurement on technological generality through patent data," Cahiers du GREThA (2007-2019) 2015-05, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    7. Raiteri, Emilio, 2018. "A time to nourish? Evaluating the impact of public procurement on technological generality through patent data," Research Policy, Elsevier, vol. 47(5), pages 936-952.
    8. Carlo Giglio & Roberto Sbragia & Roberto Musmanno & Roberto Palmieri, 2021. "Cross-country learning from patents: an analysis of citations flows in innovation trajectories," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7917-7936, September.
    9. Dechezlepretre, Antoine & Martin, Ralf & Mohnen, Myra, 2014. "Knowledge spillovers from clean and dirty technologies," LSE Research Online Documents on Economics 60501, London School of Economics and Political Science, LSE Library.
    10. Michele Cincera & Ela Ince, 2019. "Types of Innovation and Firm performance," Working Papers TIMES² 2019-032, ULB -- Universite Libre de Bruxelles.
    11. Mariani, Manuel Sebastian & Medo, Matúš & Lafond, François, 2019. "Early identification of important patents: Design and validation of citation network metrics," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 644-654.
    12. Paola Giuri & Myriam Mariani & Stefano Brusoni & Gustavo Crespi & Dominique Francoz & Alfonso Gambardella & Walter Garcia-Fontes & Aldo Geuna & Raul Gonzales & Dietmar Harhoff & Karin Hoisl & Christia, 2005. "Everything you Always Wanted to Know about Inventors (but Never Asked): Evidence from the PatVal-EU Survey," LEM Papers Series 2005/20, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    13. Fernández, Ana María & Ferrándiz, Esther & Medina, Jennifer, 2022. "The diffusion of energy technologies. Evidence from renewable, fossil, and nuclear energy patents," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    14. Satoshi Yasukawa & Shingo Kano, 2014. "Validating the usefulness of examiners’ forward citations from the viewpoint of applicants’ self-selection during the patent application procedure," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 895-909, June.
    15. Giuri, Paola & Mariani, Myriam, 2007. "Inventors and invention processes in Europe: Results from the PatVal-EU survey," Research Policy, Elsevier, vol. 36(8), pages 1105-1106, October.
    16. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    17. Ernest Miguélez & Rosina Moreno, 2016. "“Relatedness, external linkages and innovation”," IREA Working Papers 201603, University of Barcelona, Research Institute of Applied Economics, revised Apr 2016.
    18. Corredoira, Rafael A. & Banerjee, Preeta M., 2015. "Measuring patent's influence on technological evolution: A study of knowledge spanning and subsequent inventive activity," Research Policy, Elsevier, vol. 44(2), pages 508-521.
    19. Ahmad Barirani & Bruno Agard & Catherine Beaudry, 2013. "Discovering and assessing fields of expertise in nanomedicine: a patent co-citation network perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1111-1136, March.
    20. Jurriën Bakker & Dennis Verhoeven & Lin Zhang & Bart Van Looy, 2016. "Patent citation indicators: One size fits all?," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 187-211, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:x78ys_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.