IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v17y2023i2s1751157723000317.html
   My bibliography  Save this article

Evaluation and identification of potential high-value patents in the field of integrated circuits using a multidimensional patent indicators pre-screening strategy and machine learning approaches

Author

Listed:
  • Hu, Zewen
  • Zhou, Xiji
  • Lin, Angela

Abstract

Early identification of high-value patents has strategic and technological importance to firms, institutions, and governments. This study demonstrates the usefulness of the machine learning (ML) method for automatically evaluating and identifying potential high-value patents. The study collected 31,463 patents in the integrated circuits sector using the DII platform and used them to conduct experiments using five standard ML models. A multidimensional value indicator portfolio was established to measure patents’ legal, technological, competitiveness, and scientific values and construct feature vector space. The portfolio also formed a part of the pre-screening strategy providing a valid positive sample for identifying potential high-value patents. The results suggest that the multidimensional patent indicator portfolio effectively measured patent values. amongst all indicators, patent family size (legal value), first citation speed (technological value), forward citations and extended patent family size (competitiveness value), length of the patent document, non-patent reference count, and patent citation count (scientific value) play a significant informing role in identifying potential high-value patents. The proposed first-citation speed indicator proved valuable for measuring patents’ technological value. The Random Forest model had the best overall performance in classifying and recognizing potential high-value patents(PHVPs) with accuracy and precision rates above 95%.

Suggested Citation

  • Hu, Zewen & Zhou, Xiji & Lin, Angela, 2023. "Evaluation and identification of potential high-value patents in the field of integrated circuits using a multidimensional patent indicators pre-screening strategy and machine learning approaches," Journal of Informetrics, Elsevier, vol. 17(2).
    • Handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000317
    DOI: 10.1016/j.joi.2023.101406
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157723000317
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2023.101406?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lanjouw, Jean O & Schankerman, Mark, 2001. "Characteristics of Patent Litigation: A Window on Competition," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 129-151, Spring.
    2. Dar-Zen Chen & Wen-Yau Cathy Lin & Mu-Hsuan Huang, 2007. "Using Essential Patent Index and Essential Technological Strength to evaluate industrial technological innovation competitiveness," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 101-116, April.
    3. Christopher L Benson & Christopher L Magee, 2015. "Quantitative Determination of Technological Improvement from Patent Data," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-23, April.
    4. Uijun Kwon & Youngjung Geum, 2020. "Identification of promising inventions considering the quality of knowledge accumulation: a machine learning approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1877-1897, December.
    5. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    6. Sadao Nagaoka, 2007. "Assessing the R&D Management of a Firm in Terms of Speed and Science Linkage: Evidence from the US Patents," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 16(1), pages 129-156, March.
    7. Frietsch, Rainer & Schmoch, Ulrich & Van Looy, Baart & Walsh, J. P. & Devroede, R. & Du Plessis, M. & Jung, T. & Meng, Y. & Neuhäusler, Peter & Peeters, B. & Schubert, T., 2010. "The value and indicator function of patents," Studien zum deutschen Innovationssystem 15-2010, Expertenkommission Forschung und Innovation (EFI) - Commission of Experts for Research and Innovation, Berlin.
    8. Zhang, Sifei & Yuan, Chien-Chung & Chang, Ke-Chiun & Ken, Yun, 2012. "Exploring the nonlinear effects of patent H index, patent citations, and essential technological strength on corporate performance by using artificial neural network," Journal of Informetrics, Elsevier, vol. 6(4), pages 485-495.
    9. Albert, M. B. & Avery, D. & Narin, F. & McAllister, P., 1991. "Direct validation of citation counts as indicators of industrially important patents," Research Policy, Elsevier, vol. 20(3), pages 251-259, June.
    10. Grimaldi, Michele & Cricelli, Livio & Di Giovanni, Martina & Rogo, Francesco, 2015. "The patent portfolio value analysis: A new framework to leverage patent information for strategic technology planning," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 286-302.
    11. Youngho Kim & Sangsung Park & Junseok Lee & Dongsik Jang & Jiho Kang, 2021. "Integrated Survival Model for Predicting Patent Litigation Hazard," Sustainability, MDPI, vol. 13(4), pages 1-15, February.
    12. Xu, Haiyun & Winnink, Jos & Yue, Zenghui & Zhang, Huiling & Pang, Hongshen, 2021. "Multidimensional Scientometric indicators for the detection of emerging research topics," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    13. Park, Youngjin & Yoon, Janghyeok, 2017. "Application technology opportunity discovery from technology portfolios: Use of patent classification and collaborative filtering," Technological Forecasting and Social Change, Elsevier, vol. 118(C), pages 170-183.
    14. Rainer Frietsch & Ulrich Schmoch, 2010. "Transnational patents and international markets," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(1), pages 185-200, January.
    15. Nicolas van Zeebroeck & Bruno van Pottelsberghe de la Potterie, 2011. "Filing strategies and patent value," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 20(6), pages 539-561, February.
    16. Bessen, James, 2008. "The value of U.S. patents by owner and patent characteristics," Research Policy, Elsevier, vol. 37(5), pages 932-945, June.
    17. Aditi Mehta & Marc Rysman & Tim Simcoe, 2010. "Identifying the age profile of patent citations: new estimates of knowledge diffusion," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(7), pages 1179-1204, November/.
    18. Lai, Kuei-Kuei & Bhatt, Priyanka C. & Kumar, Vimal & Chen, Hsueh-Chen & Chang, Yu-Hsin & Su, Fang-Pei, 2021. "Identifying the impact of patent family on the patent trajectory: A case of thin film solar cells technological trajectories," Journal of Informetrics, Elsevier, vol. 15(2).
    19. Ruan, Xuanmin & Zhu, Yuanyang & Li, Jiang & Cheng, Ying, 2020. "Predicting the citation counts of individual papers via a BP neural network," Journal of Informetrics, Elsevier, vol. 14(3).
    20. Caviggioli, Federico & De Marco, Antonio & Montobbio, Fabio & Ughetto, Elisa, 2020. "The licensing and selling of inventions by US universities," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    21. Fisch, Christian & Sandner, Philipp & Regner, Lukas, 2017. "The value of Chinese patents: An empirical investigation of citation lags," China Economic Review, Elsevier, vol. 45(C), pages 22-34.
    22. Harhoff, Dietmar & Scherer, Frederic M. & Vopel, Katrin, 2003. "Citations, family size, opposition and the value of patent rights," Research Policy, Elsevier, vol. 32(8), pages 1343-1363, September.
    23. C. Gay & C. Le Bas & P. Patel & K. Touach, 2005. "The determinants of patent citations: an empirical analysis of French and British patents in the US," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(5), pages 339-350.
    24. Huang, Ying & Chen, Lixin & Zhang, Lin, 2020. "Patent citation inflation: The phenomenon, its measurement, and relative indicators to temper its effects," Journal of Informetrics, Elsevier, vol. 14(2).
    25. Julie Callaert & Bart Van Looy & Arnold Verbeek & Koenraad Debackere & Bart Thijs, 2006. "Traces of Prior Art: An analysis of non-patent references found in patent documents," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 3-20, October.
    26. Michele Grimaldi & Livio Cricelli, 2020. "Indexes of patent value: a systematic literature review and classification," Knowledge Management Research & Practice, Taylor & Francis Journals, vol. 18(2), pages 214-233, April.
    27. Moehrle, Martin G. & Frischkorn, Jonas, 2021. "Bridge strongly or focus – An analysis of bridging patents in four application fields of carbon fiber reinforcements," Journal of Informetrics, Elsevier, vol. 15(2).
    28. Hsieh, Chih-Hung, 2013. "Patent value assessment and commercialization strategy," Technological Forecasting and Social Change, Elsevier, vol. 80(2), pages 307-319.
    29. Ruan, Xuanmin & Lyu, Dongqing & Gong, Kaile & Cheng, Ying & Li, Jiang, 2021. "Rethinking the disruption index as a measure of scientific and technological advances," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    30. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    31. Reitzig, Markus, 2004. "Improving patent valuations for management purposes--validating new indicators by analyzing application rationales," Research Policy, Elsevier, vol. 33(6-7), pages 939-957, September.
    32. Ming-Fu Wu & Keng-Wei Chang & Wei Zhou & Juan Hao & Chien-Chung Yuan & Ke-Chiun Chang, 2015. "Patent Deployment Strategies and Patent Value in LED Industry," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-10, June.
    33. Francois P. Kabore & Walter G. Park, 2019. "Can patent family size and composition signal patent value?," Applied Economics, Taylor & Francis Journals, vol. 51(60), pages 6476-6496, December.
    34. Fischer, Timo & Leidinger, Jan, 2014. "Testing patent value indicators on directly observed patent value—An empirical analysis of Ocean Tomo patent auctions," Research Policy, Elsevier, vol. 43(3), pages 519-529.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohd Shadab Danish & Pritam Ranjan & Ruchi Sharma, 2021. "Identification of “Valuable” Technologies via Patent Statistics in India: An Analysis Based on Renewal Information," BASE University Working Papers 13/2021, BASE University, Bengaluru, India.
    2. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    3. Mohd Shadab Danish & Pritam Ranjan & Ruchi Sharma, 2022. "Assessing the Impact of Patent Attributes on the Value of Discrete and Complex Innovations," Papers 2208.07222, arXiv.org.
    4. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    5. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    6. Kim, Juram & Lee, Gyumin & Lee, Seungbin & Lee, Changyong, 2022. "Towards expert–machine collaborations for technology valuation: An interpretable machine learning approach," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    7. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    8. Song, Haoyang & Hou, Jianhua & Zhang, Yang, 2023. "The measurements and determinants of patent technological value: Lifetime, strength, breadth, and dispersion from the technology diffusion perspective," Journal of Informetrics, Elsevier, vol. 17(1).
    9. Fernández, Ana María & Ferrándiz, Esther & Medina, Jennifer, 2022. "The diffusion of energy technologies. Evidence from renewable, fossil, and nuclear energy patents," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    10. Chandra, Praveena & Dong, Andy, 2018. "The relation between knowledge accumulation and technical value in interdisciplinary technologies," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 235-244.
    11. Kim, Juram & Hong, Suckwon & Kang, Yubin & Lee, Changyong, 2023. "Domain-specific valuation of university technologies using bibliometrics, Jonckheere–Terpstra tests, and data envelopment analysis," Technovation, Elsevier, vol. 122(C).
    12. Antonio Messeni Petruzzelli & Daniele Rotolo & Vito Albino, 2014. "Determinants of Patent Citations in Biotechnology: An Analysis of Patent Influence Across the Industrial and Organizational Boundaries," SPRU Working Paper Series 2014-05, SPRU - Science Policy Research Unit, University of Sussex Business School.
    13. Yao, Li & Li, Jun & Chen, Kaihua & Yu, Rongjian, 2024. "Winning the second race of technology standardization: Strategic maneuvers in SEP follow-on innovations," Research Policy, Elsevier, vol. 53(6).
    14. Leila Tahmooresnejad & Catherine Beaudry, 2019. "Capturing the economic value of triadic patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 127-157, January.
    15. Antoine Dechezleprêtre & Yann Ménière & Myra Mohnen, 2017. "International patent families: from application strategies to statistical indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 793-828, May.
    16. Huang, Kenneth Guang-Lih & Huang, Can & Shen, Huijun & Mao, Hao, 2021. "Assessing the value of China's patented inventions," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    17. Marusaki, Koji & Nakai, Kensei & Kataoka, Shotaro & Kawano, Seiya & Hentona, Asahi & Sakumoto, Takeshi & Yamamoto, Yuta & Mori, Kaede & Nonaka, Hirofumi, 2024. "A study on patent term prediction by survival time analysis using neural hazard model," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    18. Way-Ren Huang & Chia-Jen Hsieh & Ke-Chiun Chang & Yen-Jo Kiang & Chien-Chung Yuan & Woei-Chyn Chu, 2017. "Network characteristics and patent value—Evidence from the Light-Emitting Diode industry," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-14, August.
    19. Noh, Heeyong & Lee, Sungjoo, 2020. "What constitutes a promising technology in the era of open innovation? An investigation of patent potential from multiple perspectives," Technological Forecasting and Social Change, Elsevier, vol. 157(C).
    20. Bo Kyeong Lee & So Young Sohn, 2017. "Exploring the effect of dual use on the value of military technology patents based on the renewal decision," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1203-1227, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.