IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v126y2021i7d10.1007_s11192-021-04001-1.html
   My bibliography  Save this article

Identifying emerging technologies to envision a future innovation ecosystem: A machine learning approach to patent data

Author

Listed:
  • Youngjae Choi

    (Ajou University)

  • Sanghyun Park

    (Ajou University)

  • Sungjoo Lee

    (Ajou University
    Ajou University)

Abstract

With the rapid changes to technology as well as industry value chains, it has become essential for firms to identify emerging promising technologies that can better respond to external disruptive forces and be used to launch new businesses or improve current businesses. One of the most commonly used approaches in identifying emerging promising technologies is patent analysis. Patents have long been regarded as a useful source of data on technologies; accordingly, a number of previous studies have applied patents to define rising technologies. However, most previous studies have significantly relied on patent information in assessing promising technologies, whereas promisingness is determined by various other factors that are not explained by patent information. To overcome the limitation of previous approaches, this study proposes a hybrid approach considering both expert opinions and patent information to identify emerging promising technologies. For analysis, we firstly developed a set of criteria with which to evaluate potentially valuable patents, had experts evaluate only a portion of the patents from a larger patent portfolio of interest based on the criteria, and finally used the evaluation results to identify other potentially valuable patents from the rest of patents in the portfolio. Here, an active semi-supervised learning technique was applied, in which a small amount of labeled data (patents evaluated by experts) was used with a large amount of unlabeled data (the other patents from the portfolio). An analysis model consists of two layers—patents and patent attributes—with patent attributes such as technology characteristics used to classify patents into promising and unpromising ones. The proposed approach was applied to the automobile industry sector, and its usability was verified; the analysis results indicated that semi-supervised learning combined with active learning has potential in effectively searching for emerging promising technologies or filtering non-promising technologies with less human input. With only a small set of labeled patents, a large set of patents could be labeled, which saves time and effort when experts evaluate patents. Methodologically, this is an early attempt to introduce active semi-supervised learning in the context of patent analysis. Practically, the research findings enable expert opinions to be used effectively in identifying promising technologies and envisioning a future innovation ecosystem, making a balance between data- and expert-driven decision-making.

Suggested Citation

  • Youngjae Choi & Sanghyun Park & Sungjoo Lee, 2021. "Identifying emerging technologies to envision a future innovation ecosystem: A machine learning approach to patent data," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5431-5476, July.
    • Handle: RePEc:spr:scient:v:126:y:2021:i:7:d:10.1007_s11192-021-04001-1
    DOI: 10.1007/s11192-021-04001-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04001-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-021-04001-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kyebambe, Moses Ntanda & Cheng, Ge & Huang, Yunqing & He, Chunhui & Zhang, Zhenyu, 2017. "Forecasting emerging technologies: A supervised learning approach through patent analysis," Technological Forecasting and Social Change, Elsevier, vol. 125(C), pages 236-244.
    2. Arora, Ashish & Fosfuri, Andrea, 2003. "Licensing the market for technology," Journal of Economic Behavior & Organization, Elsevier, vol. 52(2), pages 277-295, October.
    3. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    4. Kim, Hyunwoo & Hong, Suckwon & Kwon, Ohjin & Lee, Changyong, 2017. "Concentric diversification based on technological capabilities: Link analysis of products and technologies," Technological Forecasting and Social Change, Elsevier, vol. 118(C), pages 246-257.
    5. Bronwyn H. Hall & Adam Jaffe & Manuel Trajtenberg, 2005. "Market Value and Patent Citations," RAND Journal of Economics, The RAND Corporation, vol. 36(1), pages 16-38, Spring.
    6. Verhoeven, Dennis & Bakker, Jurriën & Veugelers, Reinhilde, 2016. "Measuring technological novelty with patent-based indicators," Research Policy, Elsevier, vol. 45(3), pages 707-723.
    7. Kim, Jeeeun & Lee, Sungjoo, 2015. "Patent databases for innovation studies: A comparative analysis of USPTO, EPO, JPO and KIPO," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 332-345.
    8. Momeni, Abdolreza & Rost, Katja, 2016. "Identification and monitoring of possible disruptive technologies by patent-development paths and topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 104(C), pages 16-29.
    9. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    10. Paola Giuri & Federico Munari & Martina Pasquini, 2013. "What Determines University Patent Commercialization? Empirical Evidence on the Role of IPR Ownership," Industry and Innovation, Taylor & Francis Journals, vol. 20(5), pages 488-502, July.
    11. Reitzig, Markus, 2004. "Improving patent valuations for management purposes--validating new indicators by analyzing application rationales," Research Policy, Elsevier, vol. 33(6-7), pages 939-957, September.
    12. Guellec, Dominique & Pottelsberghe de la Potterie, Bruno v., 2000. "Applications, grants and the value of patent," Economics Letters, Elsevier, vol. 69(1), pages 109-114, October.
    13. Lee, Changyong & Kim, Juram & Kwon, Ohjin & Woo, Han-Gyun, 2016. "Stochastic technology life cycle analysis using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 106(C), pages 53-64.
    14. Caviggioli, Federico, 2016. "Technology fusion: Identification and analysis of the drivers of technology convergence using patent data," Technovation, Elsevier, vol. 55, pages 22-32.
    15. Kang, Byeongwoo & Bekkers, Rudi, 2015. "Just-in-time patents and the development of standards," Research Policy, Elsevier, vol. 44(10), pages 1948-1961.
    16. Joshua Lerner, 1994. "The Importance of Patent Scope: An Empirical Analysis," RAND Journal of Economics, The RAND Corporation, vol. 25(2), pages 319-333, Summer.
    17. Park, Inchae & Yoon, Byungun, 2018. "Technological opportunity discovery for technological convergence based on the prediction of technology knowledge flow in a citation network," Journal of Informetrics, Elsevier, vol. 12(4), pages 1199-1222.
    18. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    19. Yoon, Byungun & Magee, Christopher L., 2018. "Exploring technology opportunities by visualizing patent information based on generative topographic mapping and link prediction," Technological Forecasting and Social Change, Elsevier, vol. 132(C), pages 105-117.
    20. Geum, Youngjung & Kim, Moon-Soo & Lee, Sungjoo, 2016. "How industrial convergence happens: A taxonomical approach based on empirical evidences," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 112-120.
    21. Bekkers, Rudi & Bongard, René & Nuvolari, Alessandro, 2011. "An empirical study on the determinants of essential patent claims in compatibility standards," Research Policy, Elsevier, vol. 40(7), pages 1001-1015, September.
    22. Tong, Xuesong & Frame, J. Davidson, 1994. "Measuring national technological performance with patent claims data," Research Policy, Elsevier, vol. 23(2), pages 133-141, March.
    23. Ernst, Holger, 2003. "Patent information for strategic technology management," World Patent Information, Elsevier, vol. 25(3), pages 233-242, September.
    24. Harhoff, Dietmar & Scherer, Frederic M. & Vopel, Katrin, 2003. "Citations, family size, opposition and the value of patent rights," Research Policy, Elsevier, vol. 32(8), pages 1343-1363, September.
    25. Lee, Changyong & Cho, Yangrae & Seol, Hyeonju & Park, Yongtae, 2012. "A stochastic patent citation analysis approach to assessing future technological impacts," Technological Forecasting and Social Change, Elsevier, vol. 79(1), pages 16-29.
    26. Hsieh, Chih-Hung, 2013. "Patent value assessment and commercialization strategy," Technological Forecasting and Social Change, Elsevier, vol. 80(2), pages 307-319.
    27. Song, Kisik & Kim, Kyuwoong & Lee, Sungjoo, 2018. "Identifying promising technologies using patents: A retrospective feature analysis and a prospective needs analysis on outlier patents," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 118-132.
    28. Kim, Gabjo & Bae, Jinwoo, 2017. "A novel approach to forecast promising technology through patent analysis," Technological Forecasting and Social Change, Elsevier, vol. 117(C), pages 228-237.
    29. Breitzman, Anthony & Thomas, Patrick, 2015. "The Emerging Clusters Model: A tool for identifying emerging technologies across multiple patent systems," Research Policy, Elsevier, vol. 44(1), pages 195-205.
    30. Hirschey, Mark & Richardson, Vernon J., 2001. "Valuation effects of patent quality: A comparison for Japanese and U.S. firms," Pacific-Basin Finance Journal, Elsevier, vol. 9(1), pages 65-82, January.
    31. Mariagrazia Squicciarini & Hélène Dernis & Chiara Criscuolo, 2013. "Measuring Patent Quality: Indicators of Technological and Economic Value," OECD Science, Technology and Industry Working Papers 2013/3, OECD Publishing.
    32. Fischer, Timo & Leidinger, Jan, 2014. "Testing patent value indicators on directly observed patent value—An empirical analysis of Ocean Tomo patent auctions," Research Policy, Elsevier, vol. 43(3), pages 519-529.
    33. Suzanne Scotchmer, 1991. "Standing on the Shoulders of Giants: Cumulative Research and the Patent Law," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 29-41, Winter.
    34. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lijie Feng & Kehui Liu & Jinfeng Wang & Kuo-Yi Lin & Ke Zhang & Luyao Zhang, 2022. "Identifying Promising Technologies of Electric Vehicles from the Perspective of Market and Technical Attributes," Energies, MDPI, vol. 15(20), pages 1-22, October.
    2. Jianjia He & Yue Wang, 2023. "Patent-Based Analysis of China’s Emergency Logistics Industry Convergence," Sustainability, MDPI, vol. 15(5), pages 1-13, March.
    3. Guo Chen & Jing Chen & Yu Shao & Lu Xiao, 2023. "Automatic noise reduction of domain-specific bibliographic datasets using positive-unlabeled learning," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1187-1204, February.
    4. Li Yao & He Ni, 2023. "Prediction of patent grant and interpreting the key determinants: an application of interpretable machine learning approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 4933-4969, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noh, Heeyong & Lee, Sungjoo, 2020. "What constitutes a promising technology in the era of open innovation? An investigation of patent potential from multiple perspectives," Technological Forecasting and Social Change, Elsevier, vol. 157(C).
    2. Yuan Zhou & Fang Dong & Yufei Liu & Liang Ran, 2021. "A deep learning framework to early identify emerging technologies in large-scale outlier patents: an empirical study of CNC machine tool," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 969-994, February.
    3. Kim, Juram & Lee, Gyumin & Lee, Seungbin & Lee, Changyong, 2022. "Towards expert–machine collaborations for technology valuation: An interpretable machine learning approach," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    4. Changyong Lee & Gyumin Lee, 2019. "Technology opportunity analysis based on recombinant search: patent landscape analysis for idea generation," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 603-632, November.
    5. Serkan Altuntas & Zulfiye Erdogan & Turkay Dereli, 2020. "A clustering-based approach for the evaluation of candidate emerging technologies," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1157-1177, August.
    6. Song, Kisik & Kim, Kyuwoong & Lee, Sungjoo, 2018. "Identifying promising technologies using patents: A retrospective feature analysis and a prospective needs analysis on outlier patents," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 118-132.
    7. Antonio Messeni Petruzzelli & Daniele Rotolo & Vito Albino, 2014. "Determinants of Patent Citations in Biotechnology: An Analysis of Patent Influence Across the Industrial and Organizational Boundaries," SPRU Working Paper Series 2014-05, SPRU - Science Policy Research Unit, University of Sussex Business School.
    8. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    9. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    10. Uijun Kwon & Youngjung Geum, 2020. "Identification of promising inventions considering the quality of knowledge accumulation: a machine learning approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1877-1897, December.
    11. Grimaldi, Michele & Cricelli, Livio & Di Giovanni, Martina & Rogo, Francesco, 2015. "The patent portfolio value analysis: A new framework to leverage patent information for strategic technology planning," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 286-302.
    12. Hsin-Ning Su & Carey Ming-Li Chen & Pei-Chun Lee, 2012. "Patent litigation precaution method: analyzing characteristics of US litigated and non-litigated patents from 1976 to 2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 181-195, July.
    13. Jee, Su Jung & Kwon, Minji & Ha, Jung Moon & Sohn, So Young, 2019. "Exploring the forward citation patterns of patents based on the evolution of technology fields," Journal of Informetrics, Elsevier, vol. 13(4).
    14. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    15. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    16. Ugo Rizzo & Nicolò Barbieri & Laura Ramaciotti & Demian Iannantuono, 2020. "The division of labour between academia and industry for the generation of radical inventions," The Journal of Technology Transfer, Springer, vol. 45(2), pages 393-413, April.
    17. Jang, Hyun Jin & Woo, Han-Gyun & Lee, Changyong, 2017. "Hawkes process-based technology impact analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 511-529.
    18. Barbieri, Nicolò & Marzucchi, Alberto & Rizzo, Ugo, 2020. "Knowledge sources and impacts on subsequent inventions: Do green technologies differ from non-green ones?," Research Policy, Elsevier, vol. 49(2).
    19. Sajad Ashouri & Anne-Laure Mention & Kosmas X. Smyrnios, 2021. "Anticipation and analysis of industry convergence using patent-level indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5727-5758, July.
    20. Zhao, Shengchao & Zeng, Deming & Li, Jian & Feng, Ke & Wang, Yao, 2023. "Quantity or quality: The roles of technology and science convergence on firm innovation performance," Technovation, Elsevier, vol. 126(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:126:y:2021:i:7:d:10.1007_s11192-021-04001-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.