IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v183y2022ics0040162522004619.html
   My bibliography  Save this article

Towards expert–machine collaborations for technology valuation: An interpretable machine learning approach

Author

Listed:
  • Kim, Juram
  • Lee, Gyumin
  • Lee, Seungbin
  • Lee, Changyong

Abstract

Although technology valuation has benefited considerably from recent advances in machine learning technology, the results of prior studies in this field are of limited use in practice because they rely solely on black box models whose internal mechanisms are hidden. We develop an analytical framework for successful expert–machine collaborations for technology valuation using interpretable machine learning that makes a model's behaviors and predictions understandable to humans. First, a technological characteristics–economic value matrix is constructed using patent and technology transaction databases. Second, machine learning models are developed to examine the nonlinear and complex relationships between the technological characteristics and economic value of technologies. Third, the performance of the machine learning models is assessed using quantitative metrics. Finally, the SHapley Additive exPlanation method is applied to the best-performing model to explain which technological characteristics influence the economic value of technologies. By these means, we investigate the importance of the features of technological characteristics (and their interactions) in technology valuation and offer theoretical and practical implications of the analysis results. A case study of the technologies registered in the Office of Technology Licensing at Stanford University confirms that our framework is a useful complementary tool for technology valuation.

Suggested Citation

  • Kim, Juram & Lee, Gyumin & Lee, Seungbin & Lee, Changyong, 2022. "Towards expert–machine collaborations for technology valuation: An interpretable machine learning approach," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
  • Handle: RePEc:eee:tefoso:v:183:y:2022:i:c:s0040162522004619
    DOI: 10.1016/j.techfore.2022.121940
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162522004619
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.techfore.2022.121940?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lanjouw, Jean O & Schankerman, Mark, 2001. "Characteristics of Patent Litigation: A Window on Competition," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 129-151, Spring.
    2. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    3. Joshua Lerner, 1994. "The Importance of Patent Scope: An Empirical Analysis," RAND Journal of Economics, The RAND Corporation, vol. 25(2), pages 319-333, Summer.
    4. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    5. Leonid Kogan & Dimitris Papanikolaou & Amit Seru & Noah Stoffman, 2017. "Technological Innovation, Resource Allocation, and Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 665-712.
    6. Jarrahi, Mohammad Hossein, 2018. "Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making," Business Horizons, Elsevier, vol. 61(4), pages 577-586.
    7. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    8. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    9. Bessen, James, 2008. "The value of U.S. patents by owner and patent characteristics," Research Policy, Elsevier, vol. 37(5), pages 932-945, June.
    10. Jang, Hyun Jin & Woo, Han-Gyun & Lee, Changyong, 2017. "Hawkes process-based technology impact analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 511-529.
    11. Guellec, Dominique & Pottelsberghe de la Potterie, Bruno v., 2000. "Applications, grants and the value of patent," Economics Letters, Elsevier, vol. 69(1), pages 109-114, October.
    12. Meyer, Martin, 2006. "Are patenting scientists the better scholars?: An exploratory comparison of inventor-authors with their non-inventing peers in nano-science and technology," Research Policy, Elsevier, vol. 35(10), pages 1646-1662, December.
    13. Thursby, Jerry G & Jensen, Richard & Thursby, Marie C, 2001. "Objectives, Characteristics and Outcomes of University Licensing: A Survey of Major U.S. Universities," The Journal of Technology Transfer, Springer, vol. 26(1-2), pages 59-72, January.
    14. Ernst, Holger, 2003. "Patent information for strategic technology management," World Patent Information, Elsevier, vol. 25(3), pages 233-242, September.
    15. Corredoira, Rafael A. & Goldfarb, Brent D. & Shi, Yuan, 2018. "Federal funding and the rate and direction of inventive activity," Research Policy, Elsevier, vol. 47(9), pages 1777-1800.
    16. Hirschey, Mark & Richardson, Vernon J., 2004. "Are scientific indicators of patent quality useful to investors?," Journal of Empirical Finance, Elsevier, vol. 11(1), pages 91-107, January.
    17. Hong, Suckwon & Kim, Juram & Woo, Han-Gyun & Kim, Young-Choon & Lee, Changyong, 2022. "Screening ideas in the early stages of technology development: A word2vec and convolutional neural network approach," Technovation, Elsevier, vol. 112(C).
    18. Harhoff, Dietmar & Scherer, Frederic M. & Vopel, Katrin, 2003. "Citations, family size, opposition and the value of patent rights," Research Policy, Elsevier, vol. 32(8), pages 1343-1363, September.
    19. Kim, Young-Choon & Rhee, Mooweon & Kotha, Reddi, 2019. "Many hands: The effect of the prior inventor-intermediaries relationship on academic licensing," Research Policy, Elsevier, vol. 48(3), pages 813-829.
    20. Julie Callaert & Bart Van Looy & Arnold Verbeek & Koenraad Debackere & Bart Thijs, 2006. "Traces of Prior Art: An analysis of non-patent references found in patent documents," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 3-20, October.
    21. Nicolas van Zeebroeck, 2007. "Patents only live twice: a patent survival analysis in Europe," Working Papers CEB 07-028.RS, ULB -- Universite Libre de Bruxelles.
    22. Brian D. Wright & Kyriakos Drivas & Zhen Lei & Stephen A. Merrill, 2014. "Technology transfer: Industry-funded academic inventions boost innovation," Nature, Nature, vol. 507(7492), pages 297-299, March.
    23. Lee, Changyong & Cho, Yangrae & Seol, Hyeonju & Park, Yongtae, 2012. "A stochastic patent citation analysis approach to assessing future technological impacts," Technological Forecasting and Social Change, Elsevier, vol. 79(1), pages 16-29.
    24. Chung, Park & Sohn, So Young, 2020. "Early detection of valuable patents using a deep learning model: Case of semiconductor industry," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    25. Reitzig, Markus, 2004. "Improving patent valuations for management purposes--validating new indicators by analyzing application rationales," Research Policy, Elsevier, vol. 33(6-7), pages 939-957, September.
    26. Lee, Changyong & Kim, Juram & Kwon, Ohjin & Woo, Han-Gyun, 2016. "Stochastic technology life cycle analysis using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 106(C), pages 53-64.
    27. Fischer, Timo & Leidinger, Jan, 2014. "Testing patent value indicators on directly observed patent value—An empirical analysis of Ocean Tomo patent auctions," Research Policy, Elsevier, vol. 43(3), pages 519-529.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Zichao & Li, Dexuan & Dai, Wensheng, 2023. "Machine-learning-enabled intelligence computing for crisis management in small and medium-sized enterprises (SMEs)," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    2. Sun, Weixin & Zhang, Xuantao & Li, Minghao & Wang, Yong, 2023. "Interpretable high-stakes decision support system for credit default forecasting," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    3. Lee, Gyumin & Lee, Sungjun & Lee, Changyong, 2023. "Inventor–licensee matchmaking for university technology licensing: A fastText approach," Technovation, Elsevier, vol. 125(C).
    4. Li Yao & He Ni, 2023. "Prediction of patent grant and interpreting the key determinants: an application of interpretable machine learning approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 4933-4969, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Juram & Hong, Suckwon & Kang, Yubin & Lee, Changyong, 2023. "Domain-specific valuation of university technologies using bibliometrics, Jonckheere–Terpstra tests, and data envelopment analysis," Technovation, Elsevier, vol. 122(C).
    2. Yuan Zhou & Fang Dong & Yufei Liu & Liang Ran, 2021. "A deep learning framework to early identify emerging technologies in large-scale outlier patents: an empirical study of CNC machine tool," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 969-994, February.
    3. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    4. Youngjae Choi & Sanghyun Park & Sungjoo Lee, 2021. "Identifying emerging technologies to envision a future innovation ecosystem: A machine learning approach to patent data," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5431-5476, July.
    5. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    6. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    7. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    8. Antonio Messeni Petruzzelli & Daniele Rotolo & Vito Albino, 2014. "Determinants of Patent Citations in Biotechnology: An Analysis of Patent Influence Across the Industrial and Organizational Boundaries," SPRU Working Paper Series 2014-05, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Hsin-Ning Su & Carey Ming-Li Chen & Pei-Chun Lee, 2012. "Patent litigation precaution method: analyzing characteristics of US litigated and non-litigated patents from 1976 to 2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 181-195, July.
    10. Hu, Zewen & Zhou, Xiji & Lin, Angela, 2023. "Evaluation and identification of potential high-value patents in the field of integrated circuits using a multidimensional patent indicators pre-screening strategy and machine learning approaches," Journal of Informetrics, Elsevier, vol. 17(2).
    11. Nicolas van Zeebroeck, 2007. "Patents only live twice: a patent survival analysis in Europe," Working Papers CEB 07-028.RS, ULB -- Universite Libre de Bruxelles.
    12. Krzysztof Klincewicz & Szymon Szumiał, 2022. "Successful patenting—not only how, but with whom: the importance of patent attorneys," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5111-5137, September.
    13. Nicolas van Zeebroeck & Bruno van Pottelsberghe de la Potterie, 2011. "Filing strategies and patent value," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 20(6), pages 539-561, February.
    14. Nicolas van Zeebroeck, 2011. "The puzzle of patent value indicators," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 20(1), pages 33-62.
    15. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    16. Jang, Hyun Jin & Woo, Han-Gyun & Lee, Changyong, 2017. "Hawkes process-based technology impact analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 511-529.
    17. Pontus Braunerhjelm & Roger Svensson, 2024. "Inventions, commercialization strategies, and knowledge spillovers in SMEs," Small Business Economics, Springer, vol. 63(1), pages 275-297, June.
    18. Leila Tahmooresnejad & Catherine Beaudry, 2019. "Capturing the economic value of triadic patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 127-157, January.
    19. Marusaki, Koji & Nakai, Kensei & Kataoka, Shotaro & Kawano, Seiya & Hentona, Asahi & Sakumoto, Takeshi & Yamamoto, Yuta & Mori, Kaede & Nonaka, Hirofumi, 2024. "A study on patent term prediction by survival time analysis using neural hazard model," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    20. Noh, Heeyong & Lee, Sungjoo, 2020. "What constitutes a promising technology in the era of open innovation? An investigation of patent potential from multiple perspectives," Technological Forecasting and Social Change, Elsevier, vol. 157(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:183:y:2022:i:c:s0040162522004619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.