IDEAS home Printed from https://ideas.repec.org/a/eee/techno/v129y2024ics0166497223001943.html
   My bibliography  Save this article

Natural language processing for innovation search – Reviewing an emerging non-human innovation intermediary

Author

Listed:
  • Just, Julian

Abstract

Applying artificial intelligence (AI), especially natural language processing (NLP), to harness large amounts of information from patent databases, online communities, social media, or crowdsourcing platforms is becoming increasingly popular to help organizations find promising solutions. In the era of non-human innovation intermediaries, we should begin to view NLP not only as a useful technology applied in different innovation practices but also as an intermediary orchestrating valuable information. Previous research has not taken this perspective, and knowledge about its intermediation activities and functions is limited. This study reviews 167 academic articles to better understand how NLP approaches can enrich intermediation in early-stage innovation search. It identifies 18 distinctive innovation practices taking over activities like forecasting trends, illustrating technology and idea landscapes, filtering out distinctive contributions, recombining domain-specific and analogous knowledge, or matching problems with solutions. While certain NLP capabilities complement each other, the analysis shows that the choice of the most appropriate approach depends on the characteristics of the innovation practice. Innovation researchers and practitioners should rethink current roles and responsibilities in AI-based innovation processes. As seen in the recent emergence of large language models (LLMs), the rapidly evolving field offers many future research opportunities and practical benefits.

Suggested Citation

  • Just, Julian, 2024. "Natural language processing for innovation search – Reviewing an emerging non-human innovation intermediary," Technovation, Elsevier, vol. 129(C).
    • Handle: RePEc:eee:techno:v:129:y:2024:i:c:s0166497223001943
    DOI: 10.1016/j.technovation.2023.102883
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0166497223001943
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.technovation.2023.102883?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yoon, Janghyeok & Park, Hyunseok & Seo, Wonchul & Lee, Jae-Min & Coh, Byoung-youl & Kim, Jonghwa, 2015. "Technology opportunity discovery (TOD) from existing technologies and products: A function-based TOD framework," Technological Forecasting and Social Change, Elsevier, vol. 100(C), pages 153-167.
    2. Artem Timoshenko & John R. Hauser, 2019. "Identifying Customer Needs from User-Generated Content," Marketing Science, INFORMS, vol. 38(1), pages 1-20, January.
    3. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    4. Howells, Jeremy, 2006. "Intermediation and the role of intermediaries in innovation," Research Policy, Elsevier, vol. 35(5), pages 715-728, June.
    5. Dahlander, Linus & Gann, David M. & Wallin, Martin W., 2021. "How open is innovation? A retrospective and ideas forward," Research Policy, Elsevier, vol. 50(4).
    6. Takey, Silvia Mayumi & Carvalho, Marly M., 2016. "Fuzzy front end of systemic innovations: A conceptual framework based on a systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 97-109.
    7. Lopez-Vega, Henry & Tell, Fredrik & Vanhaverbeke, Wim, 2016. "Where and how to search? Search paths in open innovation," Research Policy, Elsevier, vol. 45(1), pages 125-136.
    8. Kakatkar, Chinmay & Bilgram, Volker & Füller, Johann, 2020. "Innovation analytics: Leveraging artificial intelligence in the innovation process," Business Horizons, Elsevier, vol. 63(2), pages 171-181.
    9. Teng, Fei & Sun, Yuling & Chen, Fang & Qin, Aning & Zhang, Qi, 2021. "Technology opportunity discovery of proton exchange membrane fuel cells based on generative topographic mapping," Technological Forecasting and Social Change, Elsevier, vol. 169(C).
    10. Hong, Suckwon & Kim, Juram & Woo, Han-Gyun & Kim, Young-Choon & Lee, Changyong, 2022. "Screening ideas in the early stages of technology development: A word2vec and convolutional neural network approach," Technovation, Elsevier, vol. 112(C).
    11. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    12. Felin, Teppo & Zenger, Todd R., 2014. "Closed or open innovation? Problem solving and the governance choice," Research Policy, Elsevier, vol. 43(5), pages 914-925.
    13. Shen, Yung-Chi & Wang, Ming-Yeu & Yang, Ya-Chu, 2020. "Discovering the potential opportunities of scientific advancement and technological innovation: A case study of smart health monitoring technology," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    14. Jeong, Yujin & Park, Inchae & Yoon, Byungun, 2019. "Identifying emerging Research and Business Development (R&BD) areas based on topic modeling and visualization with intellectual property right data," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 655-672.
    15. Ozcan, Sercan & Suloglu, Metin & Sakar, C. Okan & Chatufale, Sushant, 2021. "Social media mining for ideation: Identification of sustainable solutions and opinions," Technovation, Elsevier, vol. 107(C).
    16. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    17. Jiyeon Hong & Paul R. Hoban, 2022. "Writing More Compelling Creative Appeals: A Deep Learning-Based Approach," Marketing Science, INFORMS, vol. 41(5), pages 941-965, September.
    18. Jeon, Daeseong & Ahn, Joon Mo & Kim, Juram & Lee, Changyong, 2022. "A doc2vec and local outlier factor approach to measuring the novelty of patents," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    19. Kim, Junhan & Geum, Youngjung, 2021. "How to develop data-driven technology roadmaps:The integration of topic modeling and link prediction," Technological Forecasting and Social Change, Elsevier, vol. 171(C).
    20. Füller, Johann & Hutter, Katja & Wahl, Julian & Bilgram, Volker & Tekic, Zeljko, 2022. "How AI revolutionizes innovation management – Perceptions and implementation preferences of AI-based innovators," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    21. Geum, Youngjung & Park, Yongtae, 2016. "How to generate creative ideas for innovation: a hybrid approach of WordNet and morphological analysis," Technological Forecasting and Social Change, Elsevier, vol. 111(C), pages 176-187.
    22. Teppo Felin & Todd R. Zenger, 2016. "CROSSROADS—Strategy, Problems, and a Theory for the Firm," Organization Science, INFORMS, vol. 27(1), pages 222-231, February.
    23. Caloffi, Annalisa & Colovic, Ana & Rizzoli, Valentina & Rossi, Federica, 2023. "Innovation intermediaries' types and functions: A computational analysis of the literature," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    24. Sabine Brunswicker & Ulrich Hutschek, 2010. "Crossing Horizons: Leveraging Cross-Industry Innovation Search In The Front-End Of The Innovation Process," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 14(04), pages 683-702.
    25. Victoria Kayser & Kerstin Goluchowicz & Antje Bierwisch, 2014. "Text Mining For Technology Roadmapping — The Strategic Value Of Information," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 18(03), pages 1-23.
    26. Yue Kang & Zhao Cai & Chee-Wee Tan & Qian Huang & Hefu Liu, 2020. "Natural language processing (NLP) in management research: A literature review," Journal of Management Analytics, Taylor & Francis Journals, vol. 7(2), pages 139-172, April.
    27. Hyunseok Park & Janghyeok Yoon, 2015. "A chance discovery-based approach for new product–service system (PSS) concepts," Service Business, Springer;Pan-Pacific Business Association, vol. 9(1), pages 115-135, March.
    28. Fuller, Johann & Jawecki, Gregor & Muhlbacher, Hans, 2007. "Innovation creation by online basketball communities," Journal of Business Research, Elsevier, vol. 60(1), pages 60-71, January.
    29. Trappey, Amy & Trappey, Charles V. & Hsieh, Alex, 2021. "An intelligent patent recommender adopting machine learning approach for natural language processing: A case study for smart machinery technology mining," Technological Forecasting and Social Change, Elsevier, vol. 164(C).
    30. von Hippel, Eric & Kaulartz, Sandro, 2021. "Next-generation consumer innovation search: Identifying early-stage need-solution pairs on the web," Research Policy, Elsevier, vol. 50(8).
    31. Lee, Changyong & Jeon, Daeseong & Ahn, Joon Mo & Kwon, Ohjin, 2020. "Navigating a product landscape for technology opportunity analysis: A word2vec approach using an integrated patent-product database," Technovation, Elsevier, vol. 96.
    32. Seo, Wonchul & Yoon, Janghyeok & Park, Hyunseok & Coh, Byoung-youl & Lee, Jae-Min & Kwon, Oh-Jin, 2016. "Product opportunity identification based on internal capabilities using text mining and association rule mining," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 94-104.
    33. Stefania Testa & Silvia Massa & Antonella Martini & Francesco Paolo Appio, 2020. "Social media-based innovation: A review of trends and a research agenda," Post-Print halshs-02292361, HAL.
    34. Sykora, Martin & Elayan, Suzanne & Hodgkinson, Ian R. & Jackson, Thomas W. & West, Andrew, 2022. "The power of emotions: Leveraging user generated content for customer experience management," Journal of Business Research, Elsevier, vol. 144(C), pages 997-1006.
    35. Thomas H. Davenport, 2018. "From analytics to artificial intelligence," Journal of Business Analytics, Taylor & Francis Journals, vol. 1(2), pages 73-80, July.
    36. Ma, Tingting & Zhou, Xiao & Liu, Jia & Lou, Zhenkai & Hua, Zhaoting & Wang, Ruitao, 2021. "Combining topic modeling and SAO semantic analysis to identify technological opportunities of emerging technologies," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    37. Yang, Zaoli & Zhang, Weijian & Yuan, Fei & Islam, Nazrul, 2021. "Measuring topic network centrality for identifying technology and technological development in online communities," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    38. Mingyu Park & Youngjung Geum, 2021. "On the data-driven generation of new service idea: integrated approach of morphological analysis and text mining," Service Business, Springer;Pan-Pacific Business Association, vol. 15(3), pages 539-561, September.
    39. Makarius, Erin E. & Mukherjee, Debmalya & Fox, Joseph D. & Fox, Alexa K., 2020. "Rising with the machines: A sociotechnical framework for bringing artificial intelligence into the organization," Journal of Business Research, Elsevier, vol. 120(C), pages 262-273.
    40. Antonio L. Alfeo & Mario G. C. A. Cimino & Gigliola Vaglini, 2021. "Technological troubleshooting based on sentence embedding with deep transformers," Journal of Intelligent Manufacturing, Springer, vol. 32(6), pages 1699-1710, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Zhenfeng & Feng, Jian & Uden, Lorna, 2023. "Technology opportunity analysis using hierarchical semantic networks and dual link prediction," Technovation, Elsevier, vol. 128(C).
    2. Kathleen Diener & Dirk Luettgens & Frank Thomas Piller, 2019. "Intermediation For Open Innovation: Comparing Direct Versus Delegated Search Strategies Of Innovation Intermediaries," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 24(04), pages 1-20, June.
    3. Fu, Shihui & Sun, Yi & Gao, Xue, 2022. "Balancing openness and control to improve the performance of crowdsourcing contests for product innovation: A configurational perspective," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Kokshagina, Olga & Le Masson, Pascal & Bories, Florent, 2017. "Fast-connecting search practices: On the role of open innovation intermediary to accelerate the absorptive capacity," Technological Forecasting and Social Change, Elsevier, vol. 120(C), pages 232-239.
    5. Choi, Jaewoong & Lee, Changyong & Yoon, Janghyeok, 2023. "Exploring a technology ecology for technology opportunity discovery: A link prediction approach using heterogeneous knowledge graphs," Technological Forecasting and Social Change, Elsevier, vol. 186(PB).
    6. Livio Cricelli & Michele Grimaldi & Silvia Vermicelli, 2022. "Crowdsourcing and open innovation: a systematic literature review, an integrated framework and a research agenda," Review of Managerial Science, Springer, vol. 16(5), pages 1269-1310, July.
    7. Ren, Haiying & Zhao, Yuhui, 2021. "Technology opportunity discovery based on constructing, evaluating, and searching knowledge networks," Technovation, Elsevier, vol. 101(C).
    8. Lee, Gyumin & Lee, Sungjun & Lee, Changyong, 2023. "Inventor–licensee matchmaking for university technology licensing: A fastText approach," Technovation, Elsevier, vol. 125(C).
    9. Ann Majchrzak & Arvind Malhotra, 2016. "Effect of Knowledge-Sharing Trajectories on Innovative Outcomes in Temporary Online Crowds," Information Systems Research, INFORMS, vol. 27(4), pages 685-703, December.
    10. Motohashi, Kazuyuki & Zhu, Chen, 2023. "Identifying technology opportunity using dual-attention model and technology-market concordance matrix," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    11. Yang, Zaoli & Wu, Qingyang & Venkatachalam, K. & Li, Yuchen & Xu, Bing & Trojovský, Pavel, 2022. "Topic identification and sentiment trends in Weibo and WeChat content related to intellectual property in China," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    12. Thuy Seran & Sea Matilda Bez, 2019. "Managing Open-Innovation between Competitors: A Project-Level Approach," Post-Print hal-02427680, HAL.
    13. Jeon, Daeseong & Ahn, Joon Mo & Kim, Juram & Lee, Changyong, 2022. "A doc2vec and local outlier factor approach to measuring the novelty of patents," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    14. Xuan Shi & Lingfei Cai & Hongfang Song, 2019. "Discovering Potential Technology Opportunities for Fuel Cell Vehicle Firms: A Multi-Level Patent Portfolio-Based Approach," Sustainability, MDPI, vol. 11(22), pages 1-22, November.
    15. Yuchen Zhang & Wei Yang, 2022. "Breakthrough invention and problem complexity: Evidence from a quasi‐experiment," Strategic Management Journal, Wiley Blackwell, vol. 43(12), pages 2510-2544, December.
    16. Hossain, Mokter, 2018. "Motivations, challenges, and opportunities of successful solvers on an innovation intermediary platform," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 67-73.
    17. Pollok, Patrick & Lüttgens, Dirk & Piller, Frank T., 2019. "Attracting solutions in crowdsourcing contests: The role of knowledge distance, identity disclosure, and seeker status," Research Policy, Elsevier, vol. 48(1), pages 98-114.
    18. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    19. Ghaffari, Mohsen & Aliahmadi, Alireza & Khalkhali, Abolfazl & Zakery, Amir & Daim, Tugrul U. & Yalcin, Haydar, 2023. "Topic-based technology mapping using patent data analysis: A case study of vehicle tires," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    20. Kokshagina, Olga & Gillier, Thomas & Cogez, Patrick & Le Masson, Pascal & Weil, Benoit, 2017. "Using innovation contests to promote the development of generic technologies," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 152-164.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:techno:v:129:y:2024:i:c:s0166497223001943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/01664972 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.