IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i5d10.1007_s11192-023-04672-y.html
   My bibliography  Save this article

Innovation signals: leveraging machine learning to separate noise from news

Author

Listed:
  • Christian Mühlroth

    (Friedrich-Alexander-Universität Erlangen-Nürnberg)

  • Laura Kölbl

    (Friedrich-Alexander-Universität Erlangen-Nürnberg)

  • Michael Grottke

    (Friedrich-Alexander-Universität Erlangen-Nürnberg
    GfK SE)

Abstract

The early detection of and an adequate response to meaningful signals of change have a defining impact on the competitive vitality and the competitive advantage of companies. For this strategically important task, companies apply corporate foresight, aiming to enable superior company performance. With the growing dynamics of global markets, the amount of data to be analyzed for this purpose is constantly increasing. As a result, these analyses are often performed with an unreasonably high investment of financial and human resources, or are even not performed at all. To address this challenge, this paper presents a machine-learning-based approach to help companies identify early signals of change with a higher level of automation than before. For this, we combine a newly-proposed quantitative approach with the existing qualitative approaches by Cooper (stage-gate model) and by Rohrbeck (corporate foresight process). After a search field of interest has been defined, the related data is collected from web news sites, early signals are identified and selected automatically, and domain experts then assess these signals with respect to their relevance and novelty. Once it has been set up, the approach can be executed iteratively at regular time intervals in order to continuously scan for new signals of change. By means of three case studies supported by domain experts we demonstrate the effectiveness of our approach. After presenting our findings and discussing possible limitations of the approach, we suggest future research opportunities to further advance this field.

Suggested Citation

  • Christian Mühlroth & Laura Kölbl & Michael Grottke, 2023. "Innovation signals: leveraging machine learning to separate noise from news," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2649-2676, May.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:5:d:10.1007_s11192-023-04672-y
    DOI: 10.1007/s11192-023-04672-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04672-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04672-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. O. Mryglod & Yu. Holovatch & R. Kenna & B. Berche, 2016. "Quantifying the evolution of a scientific topic: reaction of the academic community to the Chornobyl disaster," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1151-1166, March.
    2. Douglas Henrique Milanez & Leandro Innocentini Lopes Faria & Roniberto Morato Amaral & Daniel Rodrigo Leiva & José Angelo Rodrigues Gregolin, 2014. "Patents in nanotechnology: an analysis using macro-indicators and forecasting curves," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1097-1112, November.
    3. Rohrbeck, René & Kum, Menes Etingue, 2018. "Corporate foresight and its impact on firm performance: A longitudinal analysis," Technological Forecasting and Social Change, Elsevier, vol. 129(C), pages 105-116.
    4. Noh, Heeyong & Song, Young-Keun & Lee, Sungjoo, 2016. "Identifying emerging core technologies for the future: Case study of patents published by leading telecommunication organizations," Telecommunications Policy, Elsevier, vol. 40(10), pages 956-970.
    5. D. Thorleuchter & D. Van Den Poel, 2013. "Weak Signal Identification with Semantic Web Mining," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 13/860, Ghent University, Faculty of Economics and Business Administration.
    6. Gordon, Adam Vigdor & Ramic, Mirza & Rohrbeck, René & Spaniol, Matthew J., 2020. "50 Years of corporate and organizational foresight: Looking back and going forward," Technological Forecasting and Social Change, Elsevier, vol. 154(C).
    7. Janghyeok Yoon & Kwangsoo Kim, 2012. "Detecting signals of new technological opportunities using semantic patent analysis and outlier detection," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 445-461, February.
    8. Keller, Jonas & von der Gracht, Heiko A., 2014. "The influence of information and communication technology (ICT) on future foresight processes — Results from a Delphi survey," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 81-92.
    9. Momeni, Abdolreza & Rost, Katja, 2016. "Identification and monitoring of possible disruptive technologies by patent-development paths and topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 104(C), pages 16-29.
    10. Oleg Ena & Nadezhda Mikova & Ozcan Saritas & Anna Sokolova, 2016. "A methodology for technology trend monitoring: the case of semantic technologies," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1013-1041, September.
    11. Christian Mühlroth & Michael Grottke, 2018. "A systematic literature review of mining weak signals and trends for corporate foresight," Journal of Business Economics, Springer, vol. 88(5), pages 643-687, July.
    12. Farshad Madani, 2015. "‘Technology Mining’ bibliometrics analysis: applying network analysis and cluster analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 323-335, October.
    13. Ahmad Barirani & Bruno Agard & Catherine Beaudry, 2013. "Discovering and assessing fields of expertise in nanomedicine: a patent co-citation network perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1111-1136, March.
    14. Giada Di Stefano & Alfonso Gambardella & Gianmario Verona, 2012. "Technology Push and Demand Pull Perspectives in Innovation Studies: Current Findings and Future Research Directions," Post-Print hal-00696607, HAL.
    15. Stephen F. Carley & Nils C. Newman & Alan L. Porter & Jon G. Garner, 2018. "An indicator of technical emergence," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 35-49, April.
    16. Di Stefano, Giada & Gambardella, Alfonso & Verona, Gianmario, 2012. "Technology push and demand pull perspectives in innovation studies: Current findings and future research directions," Research Policy, Elsevier, vol. 41(8), pages 1283-1295.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian Mühlroth & Michael Grottke, 2018. "A systematic literature review of mining weak signals and trends for corporate foresight," Journal of Business Economics, Springer, vol. 88(5), pages 643-687, July.
    2. Marinković, Milan & Al-Tabbaa, Omar & Khan, Zaheer & Wu, Jie, 2022. "Corporate foresight: A systematic literature review and future research trajectories," Journal of Business Research, Elsevier, vol. 144(C), pages 289-311.
    3. Ebadi, Ashkan & Auger, Alain & Gauthier, Yvan, 2022. "Detecting emerging technologies and their evolution using deep learning and weak signal analysis," Journal of Informetrics, Elsevier, vol. 16(4).
    4. Juite Wang & Tzu-Yen Hsu, 2023. "Early discovery of emerging multi-technology convergence for analyzing technology opportunities from patent data: the case of smart health," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4167-4196, August.
    5. repec:dar:wpaper:130792 is not listed on IDEAS
    6. Nazemi, Kawa & Burkhardt, Dirk & Kock, Alexander, 2022. "Visual Analytics for Technology and Innovation Management: An Interaction Approach for Strategic Decision Making," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 136215, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    7. Park, Inchae & Triulzi, Giorgio & Magee, Christopher L., 2022. "Tracing the emergence of new technology: A comparative analysis of five technological domains," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    8. Zhu, Lin & Cunningham, Scott W., 2022. "Unveiling the knowledge structure of technological forecasting and social change (1969–2020) through an NMF-based hierarchical topic model," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    9. Christoph P. Kiefer & Pablo Del Río González & Javier Carrillo‐Hermosilla, 2019. "Drivers and barriers of eco‐innovation types for sustainable transitions: A quantitative perspective," Business Strategy and the Environment, Wiley Blackwell, vol. 28(1), pages 155-172, January.
    10. Spaniol, Matthew J. & Rowland, Nicholas J., 2022. "Business ecosystems and the view from the future: The use of corporate foresight by stakeholders of the Ro-Ro shipping ecosystem in the Baltic Sea Region," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    11. Paolo E. Giordani & Francesco Rullani, 2020. "The Digital Revolution and COVID-19," Working Papers 06, Venice School of Management - Department of Management, Università Ca' Foscari Venezia.
    12. Dawid, Herbert & Pellegrino, Gabriele & Vivarelli, Marco, 2017. "Is the demand-pull driver equally crucial for product vs process innovation?," MERIT Working Papers 2017-035, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    13. Hötte, Kerstin, 2023. "Demand-pull, technology-push, and the direction of technological change," Research Policy, Elsevier, vol. 52(5).
    14. Xu, Lei & Su, Jun, 2016. "From government to market and from producer to consumer: Transition of policy mix towards clean mobility in China," Energy Policy, Elsevier, vol. 96(C), pages 328-340.
    15. Clayton M. Christensen & Rory McDonald & Elizabeth J. Altman & Jonathan E. Palmer, 2018. "Disruptive Innovation: An Intellectual History and Directions for Future Research," Journal of Management Studies, Wiley Blackwell, vol. 55(7), pages 1043-1078, November.
    16. Yashuang Qi & Na Zhu & Yujia Zhai & Ying Ding, 2018. "The mutually beneficial relationship of patents and scientific literature: topic evolution in nanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 893-911, May.
    17. Nemet, Gregory F. & Zipperer, Vera & Kraus, Martina, 2018. "The valley of death, the technology pork barrel, and public support for large demonstration projects," Energy Policy, Elsevier, vol. 119(C), pages 154-167.
    18. Li, Xin & Xie, Qianqian & Jiang, Jiaojiao & Zhou, Yuan & Huang, Lucheng, 2019. "Identifying and monitoring the development trends of emerging technologies using patent analysis and Twitter data mining: The case of perovskite solar cell technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 687-705.
    19. Uzunca, Bilgehan & Sharapov, Dmitry & Tee, Richard, 2022. "Governance rigidity, industry evolution, and value capture in platform ecosystems," Research Policy, Elsevier, vol. 51(7).
    20. Kajikawa, Yuya & Mejia, Cristian & Wu, Mengjia & Zhang, Yi, 2022. "Academic landscape of Technological Forecasting and Social Change through citation network and topic analyses," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    21. Attila Havas, 2016. "Social and Business Innovations: Are Common Measurement Approaches Possible?," Foresight-Russia Форсайт, CyberLeninka;Федеральное государственное автономное образовательное учреждение высшего образования «Национальный исследовательский университет «Высшая школа экономики», vol. 10(2 (eng)), pages 58-80.

    More about this item

    Keywords

    Weak signals; Strong signals; Corporate foresight; Innovation management; Machine learning; Artificial intelligence; Trend scouting; Technology scouting; Startup scouting;
    All these keywords.

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • M1 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration
    • M19 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - Other
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:5:d:10.1007_s11192-023-04672-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.