IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i1d10.1007_s11135-022-01378-w.html
   My bibliography  Save this article

Informing policy with text mining: technological change and social challenges

Author

Listed:
  • Kristóf Gyódi

    (University of Warsaw)

  • Łukasz Nawaro

    (University of Warsaw)

  • Michał Paliński

    (University of Warsaw)

  • Maciej Wilamowski

    (University of Warsaw)

Abstract

This study presents an innovative text mining methodology that supports policy analysts with problem recognition, definition and selection. The empirical analysis is based on four years of online news articles published in the period 2016–2019. Using a combination of text mining methods (analysis of term-frequencies, co-occurrence and sentiment analysis), we identify trending terms and explore selected regulatory issues. The analysis demonstrates that while each text mining algorithm provides insightful results, their combination yields more detailed and robust overview of regulatory problems. The results present early signals and trends, the connections between trending topics, and the changing public attitudes towards them.

Suggested Citation

  • Kristóf Gyódi & Łukasz Nawaro & Michał Paliński & Maciej Wilamowski, 2023. "Informing policy with text mining: technological change and social challenges," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 933-954, February.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:1:d:10.1007_s11135-022-01378-w
    DOI: 10.1007/s11135-022-01378-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01378-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01378-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kayser, Victoria & Blind, Knut, 2017. "Extending the knowledge base of foresight: The contribution of text mining," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 208-215.
    2. Mafini Dosso & Ben R Martin & Pietro Moncada-Paternò-Castello, 2018. "Towards evidence-based industrial research and innovation policy," Science and Public Policy, Oxford University Press, vol. 45(2), pages 143-150.
    3. Niemann, Helen & Moehrle, Martin G. & Frischkorn, Jonas, 2017. "Use of a new patent text-mining and visualization method for identifying patenting patterns over time: Concept, method and test application," Technological Forecasting and Social Change, Elsevier, vol. 115(C), pages 210-220.
    4. Dedehayir, Ozgur & Steinert, Martin, 2016. "The hype cycle model: A review and future directions," Technological Forecasting and Social Change, Elsevier, vol. 108(C), pages 28-41.
    5. Young-Joo Lee & Ji-Young Park, 2018. "Identification of future signal based on the quantitative and qualitative text mining: a case study on ethical issues in artificial intelligence," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(2), pages 653-667, March.
    6. Albert, Till & Moehrle, Martin G. & Meyer, Stefan, 2015. "Technology maturity assessment based on blog analysis," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 196-209.
    7. Mikko Packalen & Jay Bhattacharya, 2015. "New Ideas in Invention," NBER Working Papers 20922, National Bureau of Economic Research, Inc.
    8. Jamie Berryhill & Kévin Kok Heang & Rob Clogher & Keegan McBride, 2019. "Hello, World: Artificial intelligence and its use in the public sector," OECD Working Papers on Public Governance 36, OECD Publishing.
    9. Bildosola, Iñaki & Río-Bélver, Rosa María & Garechana, Gaizka & Cilleruelo, Ernesto, 2017. "TeknoRoadmap, an approach for depicting emerging technologies," Technological Forecasting and Social Change, Elsevier, vol. 117(C), pages 25-37.
    10. Li, Xin & Xie, Qianqian & Daim, Tugrul & Huang, Lucheng, 2019. "Forecasting technology trends using text mining of the gaps between science and technology: The case of perovskite solar cell technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 432-449.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Changyong, 2021. "A review of data analytics in technological forecasting," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    2. Li, Xin & Wu, Yundi & Cheng, Haolun & Xie, Qianqian & Daim, Tugrul, 2023. "Identifying technology opportunity using SAO semantic mining and outlier detection method: A case of triboelectric nanogenerator technology," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    3. Xi, Xi & Ren, Feifei & Yu, Lean & Yang, Jing, 2023. "Detecting the technology's evolutionary pathway using HiDS-trait-driven tech mining strategy," Technological Forecasting and Social Change, Elsevier, vol. 195(C).
    4. Zhang, Hao & Daim, Tugrul & Zhang, Yunqiu (Peggy), 2021. "Integrating patent analysis into technology roadmapping: A latent dirichlet allocation based technology assessment and roadmapping in the field of Blockchain," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    5. Wang, Xiaoli & Huang, Lucheng & Daim, Tugrul & Li, Xin & Li, Zhiqiang, 2021. "Evaluation of China's new energy vehicle policy texts with quantitative and qualitative analysis," Technology in Society, Elsevier, vol. 67(C).
    6. Mejía, Cristian & Kajikawa, Yuya, 2019. "Technology news and their linkage to production of knowledge in robotics research," Technological Forecasting and Social Change, Elsevier, vol. 143(C), pages 114-124.
    7. White, Gareth R.T. & Samuel, Anthony, 2019. "Programmatic Advertising: Forewarning and avoiding hype-cycle failure," Technological Forecasting and Social Change, Elsevier, vol. 144(C), pages 157-168.
    8. Giones, Ferran & Brem, Alexander, 2017. "From toys to tools: The co-evolution of technological and entrepreneurial developments in the drone industry," Business Horizons, Elsevier, vol. 60(6), pages 875-884.
    9. Laura Lecluyse & Mirjam Knockaert & André Spithoven, 2019. "The contribution of science parks: a literature review and future research agenda," The Journal of Technology Transfer, Springer, vol. 44(2), pages 559-595, April.
    10. Stöcker, Claudia & Bennett, Rohan & Koeva, Mila & Nex, Francesco & Zevenbergen, Jaap, 2022. "Scaling up UAVs for land administration: Towards the plateau of productivity," Land Use Policy, Elsevier, vol. 114(C).
    11. Taeyeoun Roh & Yujin Jeong & Byungun Yoon, 2017. "Developing a Methodology of Structuring and Layering Technological Information in Patent Documents through Natural Language Processing," Sustainability, MDPI, vol. 9(11), pages 1-19, November.
    12. Abdul-Manan, Amir F.N., 2017. "Lifecycle GHG emissions of palm biodiesel: Unintended market effects negate direct benefits of the Malaysian Economic Transformation Plan (ETP)," Energy Policy, Elsevier, vol. 104(C), pages 56-65.
    13. Kriechbaum, Michael & Posch, Alfred & Hauswiesner, Angelika, 2021. "Hype cycles during socio-technical transitions: The dynamics of collective expectations about renewable energy in Germany," Research Policy, Elsevier, vol. 50(9).
    14. Zamani, Mehdi & Yalcin, Haydar & Naeini, Ali Bonyadi & Zeba, Gordana & Daim, Tugrul U, 2022. "Developing metrics for emerging technologies: identification and assessment," Technological Forecasting and Social Change, Elsevier, vol. 176(C).
    15. Miloš Ulman & Pavel Šimek & Jan Masner & Pavel Kogut & Tuula Löytty & Patrick Crehan & Karel Charvát & Antoni Oliva & Stein Runar Bergheim & Milan Kalaš & Denis Kolokol & Tommaso Sabbatini, 2020. "Towards Future Oriented Collaborative Policy Development for Rural Areas and People," AGRIS on-line Papers in Economics and Informatics, Czech University of Life Sciences Prague, Faculty of Economics and Management, vol. 12(01), March.
    16. Nguyen Thanh Viet & Alla G. Kravets, 2022. "The New Method for Analyzing Technology Trends of Smart Energy Asset Performance Management," Energies, MDPI, vol. 15(18), pages 1-26, September.
    17. Ren, Haiying & Zhao, Yuhui, 2021. "Technology opportunity discovery based on constructing, evaluating, and searching knowledge networks," Technovation, Elsevier, vol. 101(C).
    18. Kalghatgi, Gautam, 2018. "Is it really the end of internal combustion engines and petroleum in transport?," Applied Energy, Elsevier, vol. 225(C), pages 965-974.
    19. Ricard Esparza-Masana, 2022. "Towards Smart Specialisation 2.0. Main Challenges When Updating Strategies," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(1), pages 635-655, March.
    20. Leckel, Anja & Veilleux, Sophie & Dana, Leo Paul, 2020. "Local Open Innovation: A means for public policy to increase collaboration for innovation in SMEs," Technological Forecasting and Social Change, Elsevier, vol. 153(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:1:d:10.1007_s11135-022-01378-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.