IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i10d10.1007_s11192-024-05009-z.html
   My bibliography  Save this article

Annotation of scientific uncertainty using linguistic patterns

Author

Listed:
  • Panggih Kusuma Ningrum

    (Université de Franche-Comté)

  • Iana Atanassova

    (Université de Franche-Comté
    Institut Universitaire de France (IUF))

Abstract

Scientific uncertainty is an integral part of the research process and inherent to the construction of new knowledge. In this paper, we investigate the ways in which uncertainty is expressed in articles and propose a new interdisciplinary annotation framework to categorize sentences containing uncertainty expressions along five dimensions. We propose a method for the automatic annotation of sentences based on linguistic patterns for identifying the expressions of scientific uncertainty that have been derived from a corpus study. We processed a corpus of 5956 articles from 22 journals in three different discipline groups, which were annotated using our automatic annotation method. We evaluate our annotation method and study the distribution of uncertainty expressions across the different journals and categories. The results show a predominant concentration of the distribution of the scientific uncertainty expressions in the Results and Discussion section (71.4%), followed by 12.5% of expressions in the Background section, and the largest proportion of uncertainty expressions, approximately 70.3%, are formed as author(s) statements. Our research contributes methodological advances and insights into the diverse manifestations of scientific uncertainty across disciplinary domains and provides a basis for ongoing exploration and refinement of the understanding of scientific uncertainty communication.

Suggested Citation

  • Panggih Kusuma Ningrum & Iana Atanassova, 2024. "Annotation of scientific uncertainty using linguistic patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 6261-6285, October.
  • Handle: RePEc:spr:scient:v:129:y:2024:i:10:d:10.1007_s11192-024-05009-z
    DOI: 10.1007/s11192-024-05009-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05009-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-024-05009-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mingxin Yao & Ying Wei & Huiyu Wang, 2023. "Promoting research by reducing uncertainty in academic writing: a large-scale diachronic case study on hedging in Science research articles across 25 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4541-4558, August.
    2. G. Dosi & M. Egidi, 2000. "Substantive and Procedural Uncertainty: An Exploration of Economic Behaviours in Changing Environments," Chapters, in: Innovation, Organization and Economic Dynamics, chapter 5, pages 165-188, Edward Elgar Publishing.
    3. Rammel, Christian & van den Bergh, Jeroen C. J. M., 2003. "Evolutionary policies for sustainable development: adaptive flexibility and risk minimising," Ecological Economics, Elsevier, vol. 47(2-3), pages 121-133, December.
    4. Chen, Chaomei & Song, Min & Heo, Go Eun, 2018. "A scalable and adaptive method for finding semantically equivalent cue words of uncertainty," Journal of Informetrics, Elsevier, vol. 12(1), pages 158-180.
    5. Jon C. Helton, 1994. "Treatment of Uncertainty in Performance Assessments for Complex Systems," Risk Analysis, John Wiley & Sons, vol. 14(4), pages 483-511, August.
    6. Ascough, J.C. & Maier, H.R. & Ravalico, J.K. & Strudley, M.W., 2008. "Future research challenges for incorporation of uncertainty in environmental and ecological decision-making," Ecological Modelling, Elsevier, vol. 219(3), pages 383-399.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Ana Paula Coelho Clauberg & Renato de Mello & Flávio José Simioni & Simone Sehnem, 2021. "System for assessing the sustainability conditions of small hydro plants by fuzzy logic," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(2), pages 300-317, March.
    3. Maxim Kotsemir & Alexander Abroskin & Dirk Meissner, 2013. "Innovation concepts and typology – an evolutionary discussion," HSE Working papers WP BRP 05/STI/2013, National Research University Higher School of Economics.
    4. Jeroen C.J.M. van den Bergh, 2014. "Sustainable development in ecological economics," Chapters, in: Giles Atkinson & Simon Dietz & Eric Neumayer & Matthew Agarwala (ed.), Handbook of Sustainable Development, chapter 3, pages 41-54, Edward Elgar Publishing.
    5. Marletto, Gerardo, 2011. "Structure, agency and change in the car regime. A review of the literature," European Transport \ Trasporti Europei, ISTIEE, Institute for the Study of Transport within the European Economic Integration, issue 47, pages 71-88.
    6. Seidl, Rupert & Fernandes, Paulo M. & Fonseca, Teresa F. & Gillet, François & Jönsson, Anna Maria & Merganičová, Katarína & Netherer, Sigrid & Arpaci, Alexander & Bontemps, Jean-Daniel & Bugmann, Hara, 2011. "Modelling natural disturbances in forest ecosystems: a review," Ecological Modelling, Elsevier, vol. 222(4), pages 903-924.
    7. Valeria Costantini & Francesco Crespi, 2013. "Public policies for a sustainable energy sector: regulation, diversity and fostering of innovation," Journal of Evolutionary Economics, Springer, vol. 23(2), pages 401-429, April.
    8. Kanapaux, William & Kiker, Gregory A., 2013. "Development and testing of an object-oriented model for adaptively managing human disturbance of least tern (Sternula antillarum) nesting habitat," Ecological Modelling, Elsevier, vol. 268(C), pages 64-77.
    9. van den Bergh, Jeroen C.J.M., 2008. "Optimal diversity: Increasing returns versus recombinant innovation," Journal of Economic Behavior & Organization, Elsevier, vol. 68(3-4), pages 565-580, December.
    10. J. C. Helton & F. J. Davis, 2002. "Illustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 591-622, June.
    11. Nill, Jan & Kemp, Ren, 2009. "Evolutionary approaches for sustainable innovation policies: From niche to paradigm?," Research Policy, Elsevier, vol. 38(4), pages 668-680, May.
    12. Alessandro Caiani, 2017. "Innovation Dynamics and Industry Structure Under Different Technological Spaces," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 3(3), pages 307-341, November.
    13. Hahn, Thomas & McDermott, Constance & Ituarte-Lima, Claudia & Schultz, Maria & Green, Tom & Tuvendal, Magnus, 2015. "Purposes and degrees of commodification: Economic instruments for biodiversity and ecosystem services need not rely on markets or monetary valuation," Ecosystem Services, Elsevier, vol. 16(C), pages 74-82.
    14. Sandro Sapio, 2004. "Markets Design, Bidding Rules, and Long Memory in Electricity Prices," Revue d'Économie Industrielle, Programme National Persée, vol. 107(1), pages 151-170.
    15. Piotti, Geny, 2007. "Why do companies relocate? The German discourse on relocation," MPIfG Discussion Paper 07/14, Max Planck Institute for the Study of Societies.
    16. Daniela M. Salvioni & Simona Franzoni & Raffaella Cassano, 2017. "Sustainability in the Higher Education System: An Opportunity to Improve Quality and Image," Sustainability, MDPI, vol. 9(6), pages 1-27, May.
    17. Wu, Lingfei & Kittur, Aniket & Youn, Hyejin & Milojević, Staša & Leahey, Erin & Fiore, Stephen M. & Ahn, Yong-Yeol, 2022. "Metrics and mechanisms: Measuring the unmeasurable in the science of science," Journal of Informetrics, Elsevier, vol. 16(2).
    18. Grzegorz Drozdowski, 2021. "Economic Calculus Qua an Instrument to Support Sustainable Development under Increasing Risk," JRFM, MDPI, vol. 14(1), pages 1-12, January.
    19. Giovanni Dosi & Richard Nelson, 2013. "The Evolution of Technologies: An Assessment of the State-of-the-Art," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 3(1), pages 3-46, June.
    20. Kostas Bithas, 2008. "Tracing operational conditions for the Ecologically Sustainable Economic Development: the Pareto optimality and the preservation of the biological crucial levels," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 10(3), pages 373-390, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:10:d:10.1007_s11192-024-05009-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.