IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0237144.html
   My bibliography  Save this article

Predictive modeling for trustworthiness and other subjective text properties in online nutrition and health communication

Author

Listed:
  • Janne Kauttonen
  • Jenni Hannukainen
  • Pia Tikka
  • Jyrki Suomala

Abstract

While the internet has democratized and accelerated content creation and sharing, it has also made people more vulnerable to manipulation and misinformation. Also, the received information can be distorted by psychological biases. This is problematic especially in health-related communications which can greatly affect the quality of life of individuals. We assembled and analyzed 364 texts related to nutrition and health from Finnish online sources, such as news, columns and blogs, and asked non-experts to subjectively evaluate the texts. Texts were rated for their trustworthiness, sentiment, logic, information, clarity, and neutrality properties. We then estimated individual biases and consensus ratings that were used in training regression models. Firstly, we found that trustworthiness was significantly correlated to the information, neutrality and logic of the texts. Secondly, individual ratings for information and logic were significantly biased by the age and diet of the raters. Our best regression models explained up to 70% of the total variance of consensus ratings based on the low-level properties of texts, such as semantic embeddings, presence of key-terms and part-of-speech tags, references, quotes and paragraphs. With a novel combination of crowdsourcing, behavioral analysis, natural language processing and predictive modeling, our study contributes to the automated identification of reliable and high-quality online information. While critical evaluation of truthfulness cannot be surrendered to the machine only, our findings provide new insights into automated evaluation of subjective text properties and analysis of morphologically-rich languages in regards to trustworthiness.

Suggested Citation

  • Janne Kauttonen & Jenni Hannukainen & Pia Tikka & Jyrki Suomala, 2020. "Predictive modeling for trustworthiness and other subjective text properties in online nutrition and health communication," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-23, August.
    • Handle: RePEc:plo:pone00:0237144
    DOI: 10.1371/journal.pone.0237144
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0237144
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0237144&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0237144?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wu, Zhihao & Lin, Youfang & Wan, Huaiyu & Tian, Shengfeng & Hu, Keyun, 2012. "Efficient overlapping community detection in huge real-world networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(7), pages 2475-2490.
    2. Sunghan Kim & David Goldstein & Lynn Hasher & Rose T. Zacks, 2005. "Framing Effects in Younger and Older Adults," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 60(4), pages 215-218.
    3. Dan M. Kahan & Hank Jenkins-Smith & Donald Braman, 2011. "Cultural cognition of scientific consensus," Journal of Risk Research, Taylor & Francis Journals, vol. 14(2), pages 147-174, February.
    4. Giovanni Luca Ciampaglia & Prashant Shiralkar & Luis M Rocha & Johan Bollen & Filippo Menczer & Alessandro Flammini, 2015. "Computational Fact Checking from Knowledge Networks," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-13, June.
    5. Gray, Nicola J. & Klein, Jonathan D. & Noyce, Peter R. & Sesselberg, Tracy S. & Cantrill, Judith A., 2005. "Health information-seeking behaviour in adolescence: the place of the internet," Social Science & Medicine, Elsevier, vol. 60(7), pages 1467-1478, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Carolan, 2020. "Filtering perceptions of climate change and biotechnology: values and views among Colorado farmers and ranchers," Climatic Change, Springer, vol. 159(1), pages 121-139, March.
    2. Paul A. Hindsley & O. Ashton Morgan, 2020. "The Role of Cultural Worldviews in Willingness to Pay for Environmental Policy," Working Papers 20-03, Department of Economics, Appalachian State University.
    3. Lu, Xi & Mo, Hongming & Deng, Yong, 2015. "An evidential opinion dynamics model based on heterogeneous social influential power," Chaos, Solitons & Fractals, Elsevier, vol. 73(C), pages 98-107.
    4. Shang, Ronghua & Zhang, Weitong & Jiao, Licheng & Stolkin, Rustam & Xue, Yu, 2017. "A community integration strategy based on an improved modularity density increment for large-scale networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 469(C), pages 471-485.
    5. Roger D. Magarey & Christina M. Trexler, 2020. "Information: a missing component in understanding and mitigating social epidemics," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-11, December.
    6. Aaron Smith-Walter & Michael D. Jones & Elizabeth A. Shanahan & Holly Peterson, 2020. "The stories groups tell: campaign finance reform and the narrative networks of cultural cognition," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(2), pages 645-684, April.
    7. Markus Dressel, 2022. "Models of science and society: transcending the antagonism," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-15, December.
    8. Shapiro, Matthew A., 2020. "Next-generation battery research and development: Non-politicized science at the Joint Center for Energy Storage Research," Energy Policy, Elsevier, vol. 145(C).
    9. Alina Duduciuc, 2014. "Teenagers And The Use Of New Technologies (Ict) For Health Information," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 20.
    10. Sedona Chinn & P. Sol Hart, 2021. "Effects of consensus messages and political ideology on climate change attitudes: inconsistent findings and the effect of a pretest," Climatic Change, Springer, vol. 167(3), pages 1-21, August.
    11. Birkelund, Johan & Cherry, Todd L. & McEvoy, David M., 2022. "A culture of cheating: The role of worldviews in preferences for honesty," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 96(C).
    12. Hindsley, Paul & McEvoy, David M. & Morgan, O. Ashton, 2020. "Consumer Demand for Ethical Products and the Role of Cultural Worldviews: The Case of Direct-Trade Coffee," Ecological Economics, Elsevier, vol. 177(C).
    13. Linda M. Fogg & Lawrence C. Hamilton & Erin S. Bell, 2020. "Views of the Highway: Infrastructure Reality, Perceptions, and Politics," SAGE Open, , vol. 10(4), pages 21582440209, October.
    14. Muradian, Roldan & Pascual, Unai, 2020. "Ecological economics in the age of fear," Ecological Economics, Elsevier, vol. 169(C).
    15. Michael D. Jones, 2014. "Cultural Characters and Climate Change: How Heroes Shape Our Perception of Climate Science," Social Science Quarterly, Southwestern Social Science Association, vol. 95(1), pages 1-39, March.
    16. Bazzi, Samuel & Fiszbein, Martin & Gebresilasse, Mesay, 2021. "“Rugged individualism” and collective (in)action during the COVID-19 pandemic," Journal of Public Economics, Elsevier, vol. 195(C).
    17. Willemijn van Dolen & Charles B. Weinberg, 2019. "An Empirical Investigation of Factors Affecting Perceived Quality and Well-Being of Children Using an Online Child Helpline," IJERPH, MDPI, vol. 16(12), pages 1-11, June.
    18. Daniela Salite, 2019. "Explaining the uncertainty: understanding small-scale farmers’ cultural beliefs and reasoning of drought causes in Gaza Province, Southern Mozambique," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 36(3), pages 427-441, September.
    19. Janice Y. Jung & Barbara A. Mellers, 2016. "American attitudes toward nudges," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(1), pages 62-74, January.
    20. Kauder, Björn & Potrafke, Niklas & Ursprung, Heinrich, 2018. "Behavioral determinants of proclaimed support for environment protection policies," European Journal of Political Economy, Elsevier, vol. 54(C), pages 26-41.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0237144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.