IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v33y2022i3p887-907.html
   My bibliography  Save this article

Do You Really Know if It’s True? How Asking Users to Rate Stories Affects Belief in Fake News on Social Media

Author

Listed:
  • Patricia L. Moravec

    (Information, Risk, and Operations Management Department, McCombs School of Business, University of Texas, Austin, Texas 78705)

  • Antino Kim

    (Operations and Decision Technologies Department, Kelley School of Business, Indiana University, Bloomington, Indiana 47405)

  • Alan R. Dennis

    (Operations and Decision Technologies Department, Kelley School of Business, Indiana University, Bloomington, Indiana 47405)

  • Randall K. Minas

    (Information Technology Management, Shidler College of Business, University of Hawai’i at Manoa, Honolulu, Hawaii 96822)

Abstract

Research has shown that consuming ratings influences purchase decisions in e-commerce and also has modest effects on belief in news articles on social media. However, we do not know if the act of creating a rating influences belief in online news stories. Unlike e-commerce settings in which ratings typically come from those who have personally used the product or service, social media users who submit their ratings for news articles typically lack firsthand knowledge of the events reported in the news, making it difficult for most users to rate news articles accurately. We propose that one key benefit of user ratings in the context of news on social media lies in triggering users who create the ratings (as opposed to consume the ratings) to realize that they lack this firsthand knowledge, thus inducing them to become more skeptical of articles they see. We asked 68 social media users to assess the believability of 42 social media articles and measured their cognitive activity using electroencephalography. We found that asking users to rate articles using a self-referential question induced them to think more critically—as indicated by increased activation in the medial prefrontal cortex and dorsolateral prefrontal cortex—and made them less likely to believe the articles. The effect extended to subsequent articles; after being asked to rate an article, users were less likely to believe other articles that followed it whether they were asked to rate them or not. Overall, our findings suggest that asking users to evaluate the truthfulness of articles using self-referential rating questions may not only produce rating information that could be used by others later in time, but also has an immediate benefit of inducing users to think more critically about all articles they see.

Suggested Citation

  • Patricia L. Moravec & Antino Kim & Alan R. Dennis & Randall K. Minas, 2022. "Do You Really Know if It’s True? How Asking Users to Rate Stories Affects Belief in Fake News on Social Media," Information Systems Research, INFORMS, vol. 33(3), pages 887-907, September.
  • Handle: RePEc:inm:orisre:v:33:y:2022:i:3:p:887-907
    DOI: 10.1287/isre.2021.1090
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2021.1090
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2021.1090?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gersick, Connie J. G. & Hackman, J. Richard, 1990. "Habitual routines in task-performing groups," Organizational Behavior and Human Decision Processes, Elsevier, vol. 47(1), pages 65-97, October.
    2. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    3. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    4. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    5. Gordon Pennycook & Adam Bear & Evan T. Collins & David G. Rand, 2020. "The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings," Management Science, INFORMS, vol. 66(11), pages 4944-4957, November.
    6. Xianghua Lu & Sulin Ba & Lihua Huang & Yue Feng, 2013. "Promotional Marketing or Word-of-Mouth? Evidence from Online Restaurant Reviews," Information Systems Research, INFORMS, vol. 24(3), pages 596-612, September.
    7. Sparks, Beverley A. & Browning, Victoria, 2011. "The impact of online reviews on hotel booking intentions and perception of trust," Tourism Management, Elsevier, vol. 32(6), pages 1310-1323.
    8. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    9. Yi-Chun (Chad) Ho & Junjie Wu & Yong Tan, 2017. "Disconfirmation Effect on Online Rating Behavior: A Structural Model," Information Systems Research, INFORMS, vol. 28(3), pages 626-642, September.
    10. Marc Fischer & Sönke Albers & Nils Wagner & Monika Frie, 2011. "Practice Prize Winner --Dynamic Marketing Budget Allocation Across Countries, Products, and Marketing Activities," Marketing Science, INFORMS, vol. 30(4), pages 568-585, July.
    11. JaeHong Park & Prabhudev Konana & Bin Gu & Alok Kumar & Rajagopal Raghunathan, 2013. "Information Valuation and Confirmation Bias in Virtual Communities: Evidence from Stock Message Boards," Information Systems Research, INFORMS, vol. 24(4), pages 1050-1067, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patricia L. Moravec & Antino Kim & Alan R. Dennis, 2020. "Appealing to Sense and Sensibility: System 1 and System 2 Interventions for Fake News on Social Media," Information Systems Research, INFORMS, vol. 31(3), pages 987-1006, September.
    2. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    3. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    4. Tuval Danenberg & Drew Fudenberg, 2024. "Endogenous Attention and the Spread of False News," Papers 2406.11024, arXiv.org.
    5. Zhuolan Bao & Wenwen Li & Pengzhen Yin & Michael Chau, 2021. "Examining the impact of review tag function on product evaluation and information perception of popular products," Information Systems and e-Business Management, Springer, vol. 19(2), pages 517-539, June.
    6. Gonzalo Cisternas & Jorge Vásquez, 2022. "Misinformation in Social Media: The Role of Verification Incentives," Staff Reports 1028, Federal Reserve Bank of New York.
    7. Cameron Martel & Mohsen Mosleh & David G. Rand, 2021. "You’re Definitely Wrong, Maybe: Correction Style Has Minimal Effect on Corrections of Misinformation Online," Media and Communication, Cogitatio Press, vol. 9(1), pages 120-133.
    8. Young Kwark & Gene Moo Lee & Paul A. Pavlou & Liangfei Qiu, 2021. "On the Spillover Effects of Online Product Reviews on Purchases: Evidence from Clickstream Data," Information Systems Research, INFORMS, vol. 32(3), pages 895-913, September.
    9. Sarah Spiekermann & Hanna Krasnova & Oliver Hinz & Annika Baumann & Alexander Benlian & Henner Gimpel & Irina Heimbach & Antonia Köster & Alexander Maedche & Björn Niehaves & Marten Risius & Manuel Tr, 2022. "Values and Ethics in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(2), pages 247-264, April.
    10. Yipu Deng & Jinyang Zheng & Warut Khern-am-nuai & Karthik Kannan, 2022. "More than the Quantity: The Value of Editorial Reviews for a User-Generated Content Platform," Management Science, INFORMS, vol. 68(9), pages 6865-6888, September.
    11. Thomas Renault & David Restrepo Amariles & Aurore Troussel, 2024. "Collaboratively adding context to social media posts reduces the sharing of false news," Papers 2404.02803, arXiv.org.
    12. Hsin‐Hui Lin & Ching‐Feng Chen & Chih‐Lun Wu, 2023. "The effects of news authenticity and social media tie strength on consumer dissemination behavior," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(4), pages 2292-2313, June.
    13. Li, Yiming & Li, Gang & Tayi, Giri Kumar & Cheng, T.C.E., 2019. "Omni-channel retailing: Do offline retailers benefit from online reviews?," International Journal of Production Economics, Elsevier, vol. 218(C), pages 43-61.
    14. Julia Cage & Nicolas Hervé & Marie-Luce Viaud, 2017. "The Production of Information in an Online World: Is Copy Right?," Working Papers hal-03393171, HAL.
    15. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    16. Tetsuro Kobayashi & Fumiaki Taka & Takahisa Suzuki, 2021. "Can “Googling” correct misbelief? Cognitive and affective consequences of online search," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-16, September.
    17. Dean Neu & Gregory D. Saxton & Abu S. Rahaman, 2022. "Social Accountability, Ethics, and the Occupy Wall Street Protests," Journal of Business Ethics, Springer, vol. 180(1), pages 17-31, September.
    18. Robbett, Andrea & Matthews, Peter Hans, 2018. "Partisan bias and expressive voting," Journal of Public Economics, Elsevier, vol. 157(C), pages 107-120.
    19. Henrik Skaug Sætra, 2021. "AI in Context and the Sustainable Development Goals: Factoring in the Unsustainability of the Sociotechnical System," Sustainability, MDPI, vol. 13(4), pages 1-19, February.
    20. Fathey Mohammed & Nabil Hasan Al-Kumaim & Ahmed Ibrahim Alzahrani & Yousef Fazea, 2023. "The Impact of Social Media Shared Health Content on Protective Behavior against COVID-19," IJERPH, MDPI, vol. 20(3), pages 1-16, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:33:y:2022:i:3:p:887-907. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.