IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v163y2023ics0304387823000639.html
   My bibliography  Save this article

Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan

Author

Listed:
  • Ali, Ayesha
  • Qazi, Ihsan Ayyub

Abstract

Fake news is a growing problem in developing countries with potentially far-reaching consequences. This paper evaluates the effectiveness of two educational interventions to counter misinformation among low digital literacy populations in urban Pakistan using a randomized experiment. We find no evidence that video-based general educational messages about misinformation have any statistically significant impact on the ability to correctly identify news items as true or fake. However, when such messages are augmented with personalized feedback based on individuals’ past engagement with fake news, we find an improvement of 3.3 percentage points or 4.5 percent in correctly identifying news (true or fake) relative to the control group. Our results suggest that educational interventions can enable information discernment but their effectiveness depends on how well their features and delivery are customized for the population of interest.

Suggested Citation

  • Ali, Ayesha & Qazi, Ihsan Ayyub, 2023. "Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan," Journal of Development Economics, Elsevier, vol. 163(C).
    • Handle: RePEc:eee:deveco:v:163:y:2023:i:c:s0304387823000639
    DOI: 10.1016/j.jdeveco.2023.103108
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387823000639
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103108?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    2. Diva Dhar & Tarun Jain & Seema Jayachandran, 2022. "Reshaping Adolescents' Gender Attitudes: Evidence from a School-Based Experiment in India," American Economic Review, American Economic Association, vol. 112(3), pages 899-927, March.
    3. Stefano DellaVigna & Matthew Gentzkow, 2010. "Persuasion: Empirical Evidence," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 643-669, September.
    4. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    5. Richard H. Thaler & Shlomo Benartzi, 2004. "Save More Tomorrow (TM): Using Behavioral Economics to Increase Employee Saving," Journal of Political Economy, University of Chicago Press, vol. 112(S1), pages 164-187, February.
    6. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    7. Allcott, Hunt & Boxell, Levi & Conway, Jacob & Gentzkow, Matthew & Thaler, Michael & Yang, David, 2020. "Polarization and public health: Partisan differences in social distancing during the coronavirus pandemic," Journal of Public Economics, Elsevier, vol. 191(C).
    8. Christopher J. Doss & Erin M. Fahle & Susanna Loeb & Benjamin N. York, 2018. "More than Just a Nudge: Supporting Kindergarten Parents with Differentiated and Personalized Text-Messages," NBER Working Papers 24450, National Bureau of Economic Research, Inc.
    9. repec:cup:judgdm:v:8:y:2013:i:4:p:407-424 is not listed on IDEAS
    10. Kahan, Dan M. & Peters, Ellen & Dawson, Erica Cantrell & Slovic, Paul, 2017. "Motivated numeracy and enlightened self-government," Behavioural Public Policy, Cambridge University Press, vol. 1(1), pages 54-86, May.
    11. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.
    12. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    13. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    14. Levi Boxell & Matthew Gentzkow & Jesse M. Shapiro, 2024. "Cross-Country Trends in Affective Polarization," The Review of Economics and Statistics, MIT Press, vol. 106(2), pages 557-565, March.
    15. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    16. Jamil, Sadia, 2021. "From digital divide to digital inclusion: Challenges for wide-ranging digitalization in Pakistan," Telecommunications Policy, Elsevier, vol. 45(8).
    17. repec:cup:judgdm:v:8:y:2013:i:5:p:540-551 is not listed on IDEAS
    18. Matthew Gentzkow & Jesse M. Shapiro, 2006. "Media Bias and Reputation," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 280-316, April.
    19. Pogorelskiy, Kirill & Shum, Matthew, 2019. "News We Like to Share: How News Sharing on Social Networks Influences Voting Outcomes," CAGE Online Working Paper Series 427, Competitive Advantage in the Global Economy (CAGE).
    20. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," PSE-Ecole d'économie de Paris (Postprint) halshs-03342759, HAL.
    21. Pogorelskiy. Kirill & Shum, Matthew, 2019. "News We Like to Share : How News Sharing on Social Networks Influences Voting Outcomes," The Warwick Economics Research Paper Series (TWERPS) 1199, University of Warwick, Department of Economics.
    22. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    23. Sendhil Mullainathan & Andrei Shleifer, 2005. "The Market for News," American Economic Review, American Economic Association, vol. 95(4), pages 1031-1053, September.
    24. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," Post-Print halshs-03342759, HAL.
    25. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    26. Sendhil Mullainathan & Andrei Shleifer, 2005. "The Market for News," American Economic Review, American Economic Association, vol. 95(4), pages 1031-1053, September.
    27. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    28. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    29. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bandiera, Antonella & , Rojas Daniel, 2024. "Misinformation among Migrants: Evidence from Mexico and Colombia," OSF Preprints md42a, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayesha Ali & Ihsan Ayyub Qazi, 2021. "Countering Misinformation on Social Media Through Educational Interventions: Evidence from a Randomized Experiment in Pakistan," Papers 2107.02775, arXiv.org.
    2. Dana Sisak & Philipp Denter, 2024. "Information Sharing with Social Image Concerns and the Spread of Fake News," Papers 2410.19557, arXiv.org, revised Oct 2024.
    3. Choi, Syngjoo & Choi, Chung-Yoon & Kim, Seonghoon, 2023. "Tackling misperceptions about immigrants with fact-checking interventions: A randomized survey experiment," Labour Economics, Elsevier, vol. 84(C).
    4. Felix Chopra & Ingar K. Haaland & Christopher Roth, 2019. "Do People Value More Informative News?," CESifo Working Paper Series 8026, CESifo.
    5. Andrea Mattozzi & Samuel Nocito & Francesco Sobbrio, 2022. "Fact-Checking Politicians," CESifo Working Paper Series 10122, CESifo.
    6. Cariolle, Joël & Elkhateeb, Yasmine & Maurel, Mathilde, 2024. "Misinformation technology: Internet use and political misperceptions in Africa," Journal of Comparative Economics, Elsevier, vol. 52(2), pages 400-433.
    7. McNamara, Trent & Mosquera, Roberto, 2024. "The political divide: The case of expectations and preferences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 110(C).
    8. Germano, Fabrizio & Sobbrio, Francesco, 2020. "Opinion dynamics via search engines (and other algorithmic gatekeepers)," Journal of Public Economics, Elsevier, vol. 187(C).
    9. Cagé, Julia, 2017. "Media Competition, Information Provision and Political Participation: Evidence from French Local Newspapers and Elections, 1944," CEPR Discussion Papers 12198, C.E.P.R. Discussion Papers.
    10. Chopra, Felix & Haaland, Ingar & Roth, Christopher, 2022. "Do people demand fact-checked news? Evidence from U.S. Democrats," Journal of Public Economics, Elsevier, vol. 205(C).
    11. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    12. Cagé, Julia, 2020. "Media competition, information provision and political participation: Evidence from French local newspapers and elections, 1944–2014," Journal of Public Economics, Elsevier, vol. 185(C).
    13. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    14. Julia Cage, 2017. "Media Competition, Information Provision and Political Participation: Evidence from French Local Newspapers and Elections, 1944-2014," SciencePo Working papers hal-03393164, HAL.
    15. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    16. Sergei Guriev & Elias Papaioannou, 2022. "The Political Economy of Populism," Journal of Economic Literature, American Economic Association, vol. 60(3), pages 753-832, September.
    17. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    18. Besley, Timothy & Fetzer, Thiemo & Mueller, Hannes, 2019. "Terror and Tourism: The Economic Consequences of Media Coverage," CAGE Online Working Paper Series 449, Competitive Advantage in the Global Economy (CAGE).
    19. Dejean, Sylvain & Lumeau, Marianne & Peltier, Stéphanie, 2022. "Partisan selective exposure in news consumption," Information Economics and Policy, Elsevier, vol. 60(C).
    20. Lin Hu & Anqi Li & Ilya Segal, 2019. "The Politics of Personalized News Aggregation," Papers 1910.11405, arXiv.org, revised Nov 2022.

    More about this item

    Keywords

    Social media; Fake news; Misinformation; Beliefs; Education; Digital literacy;
    All these keywords.

    JEL classification:

    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:163:y:2023:i:c:s0304387823000639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.