IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v183y2020i3p1075-1096.html
   My bibliography  Save this article

A placebo design to detect spillovers from an education–entertainment experiment in Uganda

Author

Listed:
  • Anna M. Wilke
  • Donald P. Green
  • Jasper Cooper

Abstract

Education–entertainment refers to dramatizations designed to convey information and to change attitudes. Buoyed by observational studies suggesting that education–entertainment strongly influences beliefs, attitudes and behaviours, scholars have recently assessed education–entertainment by using rigorous experimental designs in field settings. Studies conducted in developing countries have repeatedly shown the effectiveness of radio and film dramatizations on outcomes ranging from health to group conflict. One important gap in the literature is estimation of social spillover effects from those exposed to the dramatizations to others in the audience members’ social network. In theory, the social diffusion of media effects could greatly amplify their policy impact. The current study uses a novel placebo‐controlled design that gauges both the direct effects of the treatment on audience members as well as the indirect effects of the treatment on others in their family and in the community. We implement this design in two large cluster‐randomized experiments set in rural Uganda using video dramatizations on the topics of violence against women, teacher absenteeism and abortion stigma. We find several instances of sizable and highly significant direct effects on the attitudes of audience members, but we find little evidence that these effects diffused to others in the villages where the videos were aired.

Suggested Citation

  • Anna M. Wilke & Donald P. Green & Jasper Cooper, 2020. "A placebo design to detect spillovers from an education–entertainment experiment in Uganda," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1075-1096, June.
  • Handle: RePEc:bla:jorssa:v:183:y:2020:i:3:p:1075-1096
    DOI: 10.1111/rssa.12571
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12571
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12571?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abhijit Banerjee & Sharon Barnhardt & Esther Duflo, 2015. "Movies, Margins, and Marketing: Encouraging the Adoption of Iron-Fortified Salt," NBER Chapters, in: Insights in the Economics of Aging, pages 285-306, National Bureau of Economic Research, Inc.
    2. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    3. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    4. Constantine E. Frangakis & Donald B. Rubin & Ming-Wen An & Ellen MacKenzie, 2007. "Principal Stratification Designs to Estimate Input Data Missing Due to Death," Biometrics, The International Biometric Society, vol. 63(3), pages 641-649, September.
    5. Eliana La Ferrara & Alberto Chong & Suzanne Duryea, 2012. "Soap Operas and Fertility: Evidence from Brazil," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 1-31, October.
    6. Betsy Sinclair & Margaret McConnell & Donald P. Green, 2012. "Detecting Spillover Effects: Design and Analysis of Multilevel Experiments," American Journal of Political Science, John Wiley & Sons, vol. 56(4), pages 1055-1069, October.
    7. Galiani, Sebastian & Gertler, Paul & Orsola-Vidal, Alexandra, 2012. "Promoting handwashing behavior in Peru : the effect of large-scale mass-media and community level interventions," Policy Research Working Paper Series 6257, The World Bank.
    8. Kalla, Joshua L. & Broockman, David E., 2018. "The Minimal Persuasive Effects of Campaign Contact in General Elections: Evidence from 49 Field Experiments," American Political Science Review, Cambridge University Press, vol. 112(1), pages 148-166, February.
    9. Brian L. Egleston & Daniel O. Scharfstein & Ellen MacKenzie, 2009. "On Estimation of the Survivor Average Causal Effect in Observational Studies When Important Confounders Are Missing Due to Death," Biometrics, The International Biometric Society, vol. 65(2), pages 497-504, June.
    10. Paluck, Elizabeth Levy & Green, Donald P., 2009. "Deference, Dissent, and Dispute Resolution: An Experimental Intervention Using Mass Media to Change Norms and Behavior in Rwanda," American Political Science Review, Cambridge University Press, vol. 103(4), pages 622-644, November.
    11. Jason Fletcher & Ryne Marksteiner, 2017. "Causal Spousal Health Spillover Effects and Implications for Program Evaluation," American Economic Journal: Economic Policy, American Economic Association, vol. 9(4), pages 144-166, November.
    12. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    13. World Bank, 2016. "World Development Indicators 2016," World Bank Publications - Books, The World Bank Group, number 23969.
    14. Benjamin-Chung, Jade & Arnold, Benjamin F & Berger, David & Luby, Stephen P & Miguel, Edward & Colford, John M & Hubbard, Alan E, 2018. "Spillover effects in epidemiology: parameters, study designs and methodological considerations," Department of Economics, Working Paper Series qt1547q2zg, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    15. Gerber, Alan S. & Green, Donald P. & Kaplan, Edward H. & Kern, Holger L., 2010. "Baseline, Placebo, and Treatment: Efficient Estimation for Three-Group Experiments," Political Analysis, Cambridge University Press, vol. 18(3), pages 297-315, July.
    16. Nickerson, David W., 2008. "Is Voting Contagious? Evidence from Two Field Experiments," American Political Science Review, Cambridge University Press, vol. 102(1), pages 49-57, February.
    17. Arthur Alik‐Lagrange & Martin Ravallion, 2019. "Estimating within‐cluster spillover effects using a cluster randomization with application to knowledge diffusion in rural India," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(1), pages 110-128, January.
    18. Ricardo Perez-Truglia & Guillermo Cruces, 2017. "Partisan Interactions: Evidence from a Field Experiment in the United States," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 1208-1243.
    19. David A. Wise, 2017. "Insights in the Economics of Aging," NBER Books, National Bureau of Economic Research, Inc, number wise-21.
    20. Jack Cuzick & Peter Sasieni & Jonathan Myles & Jonathan Tyrer, 2007. "Estimating the effect of treatment in a proportional hazards model in the presence of non‐compliance and contamination," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 565-588, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.
    2. Alex Armand & Paul Atwell & Joseph F. Gomes & Yannik Schenk, 2023. "It’s a Bird, it’s a Plane, it’s Superman! Using Mass Media to fight Intolerance," LIDAM Discussion Papers IRES 2023012, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    3. Grady, Christopher & Iannantuoni, Alice & Winters, Matthew S., 2021. "Influencing the means but not the ends: The role of entertainment-education interventions in development," World Development, Elsevier, vol. 138(C).
    4. Kosuke Imai & Zhichao Jiang, 2020. "Identification and sensitivity analysis of contagion effects in randomized placebo‐controlled trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1637-1657, October.
    5. Florian Foos & Eline A. de Rooij, 2017. "All in the Family: Partisan Disagreement and Electoral Mobilization in Intimate Networks—A Spillover Experiment," American Journal of Political Science, John Wiley & Sons, vol. 61(2), pages 289-304, April.
    6. Kjetil Bjorvatn & Alexander W. Cappelen & Linda Helgesson Sekei & Erik Ø. Sørensen & Bertil Tungodden, 2020. "Teaching Through Television: Experimental Evidence on Entrepreneurship Education in Tanzania," Management Science, INFORMS, vol. 66(6), pages 2308-2325, June.
    7. Renos Vakis & Jamele Rigolini & Leonardo Lucchetti, 2016. "Left Behind [Los olvidados : pobreza crónica en América Latina y el Caribe - resumen ejecutivo]," World Bank Publications - Books, The World Bank Group, number 21552.
    8. Yi He & Linzhi Zheng & Peng Luo, 2023. "Treatment Benefit and Treatment Harm Rates with Nonignorable Missing Covariate, Endpoint, or Treatment," Mathematics, MDPI, vol. 11(21), pages 1-18, October.
    9. Alberto Chong & Gianmarco León‐Ciliotta & Vivian Roza & Martín Valdivia & Gabriela Vega, 2019. "Urbanization Patterns, Information Diffusion, and Female Voting in Rural Paraguay," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 323-341, April.
    10. Legge, Stefan & Schmid, Lukas, 2016. "Media attention and betting markets," European Economic Review, Elsevier, vol. 87(C), pages 304-333.
    11. Maria Josefsson & Michael J. Daniels, 2021. "Bayesian semi‐parametric G‐computation for causal inference in a cohort study with MNAR dropout and death," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(2), pages 398-414, March.
    12. Eliana La Ferrara, 2016. "Mass Media And Social Change: Can We Use Television To Fight Poverty?," Journal of the European Economic Association, European Economic Association, vol. 14(4), pages 791-827, August.
    13. Abhijit Banerjee & Sharon Barnhardt & Esther Duflo, 2015. "Movies, Margins, and Marketing: Encouraging the Adoption of Iron-Fortified Salt," NBER Chapters, in: Insights in the Economics of Aging, pages 285-306, National Bureau of Economic Research, Inc.
    14. Leonardo Bursztyn & Ingar K. Haaland & Aakaash Rao & Christopher P. Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," NBER Working Papers 27288, National Bureau of Economic Research, Inc.
    15. Caroline Le Pennec & Vincent Pons, 2023. "How do Campaigns Shape Vote Choice? Multicountry Evidence from 62 Elections and 56 TV Debates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(2), pages 703-767.
    16. Kai Jäger, 2020. "When Do Campaign Effects Persist for Years? Evidence from a Natural Experiment," American Journal of Political Science, John Wiley & Sons, vol. 64(4), pages 836-851, October.
    17. Stephens Alisa & Keele Luke & Joffe Marshall, 2016. "Generalized Structural Mean Models for Evaluating Depression as a Post-treatment Effect Modifier of a Jobs Training Intervention," Journal of Causal Inference, De Gruyter, vol. 4(2), pages 1-17, September.
    18. Hoff, Karla & Stiglitz, Joseph E., 2016. "Striving for balance in economics: Towards a theory of the social determination of behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PB), pages 25-57.
    19. Donati,Dante & Orozco Olvera,Victor Hugo & Rao,Nandan Mark, 2022. "Using Social Media to Change Gender Norms : An Experiment within Facebook Messenger in India," Policy Research Working Paper Series 10199, The World Bank.
    20. Banerjee,Abhijit & La Ferrara,Eliana & Orozco Olvera,Victor Hugo, 2019. "The Entertaining Way to Behavioral Change : Fighting HIV with MTV," Policy Research Working Paper Series 8998, The World Bank.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:183:y:2020:i:3:p:1075-1096. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.