IDEAS home Printed from https://ideas.repec.org/p/feb/natura/00574.html
   My bibliography  Save this paper

Does Social Interaction Improve Learning Outcomes? Field Evidence from Massive Open Online Education

Author

Listed:
  • Gad Allon
  • Jan Van Mieghem
  • Dennis Zhang

Abstract

This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in Massive Open Online Courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30; 317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3%. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-on-one synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10% in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.

Suggested Citation

  • Gad Allon & Jan Van Mieghem & Dennis Zhang, 2016. "Does Social Interaction Improve Learning Outcomes? Field Evidence from Massive Open Online Education," Natural Field Experiments 00574, The Field Experiments Website.
    • Handle: RePEc:feb:natura:00574
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00574.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bing Jing, 2011. "Social Learning and Dynamic Pricing of Durable Goods," Marketing Science, INFORMS, vol. 30(5), pages 851-865, September.
    2. Mary A. Burke & Tim R. Sass, 2013. "Classroom Peer Effects and Student Achievement," Journal of Labor Economics, University of Chicago Press, vol. 31(1), pages 51-82.
    3. Victor Lavy & Analia Schlosser, 2011. "Mechanisms and Impacts of Gender Peer Effects at School," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 1-33, April.
    4. Armin Falk & Andrea Ichino, 2006. "Clean Evidence on Peer Effects," Journal of Labor Economics, University of Chicago Press, vol. 24(1), pages 39-58, January.
    5. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    6. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    7. David S. Lyle, 2007. "Estimating and Interpreting Peer and Role Model Effects from Randomly Assigned Social Groups at West Point," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 289-299, May.
    8. David J. Zimmerman, 2003. "Peer Effects in Academic Outcomes: Evidence from a Natural Experiment," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 9-23, February.
    9. Naor, P, 1969. "The Regulation of Queue Size by Levying Tolls," Econometrica, Econometric Society, vol. 37(1), pages 15-24, January.
    10. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    11. Caroline Hoxby, 2000. "Peer Effects in the Classroom: Learning from Gender and Race Variation," NBER Working Papers 7867, National Bureau of Economic Research, Inc.
    12. Victor Lavy & Analía Schlosser, 2011. "Corrigendum: Mechanisms and Impacts of Gender Peer Effects at School," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 268-268, July.
    13. Scott A. Imberman & Adriana D. Kugler & Bruce I. Sacerdote, 2012. "Katrina's Children: Evidence on the Structure of Peer Effects from Hurricane Evacuees," American Economic Review, American Economic Association, vol. 102(5), pages 2048-2082, August.
    14. Epple, Dennis & Romano, Richard E, 1998. "Competition between Private and Public Schools, Vouchers, and Peer-Group Effects," American Economic Review, American Economic Association, vol. 88(1), pages 33-62, March.
    15. Jane Cooley Fruehwirth, 2014. "Can Achievement Peer Effect Estimates Inform Policy? A View from Inside the Black Box," The Review of Economics and Statistics, MIT Press, vol. 96(3), pages 514-523, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis J. Zhang & Gad Allon & Jan A. Van Mieghem, 2017. "Does Social Interaction Improve Learning Outcomes? Evidence from Field Experiments on Massive Open Online Courses," Manufacturing & Service Operations Management, INFORMS, vol. 19(3), pages 347-367, July.
    2. Silvia Mendolia & Alfredo R Paloyo & Ian Walker, 2018. "Heterogeneous effects of high school peers on educational outcomes," Oxford Economic Papers, Oxford University Press, vol. 70(3), pages 613-634.
    3. Ozkan Eren, 2016. "Differential Peer Effects, Student Achievement, and Student Absenteeism: Evidence from a Large Scale Randomized Experiment," Departmental Working Papers 2016-01, Department of Economics, Louisiana State University.
    4. Wang, Haining & Cheng, Zhiming & Smyth, Russell, 2018. "Do migrant students affect local students’ academic achievements in urban China?," Economics of Education Review, Elsevier, vol. 63(C), pages 64-77.
    5. Ozkan Eren, 2017. "Differential Peer Effects, Student Achievement, and Student Absenteeism: Evidence From a Large-Scale Randomized Experiment," Demography, Springer;Population Association of America (PAA), vol. 54(2), pages 745-773, April.
    6. Berlinski, Samuel & Busso, Matias & Giannola, Michele, 2023. "Helping struggling students and benefiting all: Peer effects in primary education," Journal of Public Economics, Elsevier, vol. 224(C).
    7. Alexandra de Gendre & Nicolás Salamanca, 2020. "On the Mechanisms of Ability Peer Effects," Melbourne Institute Working Paper Series wp2020n19, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    8. Zhao, Liqiu & Zhao, Zhong, 2021. "Disruptive Peers in the Classroom and Students’ Academic Outcomes: Evidence and Mechanisms," Labour Economics, Elsevier, vol. 68(C).
    9. Michela Maria Tincani, 2017. "Heterogeneous Peer Effects and Rank Concerns: Theory and Evidence," CESifo Working Paper Series 6331, CESifo.
    10. Stephen Gibbons & Shqiponja Telhaj, 2016. "Peer Effects: Evidence from Secondary School Transition in England," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(4), pages 548-575, August.
    11. Clifton-Sprigg, Joanna, 2015. "Educational spillovers and parental migration," Labour Economics, Elsevier, vol. 34(C), pages 64-75.
    12. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    13. Zhang, Hongliang, 2016. "The role of testing noise in the estimation of achievement-based peer effects," Economics of Education Review, Elsevier, vol. 54(C), pages 113-123.
    14. Michela Tincani, 2017. "Heterogeneous Peer Effects and Rank Concerns: Theory and Evidence," Working Papers 2017-006, Human Capital and Economic Opportunity Working Group.
    15. Yi Cao & Tao Zhou & Jian Gao, 2024. "Heterogeneous peer effects of college roommates on academic performance," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    16. Dewan, Prerna & Ray, Tridip & Roy Chaudhuri, Arka & Tater, Kirti, 2024. "Gender peer effects in high schools: Evidence from India," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 470-494.
    17. Pan, Zheng & Lien, Donald & Wang, Hao, 2022. "Peer effects and shadow education," Economic Modelling, Elsevier, vol. 111(C).
    18. Dimant, Eugen, 2015. "On Peer Effects: Behavioral Contagion of (Un)Ethical Behavior and the Role of Social Identity," MPRA Paper 68732, University Library of Munich, Germany.
    19. Auestad, May Linn, 2018. "The effect of low-achieving peers," Labour Economics, Elsevier, vol. 55(C), pages 178-214.
    20. Lao, Yehui, 2023. "The more male classmates, the worse: How male peers harm academic performance of a student," International Journal of Educational Development, Elsevier, vol. 103(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:natura:00574. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesca Pagnotta (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.