IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/16089.html
   My bibliography  Save this paper

Is it Live or is it Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning

Author

Listed:
  • David N. Figlio
  • Mark Rush
  • Lu Yin

Abstract

This paper presents the first experimental evidence on the effects of live versus internet media of instruction. Students in a large introductory microeconomics course at a major research university were randomly assigned to live lectures versus watching these same lectures in an internet setting, where all other factors (e.g., instruction, supplemental materials) were the same. Counter to the conclusions drawn by a recent U.S. Department of Education meta-analysis of non-experimental analyses of internet instruction in higher education, we find modest evidence that live-only instruction dominates internet instruction. These results are particularly strong for Hispanic students, male students, and lower-achieving students. We also provide suggestions for future experimentation in other settings.

Suggested Citation

  • David N. Figlio & Mark Rush & Lu Yin, 2010. "Is it Live or is it Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," NBER Working Papers 16089, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:16089
    Note: CH ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w16089.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    2. Byron W. Brown & Carl E. Liedholm, 2002. "Can Web Courses Replace the Classroom in Principles of Microeconomics?," American Economic Review, American Economic Association, vol. 92(2), pages 444-448, May.
    3. Colleen Donovan & David N. Figlio & Mark Rush, 2006. "Cramming: The Effects of School Accountability on College-Bound Students," NBER Working Papers 12628, National Bureau of Economic Research, Inc.
    4. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    5. Figlio, David & Loeb, Susanna, 2011. "School Accountability," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 8, pages 383-421, Elsevier.
    6. P. Navarro & J. Shoemaker, 2000. "Policy issues in the teaching of economics in cyberspace: research design, course design, and research results," Contemporary Economic Policy, Western Economic Association International, vol. 18(3), pages 359-366, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    2. Stephen Machin & Sandra McNally & Martina Viarengo, 2018. "Changing How Literacy Is Taught: Evidence on Synthetic Phonics," American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
    3. Roland G. Fryer, Jr & Tanaya Devi & Richard T. Holden, 2012. "Vertical versus Horizontal Incentives in Education: Evidence from Randomized Trials," NBER Working Papers 17752, National Bureau of Economic Research, Inc.
    4. Martin Huber, 2010. "Identification of average treatment effects in social experiments under different forms of attrition," University of St. Gallen Department of Economics working paper series 2010 2010-22, Department of Economics, University of St. Gallen.
    5. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    6. Maria De Paola & Vincenzo Scoppa & Rosanna Nisticò, 2012. "Monetary Incentives and Student Achievement in a Depressed Labor Market: Results from a Randomized Experiment," Journal of Human Capital, University of Chicago Press, vol. 6(1), pages 56-85.
    7. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    8. Bonilla-Mejía, Leonardo & Galvis-Aponte, Luis Armando, 2014. "Profesionalización docente y calidad de la educación escolar en Colombia," Chapters, in: Sánchez Jabba, Andrés & Otero Cortés, Andrea (ed.), Educación y desarrollo regional en Colombia, chapter 5, pages 161-209, Banco de la Republica de Colombia.
    9. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    10. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    11. Martin Huber & Anna Solovyeva, 2020. "Direct and Indirect Effects under Sample Selection and Outcome Attrition," Econometrics, MDPI, vol. 8(4), pages 1-25, December.
    12. Martin Huber, 2012. "Identification of Average Treatment Effects in Social Experiments Under Alternative Forms of Attrition," Journal of Educational and Behavioral Statistics, , vol. 37(3), pages 443-474, June.
    13. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    14. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    15. Oliveira, Pedro Rodrigues de & Belluzzo, Walter & Pazello, Elaine Toldo, 2013. "The public–private test score gap in Brazil," Economics of Education Review, Elsevier, vol. 35(C), pages 120-133.
    16. McCarthy, Mary & Kusaila, Michelle & Grasso, Lawrence, 2019. "Intermediate accounting and auditing: Does course delivery mode impact student performance?," Journal of Accounting Education, Elsevier, vol. 46(C), pages 26-42.
    17. Perri, Timothy, 2016. "Online education, signaling, and human capital," Information Economics and Policy, Elsevier, vol. 36(C), pages 69-74.
    18. Sarah B. Cosgrove & Neal H. Olitsky, 2015. "Knowledge retention, student learning, and blended course work: Evidence from principles of economics courses," Southern Economic Journal, John Wiley & Sons, vol. 82(2), pages 556-579, October.
    19. Andersson, Christian, 2007. "Teacher density and student achievement in Swedish compulsory schools," Working Paper Series 2007:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    20. Juan A. Correa & Francisco Parro & Loreto Reyes, 2014. "The Effects of Vouchers on School Results: Evidence from Chile's Targeted Voucher Program," Journal of Human Capital, University of Chicago Press, vol. 8(4), pages 351-398.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Economic Logic blog

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:16089. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.