IDEAS home Printed from https://ideas.repec.org/a/aea/aerins/v6y2024i3p324-40.html
   My bibliography  Save this article

Zooming to Class? Experimental Evidence on College Students' Online Learning during COVID-19

Author

Listed:
  • Michael S. Kofoed
  • Lucas Gebhart
  • Dallas Gilmore
  • Ryan Moschitto

Abstract

One persistent question in higher education is the efficacy of online education. In the fall of 2020, we randomized 551 West Point students in a required introductory economics course across 12 instructors to either an online or in-person class as a response to the COVID-19 pandemic. Final grades for online students dropped by 0.215 standard deviations, a result apparent in both assignments and exams and largest for academically at-risk students. A postcourse survey finds that online students struggled to concentrate in class and felt less connected to their instructors and peers. Our results show detrimental effects for online learning.

Suggested Citation

  • Michael S. Kofoed & Lucas Gebhart & Dallas Gilmore & Ryan Moschitto, 2024. "Zooming to Class? Experimental Evidence on College Students' Online Learning during COVID-19," American Economic Review: Insights, American Economic Association, vol. 6(3), pages 324-340, September.
    • Handle: RePEc:aea:aerins:v:6:y:2024:i:3:p:324-40
    DOI: 10.1257/aeri.20230077
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20230077
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20230077.appx
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20230077.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    File URL: https://libkey.io/10.1257/aeri.20230077?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David J. Deming & Claudia Goldin & Lawrence F. Katz & Noam Yuchtman, 2015. "Can Online Learning Bend the Higher Education Cost Curve?," American Economic Review, American Economic Association, vol. 105(5), pages 496-501, May.
    2. Bilen, Eren & Matros, Alexander, 2021. "Online cheating amid COVID-19," Journal of Economic Behavior & Organization, Elsevier, vol. 182(C), pages 196-211.
    3. Scott E. Carrell & Marianne E. Page & James E. West, 2010. "Sex and Science: How Professor Gender Perpetuates the Gender Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1101-1144.
    4. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    5. David J. Deming & Michael Lovenheim & Richard Patterson, 2018. "The Competitive Effects of Online Education," NBER Chapters, in: Productivity in Higher Education, pages 259-290, National Bureau of Economic Research, Inc.
    6. Carter, Susan Payne & Greenberg, Kyle & Walker, Michael S., 2017. "The impact of computer usage on academic performance: Evidence from a randomized trial at the United States Military Academy," Economics of Education Review, Elsevier, vol. 56(C), pages 118-132.
    7. Scott E. Carrell & Teny Maghakian & James E. West, 2011. "A's from Zzzz's? The Causal Effect of School Start Time on the Academic Achievement of Adolescents," American Economic Journal: Economic Policy, American Economic Association, vol. 3(3), pages 62-81, August.
    8. Scott E. Carrell & James E. West, 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 409-432, June.
    9. Eric P. Bettinger & Bridget Terry Long, 2005. "Do Faculty Serve as Role Models? The Impact of Instructor Gender on Female Students," American Economic Review, American Economic Association, vol. 95(2), pages 152-157, May.
    10. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    11. Brady, Ryan R. & Insler, Michael A. & Rahman, Ahmed S., 2017. "Bad Company: Understanding negative peer effects in college achievement," European Economic Review, Elsevier, vol. 98(C), pages 144-168.
    12. Eric P. Bettinger & Lindsay Fox & Susanna Loeb & Eric S. Taylor, 2017. "Virtual Classrooms: How Online College Courses Affect Student Success," American Economic Review, American Economic Association, vol. 107(9), pages 2855-2875, September.
    13. Coates, Dennis & Humphreys, Brad R. & Kane, John & Vachris, Michelle A., 2004. ""No significant distance" between face-to-face and online instruction: evidence from principles of economics," Economics of Education Review, Elsevier, vol. 23(5), pages 533-546, October.
    14. Daniel A. Collier & Dan Fitzpatrick & Madison Dell & Samuel S. Snideman & Christopher R. Marsicano & Robert Kelchen & Kevin E. Wells, 2022. "We Want You Back: Uncovering the Effects on In-Person Instructional Operations in Fall 2020," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(5), pages 741-767, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    2. Hill, Andrew J. & LoPalo, Melissa, 2024. "The effects of online vs in-class testing in moderate-stakes college environments," Economics of Education Review, Elsevier, vol. 98(C).
    3. Benjamin Hansen & Joseph J. Sabia & Jessamyn Schaller, 2022. "Schools, Job Flexibility, and Married Women's Labor Supply," NBER Working Papers 29660, National Bureau of Economic Research, Inc.
    4. Ragni, Alessandra & Ippolito, Daniel & Masci, Chiara, 2024. "Assessing the impact of hybrid teaching on students’ academic performance via multilevel propensity score-based techniques," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    5. Gortazar, Lucas & Hupkau, Claudia & Roldán-Monés, Antonio, 2024. "Online tutoring works: Experimental evidence from a program with vulnerable children," Journal of Public Economics, Elsevier, vol. 232(C).
    6. Todd McFall & John Whitehead, 2024. "Measuring the Impact of the COVID-19 Pandemic on Elite Swimming Performance," Journal of Sports Economics, , vol. 25(5), pages 634-656, June.
    7. Badruddoza, Syed & Amin, Modhurima Dey, 2023. "Impacts of Teaching Modality on U.S. COVID-19 Spread in Fall 2020 Semester," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 5(1), January.
    8. Kenneth G. Elzinga & Daniel Q. Harper, 2023. "In‐person versus online instruction: Evidence from principles of economics," Southern Economic Journal, John Wiley & Sons, vol. 90(1), pages 3-30, July.
    9. Maria De Paola & Francesca Gioia & Vincenzo Scoppa, 2022. "Online Teaching, Procrastination And Students’ Achievement: Evidence From Covid-19 Induced Remote Learning," Working Papers 202202, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    10. DI PIETRO Giorgio, 2023. "The impact of Covid-19 physical school closure on student performance in OECD countries: a meta-analysis," JRC Research Reports JRC134506, Joint Research Centre.
    11. Anja Žnidaršič & Alenka Brezavšček & Gregor Rus & Janja Jerebic, 2022. "Has the COVID-19 Pandemic Affected Mathematics Achievement? A Case Study of University Students in Social Sciences," Mathematics, MDPI, vol. 10(13), pages 1-23, July.
    12. Elisa Failache & Nicolás Fiori & Noemi Katzkowicz & Alina Machado & Luciana Méndez, 2022. "Impact of COVID-19 on higher education: Evidence from Uruguay," Documentos de Trabajo (working papers) 22-02, Instituto de Economía - IECON.
    13. Picault, Julien, 2021. "Structure, Flexibility, and Consistency: A Dynamic Learning Approach for an Online Asynchronous Course," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 3(4), October.
    14. Rodríguez-Planas, Núria, 2022. "Hitting where it hurts most: COVID-19 and low-income urban college students," Economics of Education Review, Elsevier, vol. 87(C).
    15. Mustafa Uğraş & Erdal Zengin & Stamatis Papadakis & Michail Kalogiannakis, 2023. "Early Childhood Learning Losses during COVID-19: Systematic Review," Sustainability, MDPI, vol. 15(7), pages 1-29, April.
    16. Duha Altindag & Samuel Cole & R. Alan Seals Jr, 2022. "The Price of COVID-19 Risk in a Public University," Papers 2204.00894, arXiv.org.
    17. Benjamin Hansen & Joseph J. Sabia & Jessamyn Schaller, 2022. "In-Person Schooling and Youth Suicide: Evidence from School Calendars and Pandemic School Closures," NBER Working Papers 30795, National Bureau of Economic Research, Inc.
    18. Samaniego,Roberto & Jedwab,Remi Camille & Romer,Paul M & Islam,Asif Mohammed, 2022. "Scars of Pandemics from Lost Schooling and Experience : Aggregate Implications and Gender DifferencesThrough the Lens of COVID-19," Policy Research Working Paper Series 9932, The World Bank.
    19. Bandar N. Alarifi & Steve Song, 2024. "Online vs in-person learning in higher education: effects on student achievement and recommendations for leadership," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-8, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haggag, Kareem & Patterson, Richard W. & Pope, Nolan G. & Feudo, Aaron, 2021. "Attribution bias in major decisions: Evidence from the United States Military Academy," Journal of Public Economics, Elsevier, vol. 200(C).
    2. Marina Bassi & Lelys Dinarte-Diaz & Maria Marta Ferreyra & Sergio Urzua, 2023. "What Makes a Program Good? Evidence from Short-Cycle Higher Education Programs in Five Developing Countries," CESifo Working Paper Series 10255, CESifo.
    3. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    4. Wayne A Grove x & Stephen Wu, 2011. "Factors Influencing Student Performance in Economics: Class and Instructor Characteristics," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 33, Edward Elgar Publishing.
    5. Ellis, Jimmy R. & Gershenson, Seth, 2016. "LATE for the Meeting: Gender, Peer Advising, and College Success," IZA Discussion Papers 9956, Institute of Labor Economics (IZA).
    6. Griffith, Amanda L. & Main, Joyce B., 2019. "First impressions in the classroom: How do class characteristics affect student grades and majors?," Economics of Education Review, Elsevier, vol. 69(C), pages 125-137.
    7. Lester Lusher & Vasil Yasenov, 2018. "Gender Performance Gaps: Quasi‐Experimental Evidence On The Role Of Gender Differences In Sleep Cycles," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 252-262, January.
    8. Richard W. Patterson & Nolan G. Pope & Aaron Feudo, 2019. "Timing is Everything: Evidence from College Major Decisons," CESifo Working Paper Series 7448, CESifo.
    9. Ellis, Jimmy R. & Gershenson, Seth, 2020. "Gender, peer advising, and college success," Labour Economics, Elsevier, vol. 62(C).
    10. Maria De Paola & Francesca Gioia & Vincenzo Scoppa, 2022. "Online Teaching, Procrastination And Students’ Achievement: Evidence From Covid-19 Induced Remote Learning," Working Papers 202202, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    11. Eble, Alex & Hu, Feng, 2020. "Child beliefs, societal beliefs, and teacher-student identity match," Economics of Education Review, Elsevier, vol. 77(C).
    12. Marigee Bacolod & Stephen Mehay & Elda Pema, 2018. "Who succeeds in distance learning? Evidence from quantile panel data estimation," Southern Economic Journal, John Wiley & Sons, vol. 84(4), pages 1129-1145, April.
    13. Lusher, Lester & Campbell, Doug & Carrell, Scott, 2018. "TAs like me: Racial interactions between graduate teaching assistants and undergraduates," Journal of Public Economics, Elsevier, vol. 159(C), pages 203-224.
    14. Sam Allgood & William B. Walstad & John J. Siegfried, 2015. "Research on Teaching Economics to Undergraduates," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 285-325, June.
    15. Hisanobu Kakizawa, 2017. "The Effects of Student-Teacher Gender Matching on Students f Performance in Junior High Schools in Japan," Discussion Papers in Economics and Business 17-29, Osaka University, Graduate School of Economics.
    16. Dinarte Diaz,Lelys Ileana & Ferreyra,Maria Marta & Urzua,Sergio & Bassi,Marina, 2021. "What Makes a Program Good ? Evidence from Short-Cycle Higher Education Programs in LatinAmerica and the Caribbean," Policy Research Working Paper Series 9722, The World Bank.
    17. Boring, Anne, 2017. "Gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 145(C), pages 27-41.
    18. James V. Koch & Ziniya Zahedi, 2019. "The effects of role models on college graduation rates," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 43(3), pages 607-617, July.
    19. Danilowicz-Gösele, Kamila, 2016. ""A" is the aim?," University of Göttingen Working Papers in Economics 291, University of Goettingen, Department of Economics.
    20. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).

    More about this item

    JEL classification:

    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aerins:v:6:y:2024:i:3:p:324-40. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.