IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v164y2023ics030438782300069x.html
   My bibliography  Save this article

Live tutoring calls did not improve learning during the COVID-19 pandemic in Sierra Leone

Author

Listed:
  • Crawfurd, Lee
  • Evans, David K.
  • Hares, Susannah
  • Sandefur, Justin

Abstract

Education systems regularly face unexpected school closures, whether due to disease outbreaks, natural disasters, or other adverse shocks. In low-income countries where internet access is scarce, distance learning – the most common educational solution – is often passive, via TV or radio, with little opportunity for teacher–student interaction. In this paper we evaluate the effectiveness of live tutoring calls from teachers, designed to supplement radio instruction during the 2020 school closures prompted by the COVID-19 pandemic. We do this with a randomised controlled trial with 4,399 primary school students in Sierra Leone. Tutoring calls led to some limited increase in educational activity, but had no effect on mathematics or language test scores, whether for girls or boys, and whether provided by public or private school teachers. Even having received tutoring calls, one in three children reported not listening to educational radio at all, so limited take-up may partly explain our results.

Suggested Citation

  • Crawfurd, Lee & Evans, David K. & Hares, Susannah & Sandefur, Justin, 2023. "Live tutoring calls did not improve learning during the COVID-19 pandemic in Sierra Leone," Journal of Development Economics, Elsevier, vol. 164(C).
  • Handle: RePEc:eee:deveco:v:164:y:2023:i:c:s030438782300069x
    DOI: 10.1016/j.jdeveco.2023.103114
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030438782300069X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103114?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Edward Asiedu & Dean Karlan & Monica Lambon-Quayefio & Christopher Udry, 2021. "A call for structured ethics appendices in social science papers," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(29), pages 2024570118-, July.
    2. Noam Angrist & Peter Bergman & David K. Evans & Susannah Hares & Matthew C. H. Jukes & Thato Letsomo, 2020. "Practical Lessons for Phone-Based Assessments of Learning," Working Papers 534, Center for Global Development, revised 10 Jul 2020.
    3. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Kofi Mangesi, 2007. "Survey of ICT and Education in Africa : Sierra Leone Country Report," World Bank Publications - Reports 10657, The World Bank Group.
    6. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    7. Jason T. Kerwin & Rebecca L. Thornton, 2021. "Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 251-264, May.
    8. Christopher J. Doss & Erin M. Fahle & Susanna Loeb & Benjamin N. York, 2018. "More than Just a Nudge: Supporting Kindergarten Parents with Differentiated and Personalized Text-Messages," NBER Working Papers 24450, National Bureau of Economic Research, Inc.
    9. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    10. Berlinski, Samuel & Busso, Matías & Dinkelman, Taryn & Martínez, Claudia, 2021. "Reducing Parent-School Information Gaps and Improving Education Outcomes: Evidence from High-Frequency Text Messages," IDB Publications (Working Papers) 11234, Inter-American Development Bank.
    11. Mauricio Romero & Justin Sandefur & Wayne Aaron Sandholtz, 2020. "Outsourcing Education: Experimental Evidence from Liberia," American Economic Review, American Economic Association, vol. 110(2), pages 364-400, February.
    12. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    13. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    14. Mauricio Romero & Justin Sandefur, 2022. "Beyond Short-Term Learning Gains: the Impact of Outsourcing Schools in Liberia After Three Years," The Economic Journal, Royal Economic Society, vol. 132(644), pages 1600-1619.
    15. Kraft, Matthew A. & Rogers, Todd, 2015. "The underutilized potential of teacher-to-parent communication: Evidence from a field experiment," Economics of Education Review, Elsevier, vol. 47(C), pages 49-63.
    16. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    17. Das, Jishnu & Zajonc, Tristan, 2010. "India shining and Bharat drowning: Comparing two Indian states to the worldwide distribution in mathematics achievement," Journal of Development Economics, Elsevier, vol. 92(2), pages 175-187, July.
    18. Robert Garlick & Kate Orkin & Simon Quinn, 2020. "Call Me Maybe: Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys," The World Bank Economic Review, World Bank, vol. 34(2), pages 418-443.
    19. Bold, Tessa & Kimenyi, Mwangi & Mwabu, Germano & Ng’ang’a, Alice & Sandefur, Justin, 2018. "Experimental evidence on scaling up education reforms in Kenya," Journal of Public Economics, Elsevier, vol. 168(C), pages 1-20.
    20. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    21. Mo, Di & Luo, Renfu & Liu, Chengfang & Zhang, Huiping & Zhang, Linxiu & Medina, Alexis & Rozelle, Scott, 2014. "Text Messaging and its Impacts on the Health and Education of the Poor: Evidence from a Field Experiment in Rural China," World Development, Elsevier, vol. 64(C), pages 766-780.
    22. Barrera,Oscar & Macours,Karen & Premand,Patrick & Vakis,Renos, 2020. "Texting Parents about Early Child Development : Behavioral Changes and Unintended Social Effects," Policy Research Working Paper Series 9492, The World Bank.
    23. Rodriguez-Segura, Daniel & Schueler, Beth E., 2022. "Can learning be measured by phone? Evidence from Kenya," Economics of Education Review, Elsevier, vol. 90(C).
    24. Natalie Bau & Jishnu Das, 2020. "Teacher Value Added in a Low-Income Country," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 62-96, February.
    25. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    26. Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
    27. Guilherme Lichand & Julien Christen, 2020. "Behavioral nudges prevent student dropouts in the pandemic," ECON - Working Papers 363, Department of Economics - University of Zurich, revised Apr 2021.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Beegle, Kathleen & Dillon, Andrew & Karlan, Dean & Udry, Christopher, 2024. "Introduction to the journal of development economics special issue on methods and measurement," Journal of Development Economics, Elsevier, vol. 170(C).
    2. Cristia, Julian P. & Cueto, Santiago & Malamud, Ofer & Aulagnon, Raphaëlle, 2024. "Streaking to Success: The Effects of Highlighting Streaks on Student Effort and Achievement," IDB Publications (Working Papers) 13498, Inter-American Development Bank.
    3. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    4. Singh, Abhijeet & Romero, Mauricio & Muralidharan, Karthik, 2024. "COVID-19 Learning loss and recovery," University of California at San Diego, Economics Working Paper Series qt3jj1b8hb, Department of Economics, UC San Diego.
    5. Jakubowski,Maciej Jan & Gajderowicz,Tomasz Janusz & Patrinos,Harry Anthony, 2024. "COVID-19, School Closures, and Student Learning Outcomes : New Global Evidence from PISA," Policy Research Working Paper Series 10666, The World Bank.
    6. Elisabetta Aurino & Sharon Wolf, 2024. "A ‘smart buy' for all? Unequal and unintended consequences of a messaging program for child education," UB School of Economics Working Papers 2024/461, University of Barcelona School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    2. Abhijeet Singh & Mauricio Romero & Karthik Muralidharan, 2022. "Covid-19 Learning Loss and Recovery: Panel Data Evidence from India," CESifo Working Paper Series 10031, CESifo.
    3. Piza, Caio & Zwager, Astrid & Ruzzante, Matteo & Dantas, Rafael & Loureiro, Andre, 2024. "Teacher-led innovations to improve education outcomes: Experimental evidence from Brazil," Journal of Public Economics, Elsevier, vol. 234(C).
    4. Matteo Bobba & Tim Ederer & Gianmarco León-Ciliotta & Christopher A. Neilson & Marco Nieddu, 2021. "Teacher compensation and structural inequality: Evidence from centralized teacher school choice in Perú," Economics Working Papers 1788, Department of Economics and Business, Universitat Pompeu Fabra.
    5. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    6. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    7. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    8. David K. Evans & Fei Yuan & Deon Filmer, 2020. "Are Teachers in Africa Poorly Paid? Evidence from 15 Countries," Working Papers 538, Center for Global Development.
    9. Seth Gershenson & Cassandra M. D. Hart & Joshua Hyman & Constance A. Lindsay & Nicholas W. Papageorge, 2022. "The Long-Run Impacts of Same-Race Teachers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 300-342, November.
    10. Evans, David K. & Yuan, Fei & Filmer, Deon, 2022. "Teacher pay in Africa: Evidence from 15 countries," World Development, Elsevier, vol. 155(C).
    11. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    12. Allen, James & Mahumane, Arlete & Riddell, James & Rosenblat, Tanya & Yang, Dean & Yu, Hang, 2022. "Teaching and incentives: Substitutes or complements?," Economics of Education Review, Elsevier, vol. 91(C).
    13. Barrios-Fernández, Andrés & Riudavets-Barcons, Marc, 2024. "Teacher value-added and gender gaps in educational outcomes," Economics of Education Review, Elsevier, vol. 100(C).
    14. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    15. Cruz Aguayo, Yyannu & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    16. Maruyama, Takao & Kurosaki, Takashi, 2021. "Do remedial activities using math workbooks improve student learning? Empirical evidence from scaled-up interventions in Niger," World Development, Elsevier, vol. 148(C).
    17. Hernández-Agramonte, Juan Manuel & Namen, Olga & Näslund-Hadley, Emma & Biehl, Maria Loreto, 2024. "Supporting early childhood development remotely: Experimental evidence from SMS messages," Journal of Development Economics, Elsevier, vol. 166(C).
    18. Stephen Machin & Sandra McNally & Martina Viarengo, 2018. "Changing How Literacy Is Taught: Evidence on Synthetic Phonics," American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
    19. Singh, Abhijeet & Romero, Mauricio & Muralidharan, Karthik, 2024. "COVID-19 Learning loss and recovery," University of California at San Diego, Economics Working Paper Series qt3jj1b8hb, Department of Economics, UC San Diego.
    20. Sun, Yucheng & Zhou, Xianbo, 2022. "The effect of teacher's concurrent administrative position on students' academic outcomes: Evidence and mechanisms," China Economic Review, Elsevier, vol. 71(C).

    More about this item

    Keywords

    Education; COVID; Distance learning; Teachers;
    All these keywords.

    JEL classification:

    • I10 - Health, Education, and Welfare - - Health - - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:164:y:2023:i:c:s030438782300069x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.