IDEAS home Printed from https://ideas.repec.org/a/aea/aejpol/v14y2022i2p61-90.html
   My bibliography  Save this article

Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not

Author

Listed:
  • Sabrin Beg
  • Waqas Halim
  • Adrienne M. Lucas
  • Umar Saif

Abstract

Using two RCTs in middle schools in Pakistan, we show that brief, expert-led, curriculum-based videos integrated into the classroom experience improved teaching effectiveness: student test scores in math and science increased by 0.3 standard deviations, 60 percent more than the control group, after 4 months of exposure. Students and teachers increased their attendance, and students were more likely to pass the high-stakes government exams. By contrast, providing similar content to students on personal tablets decreased student scores by 0.4 SD. The contrast between the two effects shows the importance of engaging teachers and the potential for technology to do so.

Suggested Citation

  • Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    • Handle: RePEc:aea:aejpol:v:14:y:2022:i:2:p:61-90
    DOI: 10.1257/pol.20200713
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/pol.20200713
    Download Restriction: no
    File URL: https://doi.org/10.7910/DVN/Y1UZTT
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/pol.20200713.appx
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/pol.20200713.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    File URL: https://libkey.io/10.1257/pol.20200713?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sylvie Moulin & Michael Kremer & Paul Glewwe, 2009. "Many Children Left Behind? Textbooks and Test Scores in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 112-135, January.
    2. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    3. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Fang Lai & Linxiu Zhang & Xiao Hu & Qinghe Qu & Yaojiang Shi & Yajie Qiao & Matthew Boswell & Scott Rozelle, 2013. "Computer assisted learning as extracurricular tutor? Evidence from a randomised experiment in rural boarding schools in Shaanxi," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(2), pages 208-231, June.
    6. Cristian Pop-Eleches & Miguel Urquiola, 2013. "Going to a Better School: Effects and Behavioral Responses," American Economic Review, American Economic Association, vol. 103(4), pages 1289-1324, June.
    7. Adrienne M. Lucas & Isaac M. Mbiti, 2014. "Effects of School Quality on Student Achievement: Discontinuity Evidence from Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 234-263, July.
    8. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    9. Barrera-Osorio, Felipe & Ganimian, Alejandro J., 2016. "The barking dog that bites: Test score volatility and school rankings in Punjab, Pakistan," International Journal of Educational Development, Elsevier, vol. 49(C), pages 31-54.
    10. Mo, Di & Swinnen, Johan & Zhang, Linxiu & Yi, Hongmei & Qu, Qinghe & Boswell, Matthew & Rozelle, Scott, 2013. "Can One-to-One Computing Narrow the Digital Divide and the Educational Gap in China? The Case of Beijing Migrant Schools," World Development, Elsevier, vol. 46(C), pages 14-29.
    11. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    12. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    13. Tahir Andrabi & Jishnu Das & Asim I. Khwaja & Selcuk Ozyurt & Niharika Singh, 2020. "Upping the Ante: The Equilibrium Effects of Unconditional Grants to Private Schools," American Economic Review, American Economic Association, vol. 110(10), pages 3315-3349, October.
    14. Menno Pradhan & Daniel Suryadarma & Amanda Beatty & Maisy Wong & Arya Gaduh & Armida Alisjahbana & Rima Prama Artha, 2014. "Improving Educational Quality through Enhancing Community Participation: Results from a Randomized Field Experiment in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 105-126, April.
    15. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    16. Maya Escueta & Vincent Quan & Andre Joshua Nickow & Philip Oreopoulos, 2017. "Education Technology: An Evidence-Based Review," NBER Working Papers 23744, National Bureau of Economic Research, Inc.
    17. Bellei, Cristián, 2009. "Does lengthening the school day increase students' academic achievement? Results from a natural experiment in Chile," Economics of Education Review, Elsevier, vol. 28(5), pages 629-640, October.
    18. Fang Lai & Linxiu Zhang & Yu Bai & Chengfang Liu & Yaojiang Shi & Fang Chang & Scott Rozelle, 2016. "More is not always better: evidence from a randomised experiment of computer-assisted learning in rural minority schools in Qinghai," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(4), pages 449-472, October.
    19. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    20. Jenny C. Aker & Christopher Ksoll & Travis J. Lybbert, 2012. "Can Mobile Phones Improve Learning? Evidence from a Field Experiment in Niger," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 94-120, October.
    21. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    22. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    23. C. Kirabo Jackson, 2010. "Do Students Benefit from Attending Better Schools? Evidence from Rule-based Student Assignments in Trinidad and Tobago," Economic Journal, Royal Economic Society, vol. 120(549), pages 1399-1429, December.
    24. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," The World Bank Economic Review, World Bank, vol. 16(2), pages 241-274, August.
    25. Glewwe, P. & Muralidharan, K., 2016. "Improving Education Outcomes in Developing Countries," Handbook of the Economics of Education,, Elsevier.
    26. Andrabi, Tahir & Das, Jishnu & Khwaja, Asim Ijaz, 2013. "Students today, teachers tomorrow: Identifying constraints on the provision of education," Journal of Public Economics, Elsevier, vol. 100(C), pages 1-14.
    27. Adrienne M. Lucas & Patrick J. McEwan & Moses Ngware & Moses Oketch, 2014. "Improving Early‐Grade Literacy In East Africa: Experimental Evidence From Kenya And Uganda," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(4), pages 950-976, September.
    28. World Bank, 2018. "World Development Report 2018 [Rapport sur le développement dans le monde 2018]," World Bank Publications - Books, The World Bank Group, number 28340.
    29. Xiqian Cai & Yi Lu & Jessica Pan & Songfa Zhong, 2019. "Gender Gap under Pressure: Evidence from China's National College Entrance Examination," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 249-263, May.
    30. Lai, Fang & Luo, Renfu & Zhang, Linxiu & Huang, Xinzhe & Rozelle, Scott, 2015. "Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing," Economics of Education Review, Elsevier, vol. 47(C), pages 34-48.
    31. Paul Carrillo & Mercedes Onofa & Juan Ponce, 2010. "Information Technology and Student Achievement: Evidence from a Randomized Experiment in Ecuador," IDB Publications (Working Papers) 37758, Inter-American Development Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bianchi, Nicola & Lu, Yi & Song, Hong, 2022. "The effect of computer-assisted learning on students’ long-term development," Journal of Development Economics, Elsevier, vol. 158(C).
    2. Piza, Caio & Zwager, Astrid & Ruzzante, Matteo & Dantas, Rafael & Loureiro, Andre, 2024. "Teacher-led innovations to improve education outcomes: Experimental evidence from Brazil," Journal of Public Economics, Elsevier, vol. 234(C).
    3. Annie Duflo & Jessica Kiessel & Adrienne M Lucas, 2024. "Experimental Evidence on Four Policies to Increase Learning at Scale," The Economic Journal, Royal Economic Society, vol. 134(661), pages 1985-2008.
    4. M. Niaz Asadullah & Anindita Bhattacharjee, 2022. "Digital Divide or Digital Provide? Technology, Time Use, and Learning Loss during COVID-19," Journal of Development Studies, Taylor & Francis Journals, vol. 58(10), pages 1934-1957, October.
    5. Johnston, Jamie & Ksoll, Christopher, 2022. "Effectiveness of interactive satellite-transmitted instruction: Experimental evidence from Ghanaian primary schools," Economics of Education Review, Elsevier, vol. 91(C).
    6. Schaffner, Julie & Glewwe, Paul & Sharma, Uttam, 2021. "Why Programs Fail: Lessons for Improving Public Service Quality from a Mixed-Methods Evaluation of an Unsuccessful Teacher Training Program in Nepal," Staff Papers 316663, University of Minnesota, Department of Applied Economics.
    7. Derksen, Laura & Leclerc, Catherine Michaud & Souza, Pedro CL, 2019. "Searching for Answers: The Impact of Student Access to Wikipedia," CAGE Online Working Paper Series 450, Competitive Advantage in the Global Economy (CAGE).
    8. Derksen, Laura & Michaud-Leclerc, Catherine & Souza, Pedro C.L., 2022. "Restricted access: How the internet can be used to promote reading and learning," Journal of Development Economics, Elsevier, vol. 155(C).
    9. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    2. Islam, Asad, 2019. "Parent–teacher meetings and student outcomes: Evidence from a developing country," European Economic Review, Elsevier, vol. 111(C), pages 273-304.
    3. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    4. Annie Duflo & Jessica Kiessel & Adrienne Lucas, 2020. "Experimental Evidence on Alternative Policies to Increase Learning at Scale," NBER Working Papers 27298, National Bureau of Economic Research, Inc.
    5. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    6. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    7. Angrist, Noam & de Barros, Andreas & Bhula, Radhika & Chakera, Shiraz & Cummiskey, Chris & DeStefano, Joseph & Floretta, John & Kaffenberger, Michelle & Piper, Benjamin & Stern, Jonathan, 2021. "Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery," International Journal of Educational Development, Elsevier, vol. 84(C).
    8. Bin Tang & Te-Tien Ting & Chyi-In Wu & Yue Ma & Di Mo & Wei-Ting Hung & Scott Rozelle, 2020. "The Impact of Online Computer Assisted Learning at Home for Disadvantaged Children in Taiwan: Evidence from a Randomized Experiment," Sustainability, MDPI, vol. 12(23), pages 1-16, December.
    9. Clair Null & Clemencia Cosentino & Swetha Sridharan & Laura Meyer, "undated". "Policies and Programs to Improve Secondary Education in Developing Countries: A Review of the Evidence," Mathematica Policy Research Reports 516e420e637c4851b15e6a3f6, Mathematica Policy Research.
    10. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    11. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    12. Naik, Gopal & Chitre, Chetan & Bhalla, Manaswini & Rajan, Jothsna, 2020. "Impact of use of technology on student learning outcomes: Evidence from a large-scale experiment in India," World Development, Elsevier, vol. 127(C).
    13. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    14. Park, Albert & Shi, Xinzheng & Hsieh, Chang-tai & An, Xuehui, 2015. "Magnet high schools and academic performance in China: A regression discontinuity design," Journal of Comparative Economics, Elsevier, vol. 43(4), pages 825-843.
    15. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    16. Kumar, G. Naveen, 2023. "Improving public school productivity: Evidence from model schools in India," Economics of Education Review, Elsevier, vol. 97(C).
    17. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    18. Asadul Islam, 2017. "Parental Involvement in Education: Evidence from Field Experiments in Developing Countries," Monash Economics Working Papers 02-17, Monash University, Department of Economics.
    19. Daniel O. Gilligan & Naureen Karachiwalla & Ibrahim Kasirye & Adrienne M. Lucas & Derek Neal, 2022. "Educator Incentives and Educational Triage in Rural Primary Schools," Journal of Human Resources, University of Wisconsin Press, vol. 57(1), pages 79-111.
    20. Yue Ma & Robert W. Fairlie & Prashant Loyalka & Scott Rozelle, 2020. "Isolating the “Tech” from EdTech: Experimental Evidence on Computer Assisted Learning in China," NBER Working Papers 26953, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aejpol:v:14:y:2022:i:2:p:61-90. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.