IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v168y2018icp1-20.html
   My bibliography  Save this article

Experimental evidence on scaling up education reforms in Kenya

Author

Listed:
  • Bold, Tessa
  • Kimenyi, Mwangi
  • Mwabu, Germano
  • Ng’ang’a, Alice
  • Sandefur, Justin

Abstract

What constraints arise when translating successful NGO programs to improve public services in developing countries into government policy? We report on a randomized trial embedded within a nationwide reform of teacher hiring in Kenyan government primary schools. New teachers offered a fixed-term contract by an international NGO significantly raised student test scores, while teachers offered identical contracts by the Kenyan government produced zero impact. Observable differences in teacher characteristics explain little of this gap. Instead, data suggests that bureaucratic and political opposition to the contract reform led to implementation delays and a differential interpretation of identical contract terms. Additionally, contract features that produced larger learning gains in both the NGO and government treatment arms were not adopted by the government outside of the experimental sample.

Suggested Citation

  • Bold, Tessa & Kimenyi, Mwangi & Mwabu, Germano & Ng’ang’a, Alice & Sandefur, Justin, 2018. "Experimental evidence on scaling up education reforms in Kenya," Journal of Public Economics, Elsevier, vol. 168(C), pages 1-20.
  • Handle: RePEc:eee:pubeco:v:168:y:2018:i:c:p:1-20
    DOI: 10.1016/j.jpubeco.2018.08.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272718301518
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jpubeco.2018.08.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    2. Barbara Bruns & Javier Luque, 2014. "Great Teachers : How to Raise Student Learning in Latin America and the Caribbean--Overview," World Bank Publications - Reports 19507, The World Bank Group.
    3. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukherji & Marc Shotland & Michael Walton, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level” in India," NBER Working Papers 22746, National Bureau of Economic Research, Inc.
    4. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    5. Acemoglu, Daron, 2005. "Politics and economics in weak and strong states," Journal of Monetary Economics, Elsevier, vol. 52(7), pages 1199-1226, October.
    6. Ferraz, Claudio & Finan, Frederico S., 2008. "Motivating Politicians: The Impacts of Monetary Incentives on Quality and Performance," IZA Discussion Papers 3411, Institute of Labor Economics (IZA).
    7. Daron Acemoglu, 2010. "Theory, General Equilibrium, and Political Economy in Development Economics," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 17-32, Summer.
    8. Krishnaratne, Shari & White, Howard, 2013. "Quality education for all children? What works in education in developing countries," 3ie Publications 0000-0, International Initiative for Impact Evaluation (3ie).
    9. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    10. Alan B. Krueger & Alexandre Mas, 2004. "Strikes, Scabs, and Tread Separations: Labor Strife and the Production of Defective Bridgestone/Firestone Tires," Journal of Political Economy, University of Chicago Press, vol. 112(2), pages 253-289, April.
    11. Assar Lindbeck & Dennis J. Snower, 1989. "The Insider-Outsider Theory of Employment and Unemployment," MIT Press Books, The MIT Press, edition 1, volume 1, number 026262074x, April.
    12. Paul Glewwe & Nauman Ilias & Michael Kremer, 2010. "Teacher Incentives," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 205-227, July.
    13. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    14. Duflo, Esther & Banerjee, Abhijit & Banerji, Rukmini & Berry, James & Mukerji, Shobhini & Shotland, Marc & Walton, Michael & Kannan, Harini, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level†in India," CEPR Discussion Papers 11530, C.E.P.R. Discussion Papers.
    15. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 183-198.
    16. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    17. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part II: Application to Missions and Accountability of Government Agencies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 199-217.
    18. Bold, Tessa & Barton, Nicholas & Sandefur, Justin, 2017. "Measuring Rents from Public Employment: Regression discontinuity evidence from Kenya," CEPR Discussion Papers 12105, C.E.P.R. Discussion Papers.
    19. Karthik Muralidharan & Venkatesh Sundararaman, 2013. "Contract Teachers: Experimental Evidence from India," NBER Working Papers 19440, National Bureau of Economic Research, Inc.
    20. Ritva Reinikka & Jakob Svensson, 2010. "Working for God? Evidence from a Change in Financing of Nonprofit Health Care Providers in Uganda," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1159-1178, December.
    21. Frederico Finan & Benjamin A. Olken & Rohini Pande, 2015. "The Personnel Economics of the State," NBER Working Papers 21825, National Bureau of Economic Research, Inc.
    22. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    23. Isaac M. Mbiti, 2016. "The Need for Accountability in Education in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 109-132, Summer.
    24. Joppe de Ree & Karthik Muralidharan & Menno Pradhan & Halsey Rogers, 2018. "Double for Nothing? Experimental Evidence on an Unconditional Teacher Salary Increase in Indonesia," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 993-1039.
    25. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    26. Tessa Bold, Mwangi Kimenyi, Germano Mwabu, Justin Sandefur, 2011. "Why Did Abolishing Fees Not Increase Public School Enrollment in Kenya?- Working Paper 271," Working Papers 271, Center for Global Development.
    27. Abhijit V. Banerjee & Esther Duflo & Rachel Glennerster, 2008. "Putting a Band-Aid on a Corpse: Incentives for Nurses in the Indian Public Health Care System," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 487-500, 04-05.
    28. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," Review of Economic Studies, Oxford University Press, vol. 66(1), pages 183-198.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    2. James Andreoni & Michael Callen & Karrar Hussain & Muhammad Yasir Khan & Charles Sprenger, 2023. "Using Preference Estimates to Customize Incentives: An Application to Polio Vaccination Drives in Pakistan," Journal of the European Economic Association, European Economic Association, vol. 21(4), pages 1428-1477.
    3. James Andreoni & Michael Callen & Muhammad Karrar Hussain & Muhammad Yasir Khan & Charles Sprenger, 2017. "Creating Investment Scheme with State Space Modeling ," CIRJE F-Series CIRJE-F-1039, CIRJE, Faculty of Economics, University of Tokyo.
    4. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    5. Renfu Luo & Grant Miller & Scott Rozelle & Sean Sylvia & Marcos Vera-Hernández, 2015. "Can Bureaucrats Really Be Paid Like CEOs? School Administrator Incentives for Anemia Reduction in Rural China," NBER Working Papers 21302, National Bureau of Economic Research, Inc.
    6. Jenny Aker, 2013. "Scaling Up What Works: Experimental Evidence on External Validity in Kenyan Education," Working Papers 321, Center for Global Development.
    7. James Andreoni & Michael Callen & Muhammad Karrar Hussain & Muhammad Yasir Khan & Charles Sprenger, "undated". "Creating Investment Scheme with State Space Modeling ," CIRJE F-Series CIRJE-F-1039, CIRJE, Faculty of Economics, University of Tokyo.
    8. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    9. Evans, David K. & Yuan, Fei & Filmer, Deon, 2022. "Teacher pay in Africa: Evidence from 15 countries," World Development, Elsevier, vol. 155(C).
    10. Muralidharan, Karthik & Das, Jishnu & Holla, Alaka & Mohpal, Aakash, 2017. "The fiscal cost of weak governance: Evidence from teacher absence in India," Journal of Public Economics, Elsevier, vol. 145(C), pages 116-135.
    11. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    12. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    13. Bold, Tessa & Molina, Ezequiel & Filmer, Deon & Svensson, Jakob, 2018. "The Lost Human Capital: Teacher Knowledge and Student Learning in Africa," CEPR Discussion Papers 12956, C.E.P.R. Discussion Papers.
    14. Buhl-Wiggers, Julie & Kerwin, Jason T. & Muñoz-Morales, Juan & Smith, Jeffrey & Thornton, Rebecca, 2024. "Some children left behind: Variation in the effects of an educational intervention," Journal of Econometrics, Elsevier, vol. 243(1).
    15. Matteo Bobba & Tim Ederer & Gianmarco León-Ciliotta & Christopher A. Neilson & Marco Nieddu, 2021. "Teacher compensation and structural inequality: Evidence from centralized teacher school choice in Perú," Economics Working Papers 1788, Department of Economics and Business, Universitat Pompeu Fabra.
    16. Nicholas Barton & Tessa Bold & Justin Sandefur, 2017. "Measuring Rents from Public Employment: Regression Discontinuity Evidence from Kenya - Working Paper 457," Working Papers 457, Center for Global Development.
    17. Gundersen, Sara & McKay, Michael, 2019. "Reward or punishment? An examination of the relationship between teacher and parent behavior and test scores in the Gambia," International Journal of Educational Development, Elsevier, vol. 68(C), pages 20-34.
    18. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    19. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.

    More about this item

    Keywords

    Education; Kenya; Contract teachers; Randomized evaluation; External validity; State capacity;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:168:y:2018:i:c:p:1-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.