IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp17294.html
   My bibliography  Save this paper

The Unintended Consequences of Merit-Based Teacher Selection: Evidence from a Large-Scale Reform in Colombia

Author

Listed:
  • Busso, Matias

    (Inter-American Development Bank)

  • Montaño, Sebastián

    (University of Maryland)

  • Muñoz-Morales, Juan S.

    (IÉSEG School of Management)

  • Pope, Nolan G.

    (University of Maryland)

Abstract

Teacher quality is a key factor in improving student academic achievement. As such, educational policymakers strive to design systems to hire the most effective teachers. This paper examines the effects of a national policy reform in Colombia that established a merit-based teacher-hiring system intended to enhance teacher quality and improve student learning. Implemented in 2005 for all public schools, the policy ties teacher-hiring decisions to candidates' performance on an exam evaluating subject-specific knowledge and teaching aptitude. The implementation of the policy led to many experienced contract teachers being replaced by high exam-performing novice teachers. We find that though the policy sharply increased pre-college test scores of teachers, it also decreased the overall stock of teacher experience and led to sharp decreases in students' exam performance and educational attainment. Using a difference-in-differences strategy to compare the outcomes of students from public and private schools over two decades, we show that the hiring reform decreased students' performance on high school exit exams by 8 percent of a standard deviation, and reduced the likelihood that students enroll in and graduate from college by more than 10 percent. The results underscore that relying exclusively on specific ex ante measures of teacher quality to screen candidates, particularly at the expense of teacher experience, may unintentionally reduce students' learning gains.

Suggested Citation

  • Busso, Matias & Montaño, Sebastián & Muñoz-Morales, Juan S. & Pope, Nolan G., 2024. "The Unintended Consequences of Merit-Based Teacher Selection: Evidence from a Large-Scale Reform in Colombia," IZA Discussion Papers 17294, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp17294
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp17294.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gaurav Khanna, 2023. "Large-Scale Education Reform in General Equilibrium: Regression Discontinuity Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 131(2), pages 549-591.
    2. Cruz-Aguayo, Yyannú & Ibarrarán, Pablo & Schady, Norbert, 2017. "Do tests applied to teachers predict their effectiveness?," Economics Letters, Elsevier, vol. 159(C), pages 108-111.
    3. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    4. Brutti, Zelda & Sánchez Torres, Fabio, 2022. "Turning around teacher quality in Latin America: Renewed confidence and lessons from Colombia," Economic Analysis and Policy, Elsevier, vol. 73(C), pages 62-93.
    5. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    6. Ben Ost, 2014. "How Do Teachers Improve? The Relative Importance of Specific and General Human Capital," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 127-151, April.
    7. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    8. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    9. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    10. Marina Bassi & Matias Busso & Juan Sebastian Muñoz, 2015. "Enrollment, Graduation, and Dropout Rates in Latin America: Is the Glass Half Empty or Half Full?," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2015), pages 113-156, October.
    11. Berlinski, Samuel & Busso, Matias, 2017. "Challenges in educational reform: An experiment on active learning in mathematics," Economics Letters, Elsevier, vol. 156(C), pages 172-175.
    12. Bold,Tessa & Filmer,Deon P. & Molina,Ezequiel & Svensson,Jakob, 2019. "The Lost Human Capital : Teacher Knowledge and Student Achievement in Africa," Policy Research Working Paper Series 8849, The World Bank.
    13. Jonah E. Rockoff & Brian A. Jacob & Thomas J. Kane & Douglas O. Staiger, 2011. "Can You Recognize an Effective Teacher When You Recruit One?," Education Finance and Policy, MIT Press, vol. 6(1), pages 43-74, January.
    14. Hanushek, Eric, 1971. "Teacher Characteristics and Gains in Student Achievement: Estimation Using Micro Data," American Economic Review, American Economic Association, vol. 61(2), pages 280-288, May.
    15. Bold,Tessa & Filmer,Deon P. & Martin,Gayle & Molina,Ezequiel & Rockmore,Christophe & Stacy,Brian William & Svensson,Jakob & Wane,Waly, 2017. "What do teachers know and do ? does it matter ? evidence from primary schools in Africa," Policy Research Working Paper Series 7956, The World Bank.
    16. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    17. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    18. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    19. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    20. Omar Al-Ubaydli & John A. List & Dana L. Suskind, 2017. "What Can We Learn from Experiments? Understanding the Threats to the Scalability of Experimental Results," American Economic Review, American Economic Association, vol. 107(5), pages 282-286, May.
    21. David Forero & Víctor Saavedra, 2019. "Los 10 pasos para hacer de Colombia la mejor educada de América Latina," Libros Fedesarrollo 17238, Fedesarrollo.
    22. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    23. Karthik Muralidharan & Venkatesh Sundararaman, 2015. "Editor's Choice The Aggregate Effect of School Choice: Evidence from a Two-Stage Experiment in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1011-1066.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    2. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    3. Wedel, Katharina, 2021. "Instruction time and student achievement: The moderating role of teacher qualifications," Economics of Education Review, Elsevier, vol. 85(C).
    4. Johnston, Andrew C., 2021. "Preferences, Selection, and the Structure of Teacher Pay," IZA Discussion Papers 14831, Institute of Labor Economics (IZA).
    5. Eric S. Taylor & John H. Tyler, 2011. "The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-career Teachers," NBER Working Papers 16877, National Bureau of Economic Research, Inc.
    6. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    7. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    8. Araujo P., María Daniela & Heineck, Guido & Cruz-Aguayo, Yyannú, 2021. "Does Test-Based Teacher Recruitment Work in the Developing World? Experimental Evidence from Ecuador," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242448, Verein für Socialpolitik / German Economic Association.
    9. Araujo P., Maria Daniela & Heineck, Guido & Cruz Aguayo, Yyannú, 2020. "Does test-based teacher recruitment work in the developing world? Experimental evidence from Ecuador," BERG Working Paper Series 165, Bamberg University, Bamberg Economic Research Group.
    10. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    11. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    12. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    13. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    14. Jessalynn James & Matthew A. Kraft & John P. Papay, 2023. "Local supply, temporal dynamics, and unrealized potential in teacher hiring," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(4), pages 1010-1044, September.
    15. Zheng, Lei & Qi, Xiang & Zhang, Chongjiu, 2023. "Can improvements in teacher quality reduce the cognitive gap between urban and rural students in China?," International Journal of Educational Development, Elsevier, vol. 100(C).
    16. Johan Coenen & Ilja Cornelisz & Wim Groot & Henriette Maassen van den Brink & Chris Van Klaveren, 2018. "Teacher Characteristics And Their Effects On Student Test Scores: A Systematic Review," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 848-877, July.
    17. Sander Gerritsen & Erik Plug & Dinand Webbink, 2014. "Teacher quality and student achievement: Evidence from a Dutch sample of twins," CPB Discussion Paper 294, CPB Netherlands Bureau for Economic Policy Analysis.
    18. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    19. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    20. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..

    More about this item

    Keywords

    teachers; teaching experience; teacher screening; Colombia; test scores; college enrollment;
    All these keywords.

    JEL classification:

    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp17294. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.