IDEAS home Printed from https://ideas.repec.org/p/bdr/borrec/1237.html
   My bibliography  Save this paper

Acing the Test: Educational Effects of the SaberEs Test Preparation Program in Colombia

Author

Listed:
  • Christian Posso
  • Estefanía Saravia
  • Pablo Uribe

Abstract

Education in Colombia and Latin America is characterized by significant gaps in the quality of education as measured by standardized test scores. This paper assesses the impact of a Colombian program called SaberEs, which strengthens preparation for standardized cognitive tests such as the high school exit exam in Colombia (Saber 11 ) for low socioeconomic status students. The program provides competency-based training sessions to develop skills for analyzing and solving specific types of questions within school hours. Our difference-in-differences estimates show that SaberEs increased Saber 11 scores by 2.22 ranks (or 0.074 standard deviations), which implies that the socioeconomic achievement gap was reduced by 23% regarding the control schools. Also, students affected by the program experienced a significant increase in access to tertiary education and merit-based scholarships in Colombia. **** RESUMEN: La educación en Colombia y América Latina se caracteriza por brechas significativas en la calidad de la educación medida por los resultados de pruebas estandarizadas. Este trabajo evalúa el impacto de un programa colombiano llamado SaberEs, que fortalece la preparación para pruebas cognitivas estandarizadas como el examen de egreso de bachillerato en Colombia (Saber 11) para estudiantes de bajo nivel socioeconómico. El programa ofrece sesiones de entrenamiento basadas en competencias para desarrollar habilidades para analizar y resolver tipos específicos de preguntas dentro del horario escolar. Nuestras estimaciones de diferencia en diferencias muestran que SaberEs aumentó los puntajes de Saber 11 en 2,22 rankings (o 0,074 desviaciones estándar), lo que implica que la brecha de rendimiento socioeconómico se redujo en un 23 % con respecto a las escuelas de control. Asimismo, los estudiantes afectados por el programa experimentaron un aumento significativo en el acceso a la educación terciaria y a las becas por mérito en Colombia.

Suggested Citation

  • Christian Posso & Estefanía Saravia & Pablo Uribe, 2023. "Acing the Test: Educational Effects of the SaberEs Test Preparation Program in Colombia," Borradores de Economia 1237, Banco de la Republica de Colombia.
    • Handle: RePEc:bdr:borrec:1237
    DOI: 10.32468/be.1237
    as

    Download full text from publisher

    File URL: https://doi.org/10.32468/be.1237
    Download Restriction: no
    File URL: https://libkey.io/10.32468/be.1237?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    2. Ashesh Rambachan & Jonathan Roth, 2023. "A More Credible Approach to Parallel Trends," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2555-2591.
    3. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    4. Joshua Goodman & Oded Gurantz & Jonathan Smith, 2020. "Take Two! SAT Retaking and College Enrollment Gaps," American Economic Journal: Economic Policy, American Economic Association, vol. 12(2), pages 115-158, May.
    5. Ben Ost, 2014. "How Do Teachers Improve? The Relative Importance of Specific and General Human Capital," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 127-151, April.
    6. Brunello, Giorgio & Kiss, David, 2022. "Math scores in high stakes grades," Economics of Education Review, Elsevier, vol. 87(C).
    7. Claire Duquennois, 2022. "Fictional Money, Real Costs: Impacts of Financial Salience on Disadvantaged Students," American Economic Review, American Economic Association, vol. 112(3), pages 798-826, March.
    8. Christina Gathmann & Uta Schönberg, 2010. "How General Is Human Capital? A Task-Based Approach," Journal of Labor Economics, University of Chicago Press, vol. 28(1), pages 1-49, January.
    9. Christopher Avery, 2013. "Evaluation of the College Possible Program: Results from a Randomized Controlled Trial," NBER Working Papers 19562, National Bureau of Economic Research, Inc.
    10. Christopher Cornwell & David B. Mustard & Deepa J. Sridhar, 2006. "The Enrollment Effects of Merit-Based Financial Aid: Evidence from Georgia's HOPE Program," Journal of Labor Economics, University of Chicago Press, vol. 24(4), pages 761-786, October.
    11. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    12. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    13. Melguizo, Tatiana & Sanchez, Fabio & Velasco, Tatiana, 2016. "Credit for Low-Income Students and Access to and Academic Performance in Higher Education in Colombia: A Regression Discontinuity Approach," World Development, Elsevier, vol. 80(C), pages 61-77.
    14. Robert Gibbons & Michael Waldman, 2004. "Task-Specific Human Capital," American Economic Review, American Economic Association, vol. 94(2), pages 203-207, May.
    15. Alberto Abadie, 2005. "Semiparametric Difference-in-Differences Estimators," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(1), pages 1-19.
    16. Josh Kinsler & Ronni Pavan, 2015. "The Specificity of General Human Capital: Evidence from College Major Choice," Journal of Labor Economics, University of Chicago Press, vol. 33(4), pages 933-972.
    17. Webber, Douglas A., 2016. "Are college costs worth it? How ability, major, and debt affect the returns to schooling," Economics of Education Review, Elsevier, vol. 53(C), pages 296-310.
    18. Laajaj, Rachid & Moya, Andrés & Sánchez, Fabio, 2022. "Equality of opportunity and human capital accumulation: Motivational effect of a nationwide scholarship in Colombia," Journal of Development Economics, Elsevier, vol. 154(C).
    19. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    20. George Psacharopoulos & Harry Anthony Patrinos, 2018. "Returns to investment in education: a decennial review of the global literature," Education Economics, Taylor & Francis Journals, vol. 26(5), pages 445-458, September.
    21. Bernal, Gloria L. & Penney, Jeffrey, 2019. "Scholarships and student effort: Evidence from Colombia’s Ser Pilo Paga program," Economics of Education Review, Elsevier, vol. 72(C), pages 121-130.
    22. Sergio Firpo & Nicole M. Fortin & Thomas Lemieux, 2009. "Unconditional Quantile Regressions," Econometrica, Econometric Society, vol. 77(3), pages 953-973, May.
    23. Christopher M. Cornwell & Kyung Hee Lee & David B. Mustard, 2005. "Student Responses to Merit Scholarship Retention Rules," Journal of Human Resources, University of Wisconsin Press, vol. 40(4), pages 895-917.
    24. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    25. Cohn, Elchanan & Cohn, Sharon & Balch, Donald C. & Bradley, James Jr., 2004. "Determinants of undergraduate GPAs: SAT scores, high-school GPA and high-school rank," Economics of Education Review, Elsevier, vol. 23(6), pages 577-586, December.
    26. Timothy N. Bond & George Bulman & Xiaoxiao Li & Jonathan Smith, 2018. "Updating Human Capital Decisions: Evidence from SAT Score Shocks and College Applications," Journal of Labor Economics, University of Chicago Press, vol. 36(3), pages 807-839.
    27. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    28. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    29. Juliana Londoño-Vélez & Catherine Rodríguez & Fabio Sánchez, 2020. "Upstream and Downstream Impacts of College Merit-Based Financial Aid for Low-Income Students: Ser Pilo Paga in Colombia," American Economic Journal: Economic Policy, American Economic Association, vol. 12(2), pages 193-227, May.
    30. Bruce, Donald J. & Carruthers, Celeste K., 2014. "Jackpot? The impact of lottery scholarships on enrollment in Tennessee," Journal of Urban Economics, Elsevier, vol. 81(C), pages 30-44.
    31. Jonathan Roth, 2022. "Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends," American Economic Review: Insights, American Economic Association, vol. 4(3), pages 305-322, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Friedman-Sokuler, Naomi & Justman, Moshe, 2024. "Family background, education, and earnings: The limited value of "test-score transmission"," GLO Discussion Paper Series 1388, Global Labor Organization (GLO).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernal, Gloria L. & Penney, Jeffrey, 2019. "Scholarships and student effort: Evidence from Colombia’s Ser Pilo Paga program," Economics of Education Review, Elsevier, vol. 72(C), pages 121-130.
    2. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    3. Callaway, Brantly & Li, Tong, 2023. "Policy evaluation during a pandemic," Journal of Econometrics, Elsevier, vol. 236(1).
    4. Isabelle Chort & Berk Öktem, 2024. "Agricultural shocks, coping policies and deforestation: Evidence from the coffee leaf rust epidemic in Mexico," American Journal of Agricultural Economics, John Wiley & Sons, vol. 106(3), pages 1020-1057, May.
    5. Jeffrey M Wooldridge, 2023. "Simple approaches to nonlinear difference-in-differences with panel data," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 31-66.
    6. Mounu Prem & Juan Vargas & Miguel E. Purroy, 2021. "Landmines: The Local Effects of Demining," Empirical Studies of Conflict Project (ESOC) Working Papers 28, Empirical Studies of Conflict Project.
    7. Gregory Faletto, 2023. "Fused Extended Two-Way Fixed Effects for Difference-in-Differences With Staggered Adoptions," Papers 2312.05985, arXiv.org, revised Oct 2024.
    8. Andrea Albanese & Adrián Nieto & Konstantinos Tatsiramos, 2022. "Job Location Decisions and the Effect of Children on the Employment Gender Gap," CESifo Working Paper Series 9792, CESifo.
    9. Dalia Ghanem & Pedro H. C. Sant'Anna & Kaspar Wüthrich, 2022. "Selection and Parallel Trends," CESifo Working Paper Series 9910, CESifo.
    10. Jung, Suhyun & Rogers, Martha, 2024. "Mobile phone adoption, deforestation, and agricultural land use in Uganda," World Development, Elsevier, vol. 179(C).
    11. Laajaj, Rachid & Moya, Andrés & Sánchez, Fabio, 2022. "Equality of opportunity and human capital accumulation: Motivational effect of a nationwide scholarship in Colombia," Journal of Development Economics, Elsevier, vol. 154(C).
    12. Ridwan Ah Sheikh & Sunil Kanwar, 2024. "Revisiting the Impact of TRIPS on IPR-intensive Export Flows: Evidence from Staggered Difference-in-Differences," Working papers 351, Centre for Development Economics, Delhi School of Economics.
    13. Hampton, Matt & McNamara, Scott, 2022. "The impact of educational rewards on the diagnosis of autism spectrum disorder," Economics & Human Biology, Elsevier, vol. 47(C).
    14. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    15. Bahia, Kalvin & Castells, Pau & Cruz, Genaro & Masaki, Takaaki & Pedrós, Xavier & Pfutze, Tobias & Rodríguez-Castelán, Carlos & Winkler, Hernán, 2024. "The welfare effects of mobile broadband internet: Evidence from Nigeria," Journal of Development Economics, Elsevier, vol. 170(C).
    16. Rottner, Elisa, 2023. "Do climate policies lead to outsourcing? Evidence from firm-level imports," ZEW Discussion Papers 23-070, ZEW - Leibniz Centre for European Economic Research.
    17. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    18. Aldunate, Felipe & González, Felipe & Prem, Mounu, 2024. "The limits of hegemony: U.S. banks and Chilean firms in the Cold War," Journal of Development Economics, Elsevier, vol. 166(C).
    19. Philipp Barteska & Jay Euijung Lee, 2024. "Bureaucrats and the Korean export miracle," Discussion Papers 2024-11, Nottingham Interdisciplinary Centre for Economic and Political Research (NICEP).
    20. Hans-Bernd Schaefer & Rok Spruk, 2024. "Islamic Law, Western European Law and the Roots of Middle East's Long Divergence: a Comparative Empirical Investigation (800-1600)," Papers 2401.14435, arXiv.org, revised Mar 2024.

    More about this item

    Keywords

    Test preparation programs; standardized tests; higher education; financial aid and scholarships; education in Latin America; Programas de preparación de exámenes; exámenes estandarizados; enseñanza superior; financiación y becas; educación en América Latina.;
    All these keywords.

    JEL classification:

    • A21 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Pre-college
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdr:borrec:1237. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Clorith Angélica Bahos Olivera (email available below). General contact details of provider: https://edirc.repec.org/data/brcgvco.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.