IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9537.html
   My bibliography  Save this paper

Do Large-Scale Student Assessments Really Capture Cognitive Skills ?

Author

Listed:
  • De Hoyos Navarro,Rafael E.
  • Estrada,Ricardo
  • Vargas Mancera,Maria Jose

Abstract

This paper studies the relationship between test scores and cognitive skills using two longitudinal data sets that track student performance on a national standardized exam in grades 6, 9, and 12 and post-secondary school outcomes in Mexico. Using a large sample of twins, the analysis finds that primary school test scores are a strong predictor of secondary education outcomes and that this association is mainly driven by the relationship between test scores and cognitive skills, as opposed to family background and other general skills. Using a data set that links results in the national standardized test to later outcomes, the paper finds that secondary school test scores predict university enrollment and hourly wages. These results indicate that, despite their limitations, large-scale student assessments can capture the skills they are meant to measure and can therefore be used to monitor learning in education systems.

Suggested Citation

  • De Hoyos Navarro,Rafael E. & Estrada,Ricardo & Vargas Mancera,Maria Jose, 2021. "Do Large-Scale Student Assessments Really Capture Cognitive Skills ?," Policy Research Working Paper Series 9537, The World Bank.
  • Handle: RePEc:wbk:wbrwps:9537
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/767821612448367170/pdf/Do-Large-Scale-Student-Assessments-Really-Capture-Cognitive-Skills.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrew Dustan & Alain de Janvry & Elisabeth Sadoulet, 2017. "Flourish or Fail?: The Risky Reward of Elite High School Admission in Mexico City," Journal of Human Resources, University of Wisconsin Press, vol. 52(3), pages 756-799.
    2. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    3. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    4. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    5. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    6. Eunsik Chang & María Padilla-Romo, 2019. "The Effects of Local Violent Crime on High-Stakes Tests," Working Papers 2019-03, University of Tennessee, Department of Economics.
    7. Avitabile, Ciro & de Hoyos, Rafael, 2018. "The heterogeneous effect of information on student performance: Evidence from a randomized control trial in Mexico," Journal of Development Economics, Elsevier, vol. 135(C), pages 318-348.
    8. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    9. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Hoyos, Rafael & Estrada, Ricardo & Vargas, María José, 2021. "What do test scores really capture? Evidence from a large-scale student assessment in Mexico," World Development, Elsevier, vol. 146(C).
    2. repec:spo:wpmain:info:hdl:2441/6s39gt704s95upu27ma7s3p6q8 is not listed on IDEAS
    3. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    4. Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022. "Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
    5. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    6. Busso, Matias & Montaño, Sebastián & Muñoz-Morales, Juan & Pope, Nolan G., 2024. "The unintended consequences of merit-based teacher selection: Evidence from a large-scale reform in Colombia," Journal of Public Economics, Elsevier, vol. 239(C).
    7. Marie Connolly & Catherine Haeck, 2018. "Le lien entre la taille des classes et les compétences cognitives et non cognitives," CIRANO Project Reports 2018rp-18, CIRANO.
    8. Shoji, Masahiro, 2020. "Early-Life Circumstances and Adult Locus of Control: Evidence from 46 Developing Countries," MPRA Paper 99987, University Library of Munich, Germany.
    9. Bobba, Matteo & Frisancho, Veronica & Pariguana, Marco, 2016. "Perceived Ability and School Choices: Experimental Evidence and Scale-up Effects," TSE Working Papers 16-660, Toulouse School of Economics (TSE), revised Jul 2024.
    10. Lin, Dajun & Lutter, Randall & Ruhm, Christopher J., 2018. "Cognitive performance and labour market outcomes," Labour Economics, Elsevier, vol. 51(C), pages 121-135.
    11. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Working Papers hal-03429906, HAL.
    12. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).
    13. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    14. Bütikofer, Aline & Mølland, Eirin & Salvanes, Kjell G., 2018. "Childhood nutrition and labor market outcomes: Evidence from a school breakfast program," Journal of Public Economics, Elsevier, vol. 168(C), pages 62-80.
    15. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard E Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Sciences Po publications info:hdl:2441/6s39gt704s9, Sciences Po.
    16. Cabrera-Hernández, Francisco & Padilla-Romo, María & Peluffo, Cecilia, 2023. "Full-time schools and educational trajectories: Evidence from high-stakes exams," Economics of Education Review, Elsevier, vol. 96(C).
    17. Huber, Laura Rosendahl & Sloof, Randolph & Van Praag, Mirjam, 2014. "The effect of early entrepreneurship education: Evidence from a field experiment," European Economic Review, Elsevier, vol. 72(C), pages 76-97.
    18. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    19. Chih Ming Tan & Xiao Wang & Xiaobo Zhang, 2024. "It's all in the stars: The Chinese zodiac and the effects of parental investments on offspring's cognitive and noncognitive skill development," Economics of Transition and Institutional Change, John Wiley & Sons, vol. 32(3), pages 877-920, July.
    20. Almlund, Mathilde & Duckworth, Angela Lee & Heckman, James & Kautz, Tim, 2011. "Personality Psychology and Economics," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 1-181, Elsevier.
    21. Jorge Luis García & James J. Heckman & Duncan Ermini Leaf & María José Prados, 2017. "Quantifying the Life-cycle Benefits of a Prototypical Early Childhood Program," NBER Working Papers 23479, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9537. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.