IDEAS home Printed from https://ideas.repec.org/p/hhs/nhheco/2024_004.html
   My bibliography  Save this paper

Innocuous Exam Features? The Impact of Answer Placement on High-Stakes Test Performance and College Admissions

Author

Listed:
  • Franco, Catalina

    (Centre for Applied Research, Norwegian School of Economics and Business Administration)

  • Povea, Erika

    (Dept. of Economics, Norwegian School of Economics and Business Administration)

Abstract

We exploit randomness in college entrance exams in Colombia to study how the placement of answers impacts multiple-choice test results and access to college. Using administrative data, we find that: first, applicants are 5% less likely to answer correctly when the correct answer is the last in the choice set (option D). And, second, that one SD higher share of correct answers in D in the math section reduces applicants’ overall performance and their preferred major admission rate by 3%. Considering lifelong college access implications, we show how seemingly innocuous exam features disproportionately affect unlucky test takers.

Suggested Citation

  • Franco, Catalina & Povea, Erika, 2024. "Innocuous Exam Features? The Impact of Answer Placement on High-Stakes Test Performance and College Admissions," Discussion Paper Series in Economics 4/2024, Norwegian School of Economics, Department of Economics.
    • Handle: RePEc:hhs:nhheco:2024_004
    as

    Download full text from publisher

    File URL: https://openaccess.nhh.no/nhh-xmlui/handle/11250/3126775
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    2. Glenn Ellison & Ashley Swanson, 2010. "The Gender Gap in Secondary School Mathematics at High Achievement Levels: Evidence from the American Mathematics Competitions," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 109-128, Spring.
    3. Germ'an Reyes, 2023. "Cognitive Endurance, Talent Selection, and the Labor Market Returns to Human Capital," Papers 2301.02575, arXiv.org.
    4. Tom Y Chang & Agne Kajackaite, 2019. "Battle for the thermostat: Gender and the effect of temperature on cognitive performance," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-10, May.
    5. Avraham Ebenstein & Victor Lavy & Sefi Roth, 2016. "The Long-Run Economic Consequences of High-Stakes Examinations: Evidence from Transitory Variation in Pollution," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 36-65, October.
    6. Juanna Schrøter Joensen & Helena Skyt Nielsen, 2016. "Mathematics and Gender: Heterogeneity in Causes and Consequences," Economic Journal, Royal Economic Society, vol. 126(593), pages 1129-1163, June.
    7. Claire Duquennois, 2022. "Fictional Money, Real Costs: Impacts of Financial Salience on Disadvantaged Students," American Economic Review, American Economic Association, vol. 112(3), pages 798-826, March.
    8. Emma Carey & Amy Devine & Francesca Hill & Dénes Szűcs, 2017. "Differentiating anxiety forms and their role in academic performance from primary to secondary school," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-20, March.
    9. Joshua D. Angrist & Victor Lavy & Jetson Leder-Luis & Adi Shany, 2019. "Maimonides' Rule Redux," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 309-324, December.
    10. Andresen, Martin Eckhoff & Løkken, Sturla Andreas, 2020. "The Final straw: High school dropout for marginal students," MPRA Paper 106265, University Library of Munich, Germany.
    11. Roland G. Fryer & Steven D. Levitt, 2010. "An Empirical Analysis of the Gender Gap in Mathematics," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 210-240, April.
    12. Christina L. Brown & Supreet Kaur & Geeta Kingdon & Heather Schofield, 2022. "Cognitive Endurance as Human Capital," NBER Working Papers 30133, National Bureau of Economic Research, Inc.
    13. Falch, Torberg & Nyhus, Ole Henning & Strøm, Bjarne, 2014. "Causal effects of mathematics," Labour Economics, Elsevier, vol. 31(C), pages 174-187.
    14. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    15. Alma Cohen & Tzur Karelitz & Tamar Kricheli-Katz & Sephi Pumpian & Tali Regev, 2023. "Gender-Neutral Language and Gender Disparities," NBER Working Papers 31400, National Bureau of Economic Research, Inc.
    16. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    17. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    18. Cho, Hyunkuk & Glewwe, Paul & Whitler, Melissa, 2012. "Do reductions in class size raise students’ test scores? Evidence from population variation in Minnesota's elementary schools," Economics of Education Review, Elsevier, vol. 31(3), pages 77-95.
    19. R. Jisung Park, 2022. "Hot Temperature and High-Stakes Performance," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 400-434.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Justman, Moshe, 2018. "Randomized controlled trials informing public policy: Lessons from project STAR and class size reduction," European Journal of Political Economy, Elsevier, vol. 54(C), pages 167-174.
    2. Dustmann, Christian & Ku, Hyejin & Kwak, Do Won, 2018. "Why Are Single-Sex Schools Successful?," Labour Economics, Elsevier, vol. 54(C), pages 79-99.
    3. Maximilian Bach & Stephan Sievert, 2019. "Birth Cohort Size Variation and the Estimation of Class Size Effects," Discussion Papers of DIW Berlin 1817, DIW Berlin, German Institute for Economic Research.
    4. Griselda, Silvia, 2024. "Gender gap in standardized tests: What are we measuring?," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 191-229.
    5. Alex Hollingsworth & Mike Huang & Ivan J. Rudik & Nicholas J. Sanders, 2020. "A Thousand Cuts: Cumulative Lead Exposure Reduces Academic Achievement," NBER Working Papers 28250, National Bureau of Economic Research, Inc.
    6. Marie Connolly & Catherine Haeck, 2018. "Le lien entre la taille des classes et les compétences cognitives et non cognitives," CIRANO Project Reports 2018rp-18, CIRANO.
    7. Gourley, Patrick, 2021. "Back to basics: How reading the text and taking notes improves learning," International Review of Economics Education, Elsevier, vol. 37(C).
    8. Christopher Jepsen, 2015. "Class size: Does it matter for student achievement?," IZA World of Labor, Institute of Labor Economics (IZA), pages 190-190, September.
    9. Hægeland, Torbjørn & Raaum, Oddbjørn & Salvanes, Kjell G., 2012. "Pennies from heaven? Using exogenous tax variation to identify effects of school resources on pupil achievement," Economics of Education Review, Elsevier, vol. 31(5), pages 601-614.
    10. Stans, Renske A., 2022. "Short-run shock, long-run consequences? The impact of grandparental death on educational outcomes," Economics of Education Review, Elsevier, vol. 91(C).
    11. Dossi, Gaia & Figlio, David & Giuliano, Paola & Sapienza, Paola, 2021. "Born in the family: Preferences for boys and the gender gap in math," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 175-188.
    12. Stephen Gibbons & Sandra McNally & Martina Viarengo, 2018. "Does Additional Spending Help Urban Schools? An Evaluation Using Boundary Discontinuities," Journal of the European Economic Association, European Economic Association, vol. 16(5), pages 1618-1668.
    13. Adrien Bouguen & Julien Grenet & Marc Gurgand, 2017. "Does class size influence student achievement?," Post-Print halshs-02522747, HAL.
    14. Borra, Cristina & Iacovou, Maria & Sevilla, Almudena, 2023. "Adolescent development and the math gender gap," European Economic Review, Elsevier, vol. 158(C).
    15. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    16. Moshe Justman, 2016. "Economic Research and Education Policy: Project STAR and Class Size Reduction," Melbourne Institute Working Paper Series wp2016n37, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    17. Germán Reyes, 2023. "Cognitive Endurance, Talent Selection, and the Labor Market Returns to Human Capital," CRC TR 224 Discussion Paper Series crctr224_2023_490, University of Bonn and University of Mannheim, Germany.
    18. Germ'an Reyes, 2023. "Cognitive Endurance, Talent Selection, and the Labor Market Returns to Human Capital," Papers 2301.02575, arXiv.org.
    19. Stephen Gibbons & Sandra McNally, 2013. "The Effects of Resources Across School Phases: A Summary of Recent Evidence," CEP Discussion Papers dp1226, Centre for Economic Performance, LSE.
    20. Cohen, Alison K., 2018. "An instrumental variables approach to assess the effect of class size reduction on student screen time," Social Science & Medicine, Elsevier, vol. 201(C), pages 63-70.

    More about this item

    Keywords

    Multiple-choice tests; answer placement; performance; admissions;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:nhheco:2024_004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Karen Reed-Larsen (email available below). General contact details of provider: https://edirc.repec.org/data/sonhhno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.