IDEAS home Printed from https://ideas.repec.org/a/bla/obuest/v83y2021i4p1002-1023.html
   My bibliography  Save this article

Some Unpleasant Consequences of Testing at Length

Author

Listed:
  • Giorgio Brunello
  • Angela Crema
  • Lorenzo Rocco

Abstract

We show that, when performance on a math test depends on students’ endurance, longer tests do not necessarily provide a more accurate measure of students’ competencies or a higher correlation between the ranking of classes (or schools) based on test performance and the ranking based on the underlying competencies. We revisit the finding that female teenagers are better able to sustain performance during a math test by considering younger pupils, who were tested in Italian primary schools during their second and fifth grade. We find evidence of a gender gap in the ability to sustain performance only in the higher grade, suggesting that this gap develops during primary school.

Suggested Citation

  • Giorgio Brunello & Angela Crema & Lorenzo Rocco, 2021. "Some Unpleasant Consequences of Testing at Length," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(4), pages 1002-1023, August.
  • Handle: RePEc:bla:obuest:v:83:y:2021:i:4:p:1002-1023
    DOI: 10.1111/obes.12423
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/obes.12423
    Download Restriction: no

    File URL: https://libkey.io/10.1111/obes.12423?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Marianne Bertrand & Jessica Pan, 2013. "The Trouble with Boys: Social Influences and the Gender Gap in Disruptive Behavior," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 32-64, January.
    2. Contini, Dalit & Tommaso, Maria Laura Di & Mendolia, Silvia, 2017. "The gender gap in mathematics achievement: Evidence from Italian data," Economics of Education Review, Elsevier, vol. 58(C), pages 32-42.
    3. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    4. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    5. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low-skilled immigration increase profits? Evidence from Italian local labour markets," Regional Science and Urban Economics, Elsevier, vol. 85(C).
    6. Christopher Cornwell & David B. Mustard & Jessica Van Parys, 2013. "Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School," Journal of Human Resources, University of Wisconsin Press, vol. 48(1), pages 236-264.
    7. Brian A. Jacob, 2002. "Where the boys aren't: Non-cognitive skills, returns to school and the gender gap in higher education," NBER Working Papers 8964, National Bureau of Economic Research, Inc.
    8. Nyhus, Ellen K. & Pons, Empar, 2005. "The effects of personality on earnings," Journal of Economic Psychology, Elsevier, vol. 26(3), pages 363-384, June.
    9. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    10. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    11. Fleurbaey, Marc, 2012. "Fairness, Responsibility, and Welfare," OUP Catalogue, Oxford University Press, number 9780199653591, Decembrie.
    12. Pope, Devin G. & Fillmore, Ian, 2015. "The impact of time between cognitive tasks on performance: Evidence from advanced placement exams," Economics of Education Review, Elsevier, vol. 48(C), pages 30-40.
    13. Jacob, Brian A., 2002. "Where the boys aren't: non-cognitive skills, returns to school and the gender gap in higher education," Economics of Education Review, Elsevier, vol. 21(6), pages 589-598, December.
    14. Pau Balart & Matthijs Oosterveen, 2019. "Females show more sustained performance during test-taking than males," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    15. Carmit Segal, 2012. "Working When No One Is Watching: Motivation, Test Scores, and Economic Success," Management Science, INFORMS, vol. 58(8), pages 1438-1457, August.
    16. Francesca Borgonovi & Álvaro Choi & Marco Paccagnella, 2018. "The evolution of gender gaps in numeracy and literacy between childhood and adulthood," OECD Education Working Papers 184, OECD Publishing.
    17. Flavio Cunha & James J. HECKMAN, 2009. "Investing in our Young People," Rivista Internazionale di Scienze Sociali, Vita e Pensiero, Pubblicazioni dell'Universita' Cattolica del Sacro Cuore, vol. 117(3), pages 387-418.
    18. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    19. Marianna Battaglia & Marisa Hidalgo Hidalgo, 2019. "Ability to Sustain Test Performance and Remedial Education: Good News for Girls," Working Papers. Serie AD 2019-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    20. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    21. Montolio, Daniel & Taberner, Pere A., 2021. "Gender differences under test pressure and their impact on academic performance: A quasi-experimental design," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 1065-1090.
    22. Nizalova Olena Y. & Murtazashvili Irina, 2016. "Exogenous Treatment and Endogenous Factors: Vanishing of Omitted Variable Bias on the Interaction Term," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 71-77, January.
    23. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    24. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    25. Rodríguez-Planas, Núria & Nollenberger, Natalia, 2018. "Let the girls learn! It is not only about math … it's about gender social norms," Economics of Education Review, Elsevier, vol. 62(C), pages 230-253.
    26. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low skilled immigration increase the education of natives? Evidence from Italian provinces," Labour Economics, Elsevier, vol. 63(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maddalena Davoli, 2023. "A, B, or C? Question Format and the Gender Gap in Financial Literacy," Economics of Education Working Paper Series 0206, University of Zurich, Department of Business Administration (IBW).
    2. Bonan, Jacopo & Burlacu, Sergiu & Galliera, Arianna, 2023. "Prosociality in variants of the dictator game: Evidence from children in El Salvador," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianna Battaglia & Marisa Hidalgo-Hidalgo, 2020. "Non-Cognitive Skills and Remedial Education: Good News for Girls," Working Papers 20.10, Universidad Pablo de Olavide, Department of Economics.
    2. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    3. Brunello, Giorgio & Crema, Angela & Rocco, Lorenzo, 2018. "Testing at Length If It Is Cognitive or Non-Cognitive," IZA Discussion Papers 11603, Institute of Labor Economics (IZA).
    4. Martin Schlotter, 2011. "Age at Preschool Entrance and Noncognitive Skills before School - An Instrumental Variable Approach," ifo Working Paper Series 112, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    5. Marcenaro-Gutierrez, O.D. & Lopez-Agudo, L.A. & Henriques, C.O., 2021. "Are soft skills conditioned by conflicting factors? A multiobjective programming approach to explore the trade-offs," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 18-40.
    6. Borghans, Lex & Diris, Ron & Tavares, Mariana, 2025. "Time Well Spent? The Role of Test Effort in Explaining Achievement Gaps," IZA Discussion Papers 17734, Institute of Labor Economics (IZA).
    7. Kelly Foley, 2019. "The gender gap in university enrolment: Do parents play a role beyond investing in skills?," Canadian Journal of Economics, Canadian Economics Association, vol. 52(2), pages 441-489, May.
    8. Briole, Simon & Le Forner, Hélène & Lepinteur, Anthony, 2020. "Children’s socio-emotional skills: Is there a quantity–quality trade-off?," Labour Economics, Elsevier, vol. 64(C).
    9. Coneus, Katja & Laucht, Manfred & Reuß, Karsten, 2012. "The role of parental investments for cognitive and noncognitive skill formation—Evidence for the first 11 years of life," Economics & Human Biology, Elsevier, vol. 10(2), pages 189-209.
    10. Nguyen, Ha Trong & Brinkman, Sally & Le, Huong Thu & Zubrick, Stephen R. & Mitrou, Francis, 2022. "Gender differences in time allocation contribute to differences in developmental outcomes in children and adolescents," Economics of Education Review, Elsevier, vol. 89(C).
    11. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," NBER Working Papers 20749, National Bureau of Economic Research, Inc.
    12. Andrew J. Bibler, 2020. "Household Composition and Gender Differences in Parental Time Investments," Demography, Springer;Population Association of America (PAA), vol. 57(4), pages 1415-1435, August.
    13. Foley, Kelly, 2017. "The gender gap in university participation: What role do skills and parents play?," CLEF Working Paper Series 8, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    14. Seth Gershenson & Diane Whitmore Schanzenbach, 2016. "Linking Teacher Quality, Student Attendance, and Student Achievement," Education Finance and Policy, MIT Press, vol. 11(2), pages 125-149, Spring.
    15. Huong Thu Le & Ha Trong Nguyen, 2018. "The evolution of the gender test score gap through seventh grade: new insights from Australia using unconditional quantile regression and decomposition," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-42, December.
    16. Michael Baker & Kevin Milligan, 2016. "Boy-Girl Differences in Parental Time Investments: Evidence from Three Countries," Journal of Human Capital, University of Chicago Press, vol. 10(4), pages 399-441.
    17. Di Tommaso, Maria Laura & Maccagnan, Anna & Mendolia, Silvia, 2018. "The Gender Gap in Attitudes and Test Scores: A New Construct of the Mathematical Capability," IZA Discussion Papers 11843, Institute of Labor Economics (IZA).
    18. Paul Anand & Laurence Roope, 2016. "The development and happiness of very young children," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 47(4), pages 825-851, December.
    19. Didier Fouarge & Trudie Schils & Andries de Grip, 2013. "Why do low-educated workers invest less in further training?," Applied Economics, Taylor & Francis Journals, vol. 45(18), pages 2587-2601, June.
    20. Xiaodong Fan & Hanming Fang & Simen Markussen, 2015. "Mothers' Employment and Children's Educational Gender Gap," NBER Working Papers 21183, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:obuest:v:83:y:2021:i:4:p:1002-1023. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/sfeixuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.