IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/286.html
   My bibliography  Save this paper

Some unpleasant consequences of testing at length

Author

Listed:
  • Brunello, Giorgio
  • Crema, Angela
  • Rocco, Lorenzo

Abstract

Using Italian data on standardized test scores, we show that the performance decline associated with question position is heterogeneous across students. This fact implies that the rank of individuals and classes depends on the length of the test. Longer tests may also exhibit larger gaps between the variance of test scores and the variance of underlying ability. The performance decline is correlated with both cognitive and non-cognitive abilities and there is also evidence that those with better parental background experience a smaller decline than those with poorer background. Therefore, the gap between the two groups widens in longer tests.

Suggested Citation

  • Brunello, Giorgio & Crema, Angela & Rocco, Lorenzo, 2018. "Some unpleasant consequences of testing at length," GLO Discussion Paper Series 286, Global Labor Organization (GLO).
    • Handle: RePEc:zbw:glodps:286
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/188928/1/GLO-DP-0286.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Marianne Bertrand & Jessica Pan, 2013. "The Trouble with Boys: Social Influences and the Gender Gap in Disruptive Behavior," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 32-64, January.
    2. Contini, Dalit & Tommaso, Maria Laura Di & Mendolia, Silvia, 2017. "The gender gap in mathematics achievement: Evidence from Italian data," Economics of Education Review, Elsevier, vol. 58(C), pages 32-42.
    3. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    4. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    5. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low-skilled immigration increase profits? Evidence from Italian local labour markets," Regional Science and Urban Economics, Elsevier, vol. 85(C).
    6. Christopher Cornwell & David B. Mustard & Jessica Van Parys, 2013. "Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School," Journal of Human Resources, University of Wisconsin Press, vol. 48(1), pages 236-264.
    7. Brian A. Jacob, 2002. "Where the boys aren't: Non-cognitive skills, returns to school and the gender gap in higher education," NBER Working Papers 8964, National Bureau of Economic Research, Inc.
    8. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    9. Fleurbaey, Marc, 2012. "Fairness, Responsibility, and Welfare," OUP Catalogue, Oxford University Press, number 9780199653591, Decembrie.
    10. Carmit Segal, 2012. "Working When No One Is Watching: Motivation, Test Scores, and Economic Success," Management Science, INFORMS, vol. 58(8), pages 1438-1457, August.
    11. Francesca Borgonovi & Álvaro Choi & Marco Paccagnella, 2018. "The evolution of gender gaps in numeracy and literacy between childhood and adulthood," OECD Education Working Papers 184, OECD Publishing.
    12. Flavio Cunha & James J. HECKMAN, 2009. "Investing in our Young People," Rivista Internazionale di Scienze Sociali, Vita e Pensiero, Pubblicazioni dell'Universita' Cattolica del Sacro Cuore, vol. 117(3), pages 387-418.
    13. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    14. Marianna Battaglia & Marisa Hidalgo Hidalgo, 2019. "Ability to Sustain Test Performance and Remedial Education: Good News for Girls," Working Papers. Serie AD 2019-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    15. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    16. Montolio, Daniel & Taberner, Pere A., 2021. "Gender differences under test pressure and their impact on academic performance: A quasi-experimental design," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 1065-1090.
    17. Nizalova Olena Y. & Murtazashvili Irina, 2016. "Exogenous Treatment and Endogenous Factors: Vanishing of Omitted Variable Bias on the Interaction Term," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 71-77, January.
    18. Pope, Devin G. & Fillmore, Ian, 2015. "The impact of time between cognitive tasks on performance: Evidence from advanced placement exams," Economics of Education Review, Elsevier, vol. 48(C), pages 30-40.
    19. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    20. Rodríguez-Planas, Núria & Nollenberger, Natalia, 2018. "Let the girls learn! It is not only about math … it's about gender social norms," Economics of Education Review, Elsevier, vol. 62(C), pages 230-253.
    21. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low skilled immigration increase the education of natives? Evidence from Italian provinces," Labour Economics, Elsevier, vol. 63(C).
    22. Nyhus, Ellen K. & Pons, Empar, 2005. "The effects of personality on earnings," Journal of Economic Psychology, Elsevier, vol. 26(3), pages 363-384, June.
    23. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    24. Jacob, Brian A., 2002. "Where the boys aren't: non-cognitive skills, returns to school and the gender gap in higher education," Economics of Education Review, Elsevier, vol. 21(6), pages 589-598, December.
    25. Pau Balart & Matthijs Oosterveen, 2019. "Females show more sustained performance during test-taking than males," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    26. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maddalena Davoli, 2023. "A, B, or C? Question Format and the Gender Gap in Financial Literacy," Economics of Education Working Paper Series 0206, University of Zurich, Department of Business Administration (IBW).
    2. Bonan, Jacopo & Burlacu, Sergiu & Galliera, Arianna, 2023. "Prosociality in variants of the dictator game: Evidence from children in El Salvador," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianna Battaglia & Marisa Hidalgo-Hidalgo, 2020. "Non-Cognitive Skills and Remedial Education: Good News for Girls," Working Papers 20.10, Universidad Pablo de Olavide, Department of Economics.
    2. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    3. Brunello, Giorgio & Crema, Angela & Rocco, Lorenzo, 2018. "Testing at Length If It Is Cognitive or Non-Cognitive," IZA Discussion Papers 11603, Institute of Labor Economics (IZA).
    4. Martin Schlotter, 2011. "Age at Preschool Entrance and Noncognitive Skills before School - An Instrumental Variable Approach," ifo Working Paper Series 112, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    5. Borghans, Lex & Diris, Ron & Tavares, Mariana, 2025. "Time Well Spent? The Role of Test Effort in Explaining Achievement Gaps," IZA Discussion Papers 17734, Institute of Labor Economics (IZA).
    6. Marcenaro-Gutierrez, O.D. & Lopez-Agudo, L.A. & Henriques, C.O., 2021. "Are soft skills conditioned by conflicting factors? A multiobjective programming approach to explore the trade-offs," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 18-40.
    7. Kelly Foley, 2019. "The gender gap in university enrolment: Do parents play a role beyond investing in skills?," Canadian Journal of Economics, Canadian Economics Association, vol. 52(2), pages 441-489, May.
    8. Briole, Simon & Le Forner, Hélène & Lepinteur, Anthony, 2020. "Children’s socio-emotional skills: Is there a quantity–quality trade-off?," Labour Economics, Elsevier, vol. 64(C).
    9. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," NBER Working Papers 20749, National Bureau of Economic Research, Inc.
    10. Nguyen, Ha Trong & Brinkman, Sally & Le, Huong Thu & Zubrick, Stephen R. & Mitrou, Francis, 2022. "Gender differences in time allocation contribute to differences in developmental outcomes in children and adolescents," Economics of Education Review, Elsevier, vol. 89(C).
    11. Andrew J. Bibler, 2020. "Household Composition and Gender Differences in Parental Time Investments," Demography, Springer;Population Association of America (PAA), vol. 57(4), pages 1415-1435, August.
    12. Coneus, Katja & Laucht, Manfred & Reuß, Karsten, 2012. "The role of parental investments for cognitive and noncognitive skill formation—Evidence for the first 11 years of life," Economics & Human Biology, Elsevier, vol. 10(2), pages 189-209.
    13. Foley, Kelly, 2017. "The gender gap in university participation: What role do skills and parents play?," CLEF Working Paper Series 8, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    14. Seth Gershenson & Diane Whitmore Schanzenbach, 2016. "Linking Teacher Quality, Student Attendance, and Student Achievement," Education Finance and Policy, MIT Press, vol. 11(2), pages 125-149, Spring.
    15. Huong Thu Le & Ha Trong Nguyen, 2018. "The evolution of the gender test score gap through seventh grade: new insights from Australia using unconditional quantile regression and decomposition," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-42, December.
    16. Michael Baker & Kevin Milligan, 2016. "Boy-Girl Differences in Parental Time Investments: Evidence from Three Countries," Journal of Human Capital, University of Chicago Press, vol. 10(4), pages 399-441.
    17. Paul Anand & Laurence Roope, 2016. "The development and happiness of very young children," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 47(4), pages 825-851, December.
    18. Didier Fouarge & Trudie Schils & Andries de Grip, 2013. "Why do low-educated workers invest less in further training?," Applied Economics, Taylor & Francis Journals, vol. 45(18), pages 2587-2601, June.
    19. Xiaodong Fan & Hanming Fang & Simen Markussen, 2015. "Mothers' Employment and Children's Educational Gender Gap," NBER Working Papers 21183, National Bureau of Economic Research, Inc.
    20. Letizia Mencarini & Silvia Pasqua & Agnese Romiti, 2019. "Single-mother families and the gender gap in children’s time investment and non-cognitive skills," Review of Economics of the Household, Springer, vol. 17(1), pages 149-176, March.

    More about this item

    Keywords

    low stake tests; position of questions; cognitive and non-cognitive skills; Italy;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:286. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.