IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/286.html
   My bibliography  Save this paper

Some unpleasant consequences of testing at length

Author

Listed:
  • Brunello, Giorgio
  • Crema, Angela
  • Rocco, Lorenzo

Abstract

Using Italian data on standardized test scores, we show that the performance decline associated with question position is heterogeneous across students. This fact implies that the rank of individuals and classes depends on the length of the test. Longer tests may also exhibit larger gaps between the variance of test scores and the variance of underlying ability. The performance decline is correlated with both cognitive and non-cognitive abilities and there is also evidence that those with better parental background experience a smaller decline than those with poorer background. Therefore, the gap between the two groups widens in longer tests.

Suggested Citation

  • Brunello, Giorgio & Crema, Angela & Rocco, Lorenzo, 2018. "Some unpleasant consequences of testing at length," GLO Discussion Paper Series 286, Global Labor Organization (GLO).
    • Handle: RePEc:zbw:glodps:286
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/188928/1/GLO-DP-0286.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Marianne Bertrand & Jessica Pan, 2013. "The Trouble with Boys: Social Influences and the Gender Gap in Disruptive Behavior," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 32-64, January.
    2. Contini, Dalit & Tommaso, Maria Laura Di & Mendolia, Silvia, 2017. "The gender gap in mathematics achievement: Evidence from Italian data," Economics of Education Review, Elsevier, vol. 58(C), pages 32-42.
    3. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    4. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    5. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low-skilled immigration increase profits? Evidence from Italian local labour markets," Regional Science and Urban Economics, Elsevier, vol. 85(C).
    6. Christopher Cornwell & David B. Mustard & Jessica Van Parys, 2013. "Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School," Journal of Human Resources, University of Wisconsin Press, vol. 48(1), pages 236-264.
    7. Brian A. Jacob, 2002. "Where the boys aren't: Non-cognitive skills, returns to school and the gender gap in higher education," NBER Working Papers 8964, National Bureau of Economic Research, Inc.
    8. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    9. Fleurbaey, Marc, 2012. "Fairness, Responsibility, and Welfare," OUP Catalogue, Oxford University Press, number 9780199653591.
    10. Carmit Segal, 2012. "Working When No One Is Watching: Motivation, Test Scores, and Economic Success," Management Science, INFORMS, vol. 58(8), pages 1438-1457, August.
    11. Francesca Borgonovi & Álvaro Choi & Marco Paccagnella, 2018. "The evolution of gender gaps in numeracy and literacy between childhood and adulthood," OECD Education Working Papers 184, OECD Publishing.
    12. Flavio Cunha & James J. HECKMAN, 2009. "Investing in our Young People," Rivista Internazionale di Scienze Sociali, Vita e Pensiero, Pubblicazioni dell'Universita' Cattolica del Sacro Cuore, vol. 117(3), pages 387-418.
    13. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    14. Marianna Battaglia & Marisa Hidalgo Hidalgo, 2019. "Ability to Sustain Test Performance and Remedial Education: Good News for Girls," Working Papers. Serie AD 2019-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    15. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    16. Montolio, Daniel & Taberner, Pere A., 2021. "Gender differences under test pressure and their impact on academic performance: A quasi-experimental design," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 1065-1090.
    17. Nizalova Olena Y. & Murtazashvili Irina, 2016. "Exogenous Treatment and Endogenous Factors: Vanishing of Omitted Variable Bias on the Interaction Term," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 71-77, January.
    18. Pope, Devin G. & Fillmore, Ian, 2015. "The impact of time between cognitive tasks on performance: Evidence from advanced placement exams," Economics of Education Review, Elsevier, vol. 48(C), pages 30-40.
    19. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    20. Rodríguez-Planas, Núria & Nollenberger, Natalia, 2018. "Let the girls learn! It is not only about math … it's about gender social norms," Economics of Education Review, Elsevier, vol. 62(C), pages 230-253.
    21. Brunello, Giorgio & Lodigiani, Elisabetta & Rocco, Lorenzo, 2020. "Does low skilled immigration increase the education of natives? Evidence from Italian provinces," Labour Economics, Elsevier, vol. 63(C).
    22. Nyhus, Ellen K. & Pons, Empar, 2005. "The effects of personality on earnings," Journal of Economic Psychology, Elsevier, vol. 26(3), pages 363-384, June.
    23. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    24. Pau Balart & Matthijs Oosterveen, 2019. "Females show more sustained performance during test-taking than males," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    25. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maddalena Davoli, 2023. "A, B, or C? Question Format and the Gender Gap in Financial Literacy," Economics of Education Working Paper Series 0206, University of Zurich, Department of Business Administration (IBW).
    2. Bonan, Jacopo & Burlacu, Sergiu & Galliera, Arianna, 2023. "Prosociality in variants of the dictator game: Evidence from children in El Salvador," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brunello, Giorgio & Crema, Angela & Rocco, Lorenzo, 2018. "Testing at Length If It Is Cognitive or Non-Cognitive," IZA Discussion Papers 11603, Institute of Labor Economics (IZA).
    2. Marianna Battaglia & Marisa Hidalgo-Hidalgo, 2020. "Non-Cognitive Skills and Remedial Education: Good News for Girls," Working Papers 20.10, Universidad Pablo de Olavide, Department of Economics.
    3. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    4. Marcenaro-Gutierrez, O.D. & Lopez-Agudo, L.A. & Henriques, C.O., 2021. "Are soft skills conditioned by conflicting factors? A multiobjective programming approach to explore the trade-offs," Economic Analysis and Policy, Elsevier, vol. 72(C), pages 18-40.
    5. Briole, Simon & Le Forner, Hélène & Lepinteur, Anthony, 2020. "Children’s socio-emotional skills: Is there a quantity–quality trade-off?," Labour Economics, Elsevier, vol. 64(C).
    6. Martin Schlotter, 2011. "Age at Preschool Entrance and Noncognitive Skills before School - An Instrumental Variable Approach," ifo Working Paper Series 112, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    7. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    8. Kelly Foley, 2019. "The gender gap in university enrolment: Do parents play a role beyond investing in skills?," Canadian Journal of Economics, Canadian Economics Association, vol. 52(2), pages 441-489, May.
    9. Paul Anand & Laurence Roope, 2016. "The development and happiness of very young children," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 47(4), pages 825-851, December.
    10. Nguyen, Ha Trong & Brinkman, Sally & Le, Huong Thu & Zubrick, Stephen R. & Mitrou, Francis, 2022. "Gender differences in time allocation contribute to differences in developmental outcomes in children and adolescents," Economics of Education Review, Elsevier, vol. 89(C).
    11. Andrew J. Bibler, 2020. "Household Composition and Gender Differences in Parental Time Investments," Demography, Springer;Population Association of America (PAA), vol. 57(4), pages 1415-1435, August.
    12. James J. Heckman, 2008. "Schools, Skills, And Synapses," Economic Inquiry, Western Economic Association International, vol. 46(3), pages 289-324, July.
    13. James Heckman & Tim Kautz, 2013. "Fostering and Measuring Skills: Interventions That Improve Character and Cognition," Working Papers 2013-019, Human Capital and Economic Opportunity Working Group.
    14. Hull, Marie & Norris, Jonathan, 2020. "The skill development of children of immigrants," Economics of Education Review, Elsevier, vol. 78(C).
    15. Di Tommaso, Maria Laura & Maccagnan, Anna & Mendolia, Silvia, 2018. "The Gender Gap in Attitudes and Test Scores: a new construct of the mathematical capability," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201815, University of Turin.
    16. Gian Paolo Barbetta & Giuseppe Sorrenti & Gilberto Turati, 2021. "Multigrading and Child Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 56(3), pages 940-968.
    17. Michal Brzezinski, 2017. "Childhood circumstances, personality traits and adult-life economic outcomes in developing countries: Evidence from STEP," IBS Working Papers 05/2017, Instytut Badan Strukturalnych.
    18. Javier Arias & Oliver Azuara & Pedro Bernal & James J. Heckman & Cajeme Villarreal, 2010. "Policies To Promote Growth and Economic Efficiency in Mexico," NBER Working Papers 16554, National Bureau of Economic Research, Inc.
    19. Houmark, Mikkel Aagaard, 2023. "First Among Equals? How Birth Order Shapes Child Development," MPRA Paper 119325, University Library of Munich, Germany.
    20. Jürges, Hendrik & Khanam, Rasheda, 2021. "Adolescents’ time allocation and skill production," Economics of Education Review, Elsevier, vol. 85(C).

    More about this item

    Keywords

    low stake tests; position of questions; cognitive and non-cognitive skills; Italy;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:286. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.