IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v67y2018icp44-66.html
   My bibliography  Save this article

Retest effects in cognitive ability tests: A meta-analysis

Author

Listed:
  • Scharfen, Jana
  • Peters, Judith Marie
  • Holling, Heinz

Abstract

Retest effects are referred to as the increase in test scores due to the repeated administration of cognitive ability tests. This meta-analysis attempts to update and extend previous meta-analyses by examining the size of retest effects and its determinants in a high number of cognitive ability tests for up to four test administrations. Strict inclusion and exclusion criteria were applied regarding study design, participant age and health status, and cognitive ability tests. An extensive literature search detected 174 samples from 122 studies, which resulted in 786 test outcomes and an overall sample size of 153,185. A comprehensive longitudinal multilevel meta-analysis revealed significant retest effects and no further score gains after the third test administration. Moderator analyses for multiple retests indicated that cognitive ability operation and content, equivalence of test forms, retest interval and participant age have a significant influence on the size of the retest effect. Implications for future research and retesting practice are discussed.

Suggested Citation

  • Scharfen, Jana & Peters, Judith Marie & Holling, Heinz, 2018. "Retest effects in cognitive ability tests: A meta-analysis," Intelligence, Elsevier, vol. 67(C), pages 44-66.
    • Handle: RePEc:eee:intell:v:67:y:2018:i:c:p:44-66
    DOI: 10.1016/j.intell.2018.01.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289617303276
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2018.01.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marlise E A van Eersel & Hanneke Joosten & Janneke Koerts & Ron T Gansevoort & Joris P J Slaets & Gerbrand J Izaks, 2015. "Longitudinal Study of Performance on the Ruff Figural Fluency Test in Persons Aged 35 Years or Older," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    2. Arendasy, Martin E. & Sommer, Markus, 2017. "Reducing the effect size of the retest effect: Examining different approaches," Intelligence, Elsevier, vol. 62(C), pages 89-98.
    3. Robert D. Gibbons & Donald R. Hedeker & John M. Davis, 1993. "Estimation of Effect Size From a Series of Experiments Involving Paired Comparisons," Journal of Educational and Behavioral Statistics, , vol. 18(3), pages 271-279, September.
    4. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    5. Donald M Lyall & Breda Cullen & Mike Allerhand & Daniel J Smith & Daniel Mackay & Jonathan Evans & Jana Anderson & Chloe Fawns-Ritchie & Andrew M McIntosh & Ian J Deary & Jill P Pell, 2016. "Cognitive Test Scores in UK Biobank: Data Reduction in 480,416 Participants and Longitudinal Stability in 20,346 Participants," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-10, April.
    6. Childers, Terry L. & Viswanathan, Madhubalan, 2000. "Representation of Numerical and Verbal Product Information in Consumer Memory," Journal of Business Research, Elsevier, vol. 47(2), pages 109-120, February.
    7. Amit Lampit & Harry Hallock & Michael Valenzuela, 2014. "Computerized Cognitive Training in Cognitively Healthy Older Adults: A Systematic Review and Meta-Analysis of Effect Modifiers," PLOS Medicine, Public Library of Science, vol. 11(11), pages 1-18, November.
    8. Steven J. Luck & Edward K. Vogel, 1997. "The capacity of visual working memory for features and conjunctions," Nature, Nature, vol. 390(6657), pages 279-281, November.
    9. Jaber, M. Y. & Glock, C. H., 2013. "A learning curve for tasks with cognitive and motor elements," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 59707, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    10. Konstantopoulos, Spyros, 2011. "Fixed Effects and Variance Components Estimation in Three-Level Meta-Analysis," IZA Discussion Papers 5678, Institute of Labor Economics (IZA).
    11. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    12. Alfred Musekiwa & Samuel O M Manda & Henry G Mwambi & Ding-Geng Chen, 2016. "Meta-Analysis of Effect Sizes Reported at Multiple Time Points Using General Linear Mixed Model," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-13, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Harrington, Karra D. & Dang, Christa & Lim, Yen Ying & Ames, David & Laws, Simon M. & Pietrzak, Robert H. & Rainey-Smith, Stephanie & Robertson, Joanne & Rowe, Christopher C. & Salvado, Olivier & Vill, 2018. "The effect of preclinical Alzheimer's disease on age-related changes in intelligence in cognitively normal older adults," Intelligence, Elsevier, vol. 70(C), pages 22-29.
    2. Arendasy, Martin E. & Sommer, Markus & Tschiesner, Reinhard & Feldhammer-Kahr, Martina & Umdasch, Konstantin, 2024. "Using automatic item generation to construct scheduling problems measuring planning ability," Intelligence, Elsevier, vol. 106(C).
    3. Schneider, Benedikt & Becker, Nicolas & Krieger, Florian & Spinath, Frank M. & Sparfeldt, Jörn R., 2020. "Teaching the underlying rules of figural matrices in a short video increases test scores," Intelligence, Elsevier, vol. 82(C).
    4. Schneider, Benedikt & Sparfeldt, Jörn R., 2021. "How to solve number series items: Can watching video tutorials increase test scores?," Intelligence, Elsevier, vol. 87(C).
    5. Mansukoski, Liina & Bogin, Barry & Galvez-Sobral, J. Andres & Furlán, Luis & Johnson, William, 2020. "Differences and secular trends in childhood IQ trajectories in Guatemala City," Intelligence, Elsevier, vol. 80(C).
    6. Breit, Moritz & Scherrer, Vsevolod & Preckel, Franzis, 2021. "Temporal stability of specific ability scores and intelligence profiles in high ability students," Intelligence, Elsevier, vol. 86(C).
    7. Rindermann, Heiner & Becker, David & Coyle, Thomas R., 2020. "Survey of expert opinion on intelligence: Intelligence research, experts' background, controversial issues, and the media," Intelligence, Elsevier, vol. 78(C).
    8. Weise, Julius J. & Greiff, Samuel & Sparfeldt, Jörn R., 2020. "The moderating effect of prior knowledge on the relationship between intelligence and complex problem solving – Testing the Elshout-Raaheim hypothesis," Intelligence, Elsevier, vol. 83(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schubert, Anna-Lena, 2019. "A meta-analysis of the worst performance rule," Intelligence, Elsevier, vol. 73(C), pages 88-100.
    2. Boris Forthmann & Karin Kaczykowski & Mathias Benedek & Heinz Holling, 2023. "The Manic Idea Creator? A Review and Meta-Analysis of the Relationship between Bipolar Disorder and Creative Cognitive Potential," IJERPH, MDPI, vol. 20(13), pages 1-39, June.
    3. Sala, Giovanni & Aksayli, N. Deniz & Tatlidil, K. Semir & Gondo, Yasuyuki & Gobet, Fernand, 2019. "Working memory training does not enhance older adults' cognitive skills: A comprehensive meta-analysis," Intelligence, Elsevier, vol. 77(C).
    4. Rodrigo Fernández López & Adoración Antolí, 2020. "Computer-based cognitive interventions in acquired brain injury: A systematic review and meta-analysis of randomized controlled trials," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-14, July.
    5. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.
    6. Kelly R Moran & Sara Y Del Valle, 2016. "A Meta-Analysis of the Association between Gender and Protective Behaviors in Response to Respiratory Epidemics and Pandemics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-25, October.
    7. Evangelos Danopoulos & Maureen Twiddy & Jeanette M Rotchell, 2020. "Microplastic contamination of drinking water: A systematic review," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-23, July.
    8. Sangsuk Yoon & Nathan M. Fong & Angelika Dimoka, 2019. "The robustness of anchoring effects on preferential judgments," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 470-487, July.
    9. Boshra H. Namin & Torvald Øgaard & Jo Røislien, 2021. "Workplace Incivility and Turnover Intention in Organizations: A Meta-Analytic Review," IJERPH, MDPI, vol. 19(1), pages 1-19, December.
    10. Ruohuang Jiao & Wojtek Przepiorka & Vincent Buskens, 2022. "Moderators of reputation effects in peer-to-peer online markets: a meta-analytic model selection approach," Journal of Computational Social Science, Springer, vol. 5(1), pages 1041-1067, May.
    11. Pedro Silva Moreira & Pedro R Almeida & Hugo Leite-Almeida & Nuno Sousa & Patrício Costa, 2016. "Impact of Chronic Stress Protocols in Learning and Memory in Rodents: Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-24, September.
    12. Claudia Mendoza-Pinto & Adriana Rojas-Villarraga & Nicolás Molano-González & Erick A Jiménez-Herrera & María de la Luz León-Vázquez & Álvaro Montiel-Jarquín & Mario García-Carrasco & Ricard Cervera, 2018. "Bone mineral density and vertebral fractures in patients with systemic lupus erythematosus: A systematic review and meta-regression," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-15, June.
    13. repec:cup:judgdm:v:17:y:2022:i:4:p:720-744 is not listed on IDEAS
    14. Mohith M. Varma & Shengzi Zeng & Laura Singh & Emily A. Holmes & Jingyun Huang & Man Hey Chiu & Xiaoqing Hu, 2024. "A systematic review and meta-analysis of experimental methods for modulating intrusive memories following lab-analogue trauma exposure in non-clinical populations," Nature Human Behaviour, Nature, vol. 8(10), pages 1968-1987, October.
    15. Woodley of Menie, Michael A. & Peñaherrera-Aguirre, Mateo & Sarraf, Matthew A., 2022. "Signs of a Flynn effect in rodents? Secular differentiation of the manifold of general cognitive ability in laboratory mice (Mus musculus) and Norwegian rats (Rattus norvegicus) over a century—Results," Intelligence, Elsevier, vol. 95(C).
    16. Chad K Bush & Dayaamayi Kurimella & Lee J S Cross & Katherine R Conner & Sheryl Martin-Schild & Jiang He & Changwei Li & Jing Chen & Tanika Kelly, 2016. "Endovascular Treatment with Stent-Retriever Devices for Acute Ischemic Stroke: A Meta-Analysis of Randomized Controlled Trials," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-19, January.
    17. Jaskiewicz, Peter & Block, Joern & Wagner, Dominik & Carney, Michael & Hansen, Christopher, 2021. "How do cross-country differences in institutional trust and trust in family explain the mixed performance effects of family management? A meta-analysis," Journal of World Business, Elsevier, vol. 56(5).
    18. Laurens Manning & Moses Laman & Wendy A Davis & Timothy M E Davis, 2014. "Clinical Features and Outcome in Children with Severe Plasmodium falciparum Malaria: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-11, February.
    19. Mikkel Wallentin, 2018. "Sex differences in post-stroke aphasia rates are caused by age. A meta-analysis and database query," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-18, December.
    20. Ewa Zasadzka & Anna Pieczyńska & Tomasz Trzmiel & Paweł Kleka & Mariola Pawlaczyk, 2021. "Correlation between Handgrip Strength and Depression in Older Adults—A Systematic Review and a Meta-Analysis," IJERPH, MDPI, vol. 18(9), pages 1-15, April.
    21. Dominika Wilczyńska & Wen Qi & José Carlos Jaenes & David Alarcón & María José Arenilla & Mariusz Lipowski, 2022. "Burnout and Mental Interventions among Youth Athletes: A Systematic Review and Meta-Analysis of the Studies," IJERPH, MDPI, vol. 19(17), pages 1-17, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:67:y:2018:i:c:p:44-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.