IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v67y2018icp44-66.html
   My bibliography  Save this article

Retest effects in cognitive ability tests: A meta-analysis

Author

Listed:
  • Scharfen, Jana
  • Peters, Judith Marie
  • Holling, Heinz

Abstract

Retest effects are referred to as the increase in test scores due to the repeated administration of cognitive ability tests. This meta-analysis attempts to update and extend previous meta-analyses by examining the size of retest effects and its determinants in a high number of cognitive ability tests for up to four test administrations. Strict inclusion and exclusion criteria were applied regarding study design, participant age and health status, and cognitive ability tests. An extensive literature search detected 174 samples from 122 studies, which resulted in 786 test outcomes and an overall sample size of 153,185. A comprehensive longitudinal multilevel meta-analysis revealed significant retest effects and no further score gains after the third test administration. Moderator analyses for multiple retests indicated that cognitive ability operation and content, equivalence of test forms, retest interval and participant age have a significant influence on the size of the retest effect. Implications for future research and retesting practice are discussed.

Suggested Citation

  • Scharfen, Jana & Peters, Judith Marie & Holling, Heinz, 2018. "Retest effects in cognitive ability tests: A meta-analysis," Intelligence, Elsevier, vol. 67(C), pages 44-66.
    • Handle: RePEc:eee:intell:v:67:y:2018:i:c:p:44-66
    DOI: 10.1016/j.intell.2018.01.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289617303276
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2018.01.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jaber, M. Y. & Glock, C. H., 2013. "A learning curve for tasks with cognitive and motor elements," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 59707, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    2. Marlise E A van Eersel & Hanneke Joosten & Janneke Koerts & Ron T Gansevoort & Joris P J Slaets & Gerbrand J Izaks, 2015. "Longitudinal Study of Performance on the Ruff Figural Fluency Test in Persons Aged 35 Years or Older," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    3. Arendasy, Martin E. & Sommer, Markus, 2017. "Reducing the effect size of the retest effect: Examining different approaches," Intelligence, Elsevier, vol. 62(C), pages 89-98.
    4. Robert D. Gibbons & Donald R. Hedeker & John M. Davis, 1993. "Estimation of Effect Size From a Series of Experiments Involving Paired Comparisons," Journal of Educational and Behavioral Statistics, , vol. 18(3), pages 271-279, September.
    5. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    6. Donald M Lyall & Breda Cullen & Mike Allerhand & Daniel J Smith & Daniel Mackay & Jonathan Evans & Jana Anderson & Chloe Fawns-Ritchie & Andrew M McIntosh & Ian J Deary & Jill P Pell, 2016. "Cognitive Test Scores in UK Biobank: Data Reduction in 480,416 Participants and Longitudinal Stability in 20,346 Participants," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-10, April.
    7. Childers, Terry L. & Viswanathan, Madhubalan, 2000. "Representation of Numerical and Verbal Product Information in Consumer Memory," Journal of Business Research, Elsevier, vol. 47(2), pages 109-120, February.
    8. Konstantopoulos, Spyros, 2011. "Fixed Effects and Variance Components Estimation in Three-Level Meta-Analysis," IZA Discussion Papers 5678, Institute of Labor Economics (IZA).
    9. Amit Lampit & Harry Hallock & Michael Valenzuela, 2014. "Computerized Cognitive Training in Cognitively Healthy Older Adults: A Systematic Review and Meta-Analysis of Effect Modifiers," PLOS Medicine, Public Library of Science, vol. 11(11), pages 1-18, November.
    10. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    11. Steven J. Luck & Edward K. Vogel, 1997. "The capacity of visual working memory for features and conjunctions," Nature, Nature, vol. 390(6657), pages 279-281, November.
    12. Alfred Musekiwa & Samuel O M Manda & Henry G Mwambi & Ding-Geng Chen, 2016. "Meta-Analysis of Effect Sizes Reported at Multiple Time Points Using General Linear Mixed Model," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-13, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mansukoski, Liina & Bogin, Barry & Galvez-Sobral, J. Andres & Furlán, Luis & Johnson, William, 2020. "Differences and secular trends in childhood IQ trajectories in Guatemala City," Intelligence, Elsevier, vol. 80(C).
    2. Harrington, Karra D. & Dang, Christa & Lim, Yen Ying & Ames, David & Laws, Simon M. & Pietrzak, Robert H. & Rainey-Smith, Stephanie & Robertson, Joanne & Rowe, Christopher C. & Salvado, Olivier & Vill, 2018. "The effect of preclinical Alzheimer's disease on age-related changes in intelligence in cognitively normal older adults," Intelligence, Elsevier, vol. 70(C), pages 22-29.
    3. Breit, Moritz & Scherrer, Vsevolod & Preckel, Franzis, 2021. "Temporal stability of specific ability scores and intelligence profiles in high ability students," Intelligence, Elsevier, vol. 86(C).
    4. Rindermann, Heiner & Becker, David & Coyle, Thomas R., 2020. "Survey of expert opinion on intelligence: Intelligence research, experts' background, controversial issues, and the media," Intelligence, Elsevier, vol. 78(C).
    5. Weise, Julius J. & Greiff, Samuel & Sparfeldt, Jörn R., 2020. "The moderating effect of prior knowledge on the relationship between intelligence and complex problem solving – Testing the Elshout-Raaheim hypothesis," Intelligence, Elsevier, vol. 83(C).
    6. Arendasy, Martin E. & Sommer, Markus & Tschiesner, Reinhard & Feldhammer-Kahr, Martina & Umdasch, Konstantin, 2024. "Using automatic item generation to construct scheduling problems measuring planning ability," Intelligence, Elsevier, vol. 106(C).
    7. Schneider, Benedikt & Becker, Nicolas & Krieger, Florian & Spinath, Frank M. & Sparfeldt, Jörn R., 2020. "Teaching the underlying rules of figural matrices in a short video increases test scores," Intelligence, Elsevier, vol. 82(C).
    8. Schneider, Benedikt & Sparfeldt, Jörn R., 2021. "How to solve number series items: Can watching video tutorials increase test scores?," Intelligence, Elsevier, vol. 87(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sala, Giovanni & Aksayli, N. Deniz & Tatlidil, K. Semir & Gondo, Yasuyuki & Gobet, Fernand, 2019. "Working memory training does not enhance older adults' cognitive skills: A comprehensive meta-analysis," Intelligence, Elsevier, vol. 77(C).
    2. Schubert, Anna-Lena, 2019. "A meta-analysis of the worst performance rule," Intelligence, Elsevier, vol. 73(C), pages 88-100.
    3. Boris Forthmann & Karin Kaczykowski & Mathias Benedek & Heinz Holling, 2023. "The Manic Idea Creator? A Review and Meta-Analysis of the Relationship between Bipolar Disorder and Creative Cognitive Potential," IJERPH, MDPI, vol. 20(13), pages 1-39, June.
    4. Rodrigo Fernández López & Adoración Antolí, 2020. "Computer-based cognitive interventions in acquired brain injury: A systematic review and meta-analysis of randomized controlled trials," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-14, July.
    5. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.
    6. Mahesh Shumsher Rughooputh & Rui Zeng & Ying Yao, 2015. "Protein Diet Restriction Slows Chronic Kidney Disease Progression in Non-Diabetic and in Type 1 Diabetic Patients, but Not in Type 2 Diabetic Patients: A Meta-Analysis of Randomized Controlled Trials ," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-17, December.
    7. Christopher Winchester & Kelsey E. Medeiros, 2023. "In Bounds but Out of the Box: A Meta-Analysis Clarifying the Effect of Ethicality on Creativity," Journal of Business Ethics, Springer, vol. 183(3), pages 713-743, March.
    8. Kelly R Moran & Sara Y Del Valle, 2016. "A Meta-Analysis of the Association between Gender and Protective Behaviors in Response to Respiratory Epidemics and Pandemics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-25, October.
    9. Sandra Feijóo & Raquel Rodríguez-Fernández, 2021. "A Meta-Analytical Review of Gender-Based School Bullying in Spain," IJERPH, MDPI, vol. 18(23), pages 1-13, December.
    10. Xizheng Xu & Zhiqiang Liu & Shaoying Gong & Yunpeng Wu, 2022. "The Relationship between Empathy and Attachment in Children and Adolescents: Three-Level Meta-Analyses," IJERPH, MDPI, vol. 19(3), pages 1-18, January.
    11. Kathrin Wunsch & Janis Fiedler & Philip Bachert & Alexander Woll, 2021. "The Tridirectional Relationship among Physical Activity, Stress, and Academic Performance in University Students: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(2), pages 1-18, January.
    12. Alan da Silveira Fleck & Margaux L. Sadoine & Stéphane Buteau & Eva Suarthana & Maximilien Debia & Audrey Smargiassi, 2021. "Environmental and Occupational Short-Term Exposure to Airborne Particles and FEV 1 and FVC in Healthy Adults: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(20), pages 1-19, October.
    13. Evangelos Danopoulos & Maureen Twiddy & Jeanette M Rotchell, 2020. "Microplastic contamination of drinking water: A systematic review," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-23, July.
    14. Claudia Menne-Lothmann & Wolfgang Viechtbauer & Petra Höhn & Zuzana Kasanova & Simone P Haller & Marjan Drukker & Jim van Os & Marieke Wichers & Jennifer Y F Lau, 2014. "How to Boost Positive Interpretations? A Meta-Analysis of the Effectiveness of Cognitive Bias Modification for Interpretation," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-26, June.
    15. José Felipe Orzuna-Orzuna & Juan Eduardo Godina-Rodríguez & Jonathan Raúl Garay-Martínez & Guillermo Reséndiz-González & Santiago Joaquín-Cancino & Alejandro Lara-Bueno, 2024. "Milk Yield, Composition, and Fatty Acid Profile in Milk of Dairy Cows Supplemented with Microalgae Schizochytrium sp.: A Meta-Analysis," Agriculture, MDPI, vol. 14(7), pages 1-13, July.
    16. Wei-Cheng Chang & Chin Lin & Cho-Hao Lee & Tzu-Ling Sung & Tao-Hsin Tung & Jorn-Hon Liu, 2017. "Vitrectomy with or without internal limiting membrane peeling for idiopathic epiretinal membrane: A meta-analysis," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-18, June.
    17. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    18. Shaylea Badovinac & Jodi Martin & Camille Guérin-Marion & Monica O’Neill & Rebecca Pillai Riddell & Jean-François Bureau & Rebecca Spiegel, 2018. "Associations between mother-preschooler attachment and maternal depression symptoms: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-27, October.
    19. Fazel, Seena & Burghart, Matthias & Fanshawe, Thomas & Gil, Sharon Danielle & Monahan, John & Yu, Rongqin, 2022. "The predictive performance of criminal risk assessment tools used at sentencing: Systematic review of validation studies," Journal of Criminal Justice, Elsevier, vol. 81(C).
    20. Amro Qaddoura & Payam Yazdan-Ashoori & Conrad Kabali & Lehana Thabane & R Brian Haynes & Stuart J Connolly & Harriette Gillian Christine Van Spall, 2015. "Efficacy of Hospital at Home in Patients with Heart Failure: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-15, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:67:y:2018:i:c:p:44-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.