IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v73y2019icp88-100.html
   My bibliography  Save this article

A meta-analysis of the worst performance rule

Author

Listed:
  • Schubert, Anna-Lena

Abstract

The worst performance rule (WPR) describes the phenomenon that individuals' slowest responses in a task are more predictive of their intelligence than their fastest or average responses. Because the WPR supposedly amplifies in heavily g-loaded tasks and in samples whose cognitive abilities factor structure is dominated by a strong g-factor, it has been suggested that whatever mechanism is giving rise to the positive manifold may not promote peak performance, but may rather limit performance in a wide range of cognitive tasks. The aim of the present meta-analysis was to provide a meta-analytically determined estimate of the strength, consistency, and generalizability of the WPR. Across 19 studies containing 23 datasets with a total of 3767 participants, there was robust evidence for the WPR. However, the increase in correlations across quantiles of the RT distribution did not follow a linear, but a logarithmic trend, suggesting that those cognitive processes contributing to fast responses in reaction time tasks are less strongly related to cognitive abilities (r = −0.18) than other cognitive processes contributing to average (r = −0.28) and slow responses (r = −0.33). There was no evidence that the strength of the worst performance rule increased with greater mean reaction times, in tests of general intelligence, or in samples with lower or average cognitive abilities. Instead, it was attenuated in less intelligent samples and greater when correlated with speed instead of intelligence or memory tests. Hence, the WPR may not be as characteristic for g and may play a smaller role for theoretical accounts of the positive manifold than previously thought.

Suggested Citation

  • Schubert, Anna-Lena, 2019. "A meta-analysis of the worst performance rule," Intelligence, Elsevier, vol. 73(C), pages 88-100.
  • Handle: RePEc:eee:intell:v:73:y:2019:i:c:p:88-100
    DOI: 10.1016/j.intell.2019.02.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289618302459
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.intell.2019.02.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    2. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    3. Wallert, John & Ekman, Urban & Westman, Eric & Madison, Guy, 2017. "The worst performance rule with elderly in abnormal cognitive decline," Intelligence, Elsevier, vol. 64(C), pages 9-17.
    4. Konstantopoulos, Spyros, 2011. "Fixed Effects and Variance Components Estimation in Three-Level Meta-Analysis," IZA Discussion Papers 5678, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hilger, Kirsten & Spinath, Frank M. & Troche, Stefan & Schubert, Anna-Lena, 2022. "The biological basis of intelligence: Benchmark findings," Intelligence, Elsevier, vol. 93(C).
    2. Sorjonen, Kimmo & Madison, Guy & Hemmingsson, Tomas & Melin, Bo & Ullén, Fredrik, 2021. "Further evidence that the worst performance rule is a special case of the correlation of sorted scores rule," Intelligence, Elsevier, vol. 84(C).
    3. Frischkorn, Gidon T. & Wilhelm, Oliver & Oberauer, Klaus, 2022. "Process-oriented intelligence research: A review from the cognitive perspective," Intelligence, Elsevier, vol. 94(C).
    4. Ociepka, Michał & Kałamała, Patrycja & Chuderski, Adam, 2022. "High individual alpha frequency brains run fast, but it does not make them smart," Intelligence, Elsevier, vol. 92(C).
    5. Sorjonen, Kimmo & Madison, Guy & Melin, Bo & Ullén, Fredrik, 2020. "The Correlation of Sorted Scores Rule," Intelligence, Elsevier, vol. 80(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boris Forthmann & Karin Kaczykowski & Mathias Benedek & Heinz Holling, 2023. "The Manic Idea Creator? A Review and Meta-Analysis of the Relationship between Bipolar Disorder and Creative Cognitive Potential," IJERPH, MDPI, vol. 20(13), pages 1-39, June.
    2. Scharfen, Jana & Peters, Judith Marie & Holling, Heinz, 2018. "Retest effects in cognitive ability tests: A meta-analysis," Intelligence, Elsevier, vol. 67(C), pages 44-66.
    3. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.
    4. Kelly R Moran & Sara Y Del Valle, 2016. "A Meta-Analysis of the Association between Gender and Protective Behaviors in Response to Respiratory Epidemics and Pandemics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-25, October.
    5. Evangelos Danopoulos & Maureen Twiddy & Jeanette M Rotchell, 2020. "Microplastic contamination of drinking water: A systematic review," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-23, July.
    6. Sangsuk Yoon & Nathan M. Fong & Angelika Dimoka, 2019. "The robustness of anchoring effects on preferential judgments," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 470-487, July.
    7. Boshra H. Namin & Torvald Øgaard & Jo Røislien, 2021. "Workplace Incivility and Turnover Intention in Organizations: A Meta-Analytic Review," IJERPH, MDPI, vol. 19(1), pages 1-19, December.
    8. Ruohuang Jiao & Wojtek Przepiorka & Vincent Buskens, 2022. "Moderators of reputation effects in peer-to-peer online markets: a meta-analytic model selection approach," Journal of Computational Social Science, Springer, vol. 5(1), pages 1041-1067, May.
    9. Pedro Silva Moreira & Pedro R Almeida & Hugo Leite-Almeida & Nuno Sousa & Patrício Costa, 2016. "Impact of Chronic Stress Protocols in Learning and Memory in Rodents: Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-24, September.
    10. Claudia Mendoza-Pinto & Adriana Rojas-Villarraga & Nicolás Molano-González & Erick A Jiménez-Herrera & María de la Luz León-Vázquez & Álvaro Montiel-Jarquín & Mario García-Carrasco & Ricard Cervera, 2018. "Bone mineral density and vertebral fractures in patients with systemic lupus erythematosus: A systematic review and meta-regression," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-15, June.
    11. repec:cup:judgdm:v:17:y:2022:i:4:p:720-744 is not listed on IDEAS
    12. Woodley of Menie, Michael A. & Peñaherrera-Aguirre, Mateo & Sarraf, Matthew A., 2022. "Signs of a Flynn effect in rodents? Secular differentiation of the manifold of general cognitive ability in laboratory mice (Mus musculus) and Norwegian rats (Rattus norvegicus) over a century—Results," Intelligence, Elsevier, vol. 95(C).
    13. Chad K Bush & Dayaamayi Kurimella & Lee J S Cross & Katherine R Conner & Sheryl Martin-Schild & Jiang He & Changwei Li & Jing Chen & Tanika Kelly, 2016. "Endovascular Treatment with Stent-Retriever Devices for Acute Ischemic Stroke: A Meta-Analysis of Randomized Controlled Trials," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-19, January.
    14. Jaskiewicz, Peter & Block, Joern & Wagner, Dominik & Carney, Michael & Hansen, Christopher, 2021. "How do cross-country differences in institutional trust and trust in family explain the mixed performance effects of family management? A meta-analysis," Journal of World Business, Elsevier, vol. 56(5).
    15. Laurens Manning & Moses Laman & Wendy A Davis & Timothy M E Davis, 2014. "Clinical Features and Outcome in Children with Severe Plasmodium falciparum Malaria: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-11, February.
    16. Mikkel Wallentin, 2018. "Sex differences in post-stroke aphasia rates are caused by age. A meta-analysis and database query," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-18, December.
    17. Ewa Zasadzka & Anna Pieczyńska & Tomasz Trzmiel & Paweł Kleka & Mariola Pawlaczyk, 2021. "Correlation between Handgrip Strength and Depression in Older Adults—A Systematic Review and a Meta-Analysis," IJERPH, MDPI, vol. 18(9), pages 1-15, April.
    18. Dominika Wilczyńska & Wen Qi & José Carlos Jaenes & David Alarcón & María José Arenilla & Mariusz Lipowski, 2022. "Burnout and Mental Interventions among Youth Athletes: A Systematic Review and Meta-Analysis of the Studies," IJERPH, MDPI, vol. 19(17), pages 1-17, August.
    19. van Aert, Robbie Cornelis Maria & van Assen, Marcel A. L. M., 2018. "P-uniform," MetaArXiv zqjr9, Center for Open Science.
    20. B G Pijls & J M T A Meessen & J W Schoones & M Fiocco & H J L van der Heide & A Sedrakyan & R G H H Nelissen, 2016. "Increased Mortality in Metal-on-Metal versus Non-Metal-on-Metal Primary Total Hip Arthroplasty at 10 Years and Longer Follow-Up: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-17, June.
    21. Briana N. M. Hagen & Charlotte B. Winder & Jared Wootten & Carrie K. McMullen & Andria Jones-Bitton, 2020. "A Systematic Review and Meta-Analysis of Depression among Farming Populations Worldwide," IJERPH, MDPI, vol. 17(24), pages 1-15, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:73:y:2019:i:c:p:88-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.