IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v83y2020ics0160289620300684.html
   My bibliography  Save this article

Reasoning, fast and slow: How noncognitive factors may alter the ability-speed relationship

Author

Listed:
  • Shaw, Amy
  • Elizondo, Fabian
  • Wadlington, Patrick L.

Abstract

Although not unequivocal, a general viewpoint based on earlier research is that the ability-speed relationship in reasoning tasks is likely to be zero or slightly positive (Carroll, 1993; Kyllonen, 1985). Yet, more recent studies (Goldhammer & Klein Entink, 2011; Scherer, Greiff, & Hautamäki, 2015; Shaw, Oswald, Elizondo, & Wadlington, 2014) adopting the conjoint item response theory (CIRT) modeling approach (van der Linden, 2006, 2007) have found this relationship to be negative and moderate-to-large in size. Attempting to address such mixed findings, the current article proposes and examines the moderating effects of test situation and personality on the exhibited ability-speed relationship possibly via influencing test takers' choices of speed-accuracy tradeoff. Based on a sample of N = 300 working adults who completed a reasoning test and a personality assessment in a high-stakes selection context, we modeled item responses and response times as well as two personality traits (Conscientiousness and Neuroticism) in CIRT. In line with the overall conclusion by Carroll (1993), our results revealed a nearly zero ability-speed correlation. Comparing this finding to the negative correlations found in other CIRT studies, we contend that these negative relationships were likely due to low test-taking motivation in low-stakes contexts and that test situations matter in intelligence testing. Additionally, Conscientiousness and Neuroticism were found to be negatively related to speed but not ability on the test. Study implications, limitations, and future research needs are discussed.

Suggested Citation

  • Shaw, Amy & Elizondo, Fabian & Wadlington, Patrick L., 2020. "Reasoning, fast and slow: How noncognitive factors may alter the ability-speed relationship," Intelligence, Elsevier, vol. 83(C).
    • Handle: RePEc:eee:intell:v:83:y:2020:i:c:s0160289620300684
    DOI: 10.1016/j.intell.2020.101490
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289620300684
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2020.101490?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Francis Tuerlinckx & Paul Boeck, 2005. "Two interpretations of the discrimination parameter," Psychometrika, Springer;The Psychometric Society, vol. 70(4), pages 629-650, December.
    2. John Horn, 1965. "A rationale and test for the number of factors in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(2), pages 179-185, June.
    3. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    4. Andrew Caplin & Daniel Martin, 2016. "The Dual-Process Drift Diffusion Model: Evidence From Response Times," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1274-1282, April.
    5. Wim van der Linden, 2007. "A Hierarchical Framework for Modeling Speed and Accuracy on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 72(3), pages 287-308, September.
    6. R. Klein Entink & J.-P. Fox & W. Linden, 2009. "A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 21-48, March.
    7. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    8. Fox, Jean-Paul & Entink, Rinke Klein & van der Linden, Wilm, 2007. "Modeling of Responses and Response Times with the Package cirt," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i07).
    9. Frederic Lord, 1956. "A study of speed factors in tests and academic grades," Psychometrika, Springer;The Psychometric Society, vol. 21(1), pages 31-50, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kang, Inhan & De Boeck, Paul & Partchev, Ivailo, 2022. "A randomness perspective on intelligence processes," Intelligence, Elsevier, vol. 91(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dylan Molenaar & Paul Boeck, 2018. "Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 279-297, June.
    2. Kang, Inhan & De Boeck, Paul & Partchev, Ivailo, 2022. "A randomness perspective on intelligence processes," Intelligence, Elsevier, vol. 91(C).
    3. Maria Bolsinova & Jesper Tijmstra, 2016. "Posterior Predictive Checks for Conditional Independence Between Response Time and Accuracy," Journal of Educational and Behavioral Statistics, , vol. 41(2), pages 123-145, April.
    4. Inhan Kang & Dylan Molenaar & Roger Ratcliff, 2023. "A Modeling Framework to Examine Psychological Processes Underlying Ordinal Responses and Response Times of Psychometric Data," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 940-974, September.
    5. M. Marsman & H. Sigurdardóttir & M. Bolsinova & G. Maris, 2019. "Characterizing the Manifest Probability Distributions of Three Latent Trait Models for Accuracy and Response Time," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 870-891, September.
    6. Inhan Kang & Paul Boeck & Roger Ratcliff, 2022. "Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 725-748, June.
    7. Humphries, John Eric & Kosse, Fabian, 2017. "On the interpretation of non-cognitive skills – What is being measured and why it matters," Journal of Economic Behavior & Organization, Elsevier, vol. 136(C), pages 174-185.
    8. John Eric Humphries & Fabian Kosse, 2016. "On the interpretation of non-cognitive skills – what is being measured and why it matters," Working Papers 2016-025, Human Capital and Economic Opportunity Working Group.
    9. Jeffrey Rouder & Jordan Province & Richard Morey & Pablo Gomez & Andrew Heathcote, 2015. "The Lognormal Race: A Cognitive-Process Model of Choice and Latency with Desirable Psychometric Properties," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 491-513, June.
    10. Steffi Pohl & Esther Ulitzsch & Matthias Davier, 2019. "Using Response Times to Model Not-Reached Items due to Time Limits," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 892-920, September.
    11. Peter W. Rijn & Usama S. Ali, 2018. "A Generalized Speed–Accuracy Response Model for Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 109-131, March.
    12. Maria Bolsinova & Paul Boeck & Jesper Tijmstra, 2017. "Modelling Conditional Dependence Between Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1126-1148, December.
    13. Gunter Maris & Han Maas, 2012. "Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 615-633, October.
    14. Hendrik Thiel & Stephan L. Thomsen & Bettina Büttner, 2014. "Variation of learning intensity in late adolescence and the effect on personality traits," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(4), pages 861-892, October.
    15. Inhan Kang & Minjeong Jeon & Ivailo Partchev, 2023. "A Latent Space Diffusion Item Response Theory Model to Explore Conditional Dependence between Responses and Response Times," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 830-864, September.
    16. Jens Jirschitzka & Aileen Oeberst & Richard Göllner & Ulrike Cress, 2017. "Inter-rater reliability and validity of peer reviews in an interdisciplinary field," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1059-1092, November.
    17. Minjeong Jeon & Paul Boeck & Jevan Luo & Xiangrui Li & Zhong-Lin Lu, 2021. "Modeling Within-Item Dependencies in Parallel Data on Test Responses and Brain Activation," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 239-271, March.
    18. Chen, Yunxiao & Lu, Yan & Moustaki, Irini, 2022. "Detection of two-way outliers in multivariate data and application to cheating detection in educational tests," LSE Research Online Documents on Economics 112499, London School of Economics and Political Science, LSE Library.
    19. Wim J. van der Linden, 2009. "A Bivariate Lognormal Response-Time Model for the Detection of Collusion Between Test Takers," Journal of Educational and Behavioral Statistics, , vol. 34(3), pages 378-394, September.
    20. Fang Liu & Xiaojing Wang & Roeland Hancock & Ming-Hui Chen, 2022. "Bayesian Model Assessment for Jointly Modeling Multidimensional Response Data with Application to Computerized Testing," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1290-1317, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:83:y:2020:i:c:s0160289620300684. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.