IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v112y2024ics2214804324001101.html
   My bibliography  Save this article

Manipulating response times in the cognitive reflection test: Time delay boosts deliberation, time pressure hinders it

Author

Listed:
  • Bilancini, Ennio
  • Boncinelli, Leonardo
  • Celadin, Tatiana

Abstract

We employ the Cognitive Reflection Test (CRT) to assess the effectiveness of two widely applied cognitive manipulations which rely on constraining response times. The CRT measures the ability of a person to resist giving an immediate response that is intuitive but incorrect in favor of greater reflection to find out the correct answer. We have two treatments: a Time Pressure (TP) treatment (provide an answer within 30 s) and a Time Delay (TD) treatment (provide an answer after 60 s). We find that TD increases the frequency of correct answers, while TP increases the frequency of incorrect answers, especially incorrect answers that are not intuitive. Moreover, we confirm the existence of gender biases as already found in other studies. In particular, gender moderates the effects of the experimental treatments: TD increases the frequency of correct answers for males but not for females, while TP increases the frequency of incorrect but less intuitive answers for females but not for males. Our findings provide important insights on the effectiveness of the time manipulations that are widely used in the literature of cognition.

Suggested Citation

  • Bilancini, Ennio & Boncinelli, Leonardo & Celadin, Tatiana, 2024. "Manipulating response times in the cognitive reflection test: Time delay boosts deliberation, time pressure hinders it," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 112(C).
  • Handle: RePEc:eee:soceco:v:112:y:2024:i:c:s2214804324001101
    DOI: 10.1016/j.socec.2024.102273
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804324001101
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2024.102273?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lohse, Tim & Simon, Sven A. & Konrad, Kai A., 2018. "Deception under time pressure: Conscious decision or a problem of awareness?," Journal of Economic Behavior & Organization, Elsevier, vol. 146(C), pages 31-42.
    2. Campitelli, Guillermo & Labollita, Martín, 2010. "Correlations of cognitive reflection with judgments and choices," Judgment and Decision Making, Cambridge University Press, vol. 5(3), pages 182-191, June.
    3. Capraro, Valerio, 2017. "Does the truth come naturally? Time pressure increases honesty in one-shot deception games," Economics Letters, Elsevier, vol. 158(C), pages 54-57.
    4. Lex Borghans & Huub Meijers & Bas Ter Weel, 2008. "The Role Of Noncognitive Skills In Explaining Cognitive Test Scores," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 2-12, January.
    5. Bilancini, Ennio & Boncinelli, Leonardo & Guarnieri, Pietro & Spadoni, Lorenzo, 2023. "Delaying and motivating decisions in the (Bully) dictator game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    6. Capraro, Valerio & Schulz, Jonathan & Rand, David G., 2019. "Time pressure and honesty in a deception game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 79(C), pages 93-99.
    7. Besedeš, Tibor & Deck, Cary & Sarangi, Sudipta & Shor, Mikhael, 2012. "Decision-making strategies and performance among seniors," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 524-533.
    8. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    9. Bilancini, Ennio & Boncinelli, Leonardo & Celadin, Tatiana, 2022. "Social value orientation and conditional cooperation in the online one-shot public goods game," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 243-272.
    10. Gian Luigi Albano & Angela Cipollone & Roberto Di Paolo & Giovanni Ponti & Marco Sparro, 2018. "Scoring Rules in Experimental Procurement," Working Papers. Serie AD 2018-02, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    11. Schulz, Jonathan F. & Fischbacher, Urs & Thöni, Christian & Utikal, Verena, 2014. "Affect and fairness: Dictator games under cognitive load," Journal of Economic Psychology, Elsevier, vol. 41(C), pages 77-87.
    12. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    13. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2016. "Risk Aversion Relates to Cognitive Ability: Preferences Or Noise?," Journal of the European Economic Association, European Economic Association, vol. 14(5), pages 1129-1154.
    14. Hoppe, Eva I. & Kusterer, David J., 2011. "Behavioral biases and cognitive reflection," Economics Letters, Elsevier, vol. 110(2), pages 97-100, February.
    15. Lohse, Johannes, 2016. "Smart or selfish – When smart guys finish nice," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 28-40.
    16. Holt, Charles A. & Porzio, Megan & Song, Michelle Yingze, 2017. "Price bubbles, gender, and expectations in experimental asset markets," European Economic Review, Elsevier, vol. 100(C), pages 72-94.
    17. Alós-Ferrer, Carlos & Garagnani, Michele, 2020. "The cognitive foundations of cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 71-85.
    18. Cueva, Carlos & Iturbe-Ormaetxe, Iñigo & Mata-Pérez, Esther & Ponti, Giovanni & Sartarelli, Marcello & Yu, Haihan & Zhukova, Vita, 2016. "Cognitive (ir)reflection: New experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 81-93.
    19. David G. Rand & Joshua D. Greene & Martin A. Nowak, 2012. "Spontaneous giving and calculated greed," Nature, Nature, vol. 489(7416), pages 427-430, September.
    20. Achtziger, Anja & Alós-Ferrer, Carlos & Wagner, Alexander K., 2018. "Social preferences and self-control," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 161-166.
    21. David G. Rand & Alexander Peysakhovich & Gordon T. Kraft-Todd & George E. Newman & Owen Wurzbacher & Martin A. Nowak & Joshua D. Greene, 2014. "Social heuristics shape intuitive cooperation," Nature Communications, Nature, vol. 5(1), pages 1-12, May.
    22. Goeschl, Timo & Lohse, Johannes, 2018. "Cooperation in public good games. Calculated or confused?," European Economic Review, Elsevier, vol. 107(C), pages 185-203.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    2. Bilancini, Ennio & Boncinelli, Leonardo & Guarnieri, Pietro & Spadoni, Lorenzo, 2023. "Delaying and motivating decisions in the (Bully) dictator game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    3. Anna Louisa Merkel & Johannes Lohse, 2019. "Is fairness intuitive? An experiment accounting for subjective utility differences under time pressure," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 24-50, March.
    4. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    5. Strømland, Eirik & Torsvik, Gaute, 2019. "Intuitive Prosociality: Heterogeneous Treatment Effects or False Positive?," OSF Preprints hrx2y, Center for Open Science.
    6. Sascha Grehl & Andreas Tutić, 2022. "Intuition, reflection, and prosociality: Evidence from a field experiment," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-14, February.
    7. Ayşegül Engin, 2021. "The cognitive ability and working memory framework: Interpreting cognitive reflection test results in the domain of the cognitive experiential theory," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 29(1), pages 227-245, March.
    8. Jimenez, Natalia & Rodriguez-Lara, Ismael & Tyran, Jean-Robert & Wengström, Erik, 2018. "Thinking fast, thinking badly," Economics Letters, Elsevier, vol. 162(C), pages 41-44.
    9. Kvarven, Amanda & Strømland, Eirik & Torsvik, Gaute, 2025. "Estimating Heterogeneity in Intuitive Prosociality," OSF Preprints 4kxsu, Center for Open Science.
    10. Alós-Ferrer, Carlos & Garagnani, Michele, 2020. "The cognitive foundations of cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 71-85.
    11. Alós-Ferrer, Carlos & Hügelschäfer, Sabine, 2016. "Faith in intuition and cognitive reflection," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 61-70.
    12. Amanda Kvarven & Eirik Strømland & Conny Wollbrant & David Andersson & Magnus Johannesson & Gustav Tinghög & Daniel Västfjäll & Kristian Ove R. Myrseth, 2020. "The intuitive cooperation hypothesis revisited: a meta-analytic examination of effect size and between-study heterogeneity," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(1), pages 26-42, June.
    13. Jinrui Pan & Jason Shachat & Sijia Wei, 2020. "Cognitive reflection and economic order quantity inventory management: An experimental investigation," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(6), pages 998-1009, September.
    14. Martin G. Kocher & Peter Martinsson & Kristian Ove R. Myrseth & Conny E. Wollbrant, 2017. "Strong, bold, and kind: self-control and cooperation in social dilemmas," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 44-69, March.
    15. Lohse, Tim & Simon, Sven A. & Konrad, Kai A., 2018. "Deception under time pressure: Conscious decision or a problem of awareness?," Journal of Economic Behavior & Organization, Elsevier, vol. 146(C), pages 31-42.
    16. Ennio Bilancini & Leonardo Boncinelli & Lorenzo Spadoni, 2020. "Motivating Risky Choices Increases Risk Taking," Working Papers CESARE 1/2020, Dipartimento di Economia e Finanza, LUISS Guido Carli.
    17. Benjamin Enke & Uri Gneezy & Brian Hall & David Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2020. "Cognitive Biases: Mistakes or Missing Stakes?," CESifo Working Paper Series 8168, CESifo.
    18. Deck, Cary & Jahedi, Salar & Sheremeta, Roman, 2021. "On the consistency of cognitive load," European Economic Review, Elsevier, vol. 134(C).
    19. Cueva, Carlos & Iturbe-Ormaetxe, Iñigo & Mata-Pérez, Esther & Ponti, Giovanni & Sartarelli, Marcello & Yu, Haihan & Zhukova, Vita, 2016. "Cognitive (ir)reflection: New experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 81-93.
    20. Krawczyk, Michał & Sylwestrzak, Marta, 2018. "Exploring the role of deliberation time in non-selfish behavior: The double response method," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 121-134.

    More about this item

    Keywords

    Cognitive reflection test; Time pressure; Time delay;
    All these keywords.

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:112:y:2024:i:c:s2214804324001101. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.