IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v85y2020ics221480431930357x.html
   My bibliography  Save this article

Heterogeneous motivation and cognitive ability in the lab

Author

Listed:
  • Taylor, Matthew P.

Abstract

I test whether economics experiments that estimate the relationships between cognitive ability and economic behavior are biased because they fail to account for differences in motivation among subjects when they measure cognitive ability without compensating them for performance. I find that monetary incentives do not significantly improve average performance on cognitive reflection test (CRT) questions, but subjects classified as low ability based on unpaid scores tend to improve their performance when they are paid for performance relative to high ability subjects. This heterogeneous response to monetary incentives appears to bias estimates of the relationships between cognitive ability and trust and risk aversion downward, but does not have the same systematic effect for strategic reasoning.

Suggested Citation

  • Taylor, Matthew P., 2020. "Heterogeneous motivation and cognitive ability in the lab," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    • Handle: RePEc:eee:soceco:v:85:y:2020:i:c:s221480431930357x
    DOI: 10.1016/j.socec.2020.101523
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S221480431930357X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2020.101523?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Louis Lévy-Garboua & Hela Maafi & David Masclet & Antoine Terracol, 2012. "Risk aversion and framing effects," Experimental Economics, Springer;Economic Science Association, vol. 15(1), pages 128-144, March.
    2. repec:cup:judgdm:v:9:y:2014:i:2:p:148-151 is not listed on IDEAS
    3. Uri Gneezy & Aldo Rustichini, 2000. "Pay Enough or Don't Pay at All," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 791-810.
    4. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    5. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2016. "Risk Aversion Relates to Cognitive Ability: Preferences Or Noise?," Journal of the European Economic Association, European Economic Association, vol. 14(5), pages 1129-1154.
    6. Oechssler, Jörg & Roider, Andreas & Schmitz, Patrick W., 2009. "Cognitive abilities and behavioral biases," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 147-152, October.
    7. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    8. Pokorny, Kathrin, 2008. "Pay--but do not pay too much: An experimental study on the impact of incentives," Journal of Economic Behavior & Organization, Elsevier, vol. 66(2), pages 251-264, May.
    9. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    10. Carpenter, Jeffrey & Graham, Michael & Wolf, Jesse, 2013. "Cognitive ability and strategic sophistication," Games and Economic Behavior, Elsevier, vol. 80(C), pages 115-130.
    11. Cox, James C., 2004. "How to identify trust and reciprocity," Games and Economic Behavior, Elsevier, vol. 46(2), pages 260-281, February.
    12. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    13. Amador, Luis & Brañas-Garza, Pablo & Espín, Antonio M. & Garcia, Teresa & Hernández, Ana, 2019. "Consistent and inconsistent choices under uncertainty: The role of cognitive abilities," MPRA Paper 95178, University Library of Munich, Germany.
    14. Cueva, Carlos & Iturbe-Ormaetxe, Iñigo & Mata-Pérez, Esther & Ponti, Giovanni & Sartarelli, Marcello & Yu, Haihan & Zhukova, Vita, 2016. "Cognitive (ir)reflection: New experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 81-93.
    15. David Gill & Victoria Prowse, 2016. "Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1619-1676.
    16. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    17. Taylor, Matthew P., 2016. "Are high-ability individuals really more tolerant of risk? A test of the relationship between risk aversion and cognitive ability," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 63(C), pages 136-147.
    18. Dessi, Roberta & Rustichini, Aldo, 2015. "Strong intrinsic motivation," IDEI Working Papers 847, Institut d'Économie Industrielle (IDEI), Toulouse.
    19. repec:cup:judgdm:v:11:y:2016:i:1:p:99-113 is not listed on IDEAS
    20. Glenn W. Harrison, 2006. "Hypothetical Bias Over Uncertain Outcomes," Chapters, in: John A. List (ed.), Using Experimental Methods in Environmental and Resource Economics, chapter 3, Edward Elgar Publishing.
    21. Pablo Brañas‐Garza & Matteo M. Galizzi & Jeroen Nieboer, 2018. "Experimental And Self‐Reported Measures Of Risk Taking And Digit Ratio (2d:4d): Evidence From A Large, Systematic Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(3), pages 1131-1157, August.
    22. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    23. Oliver Schnusenberg & Andrés Gallo, 2011. "On Cognitive Ability and Learning in a Beauty Contest," Journal for Economic Educators, Middle Tennessee State University, Business and Economic Research Center, vol. 11(1), pages 13-24, Summer.
    24. repec:cup:judgdm:v:4:y:2009:i:1:p:20-33 is not listed on IDEAS
    25. Di Cagno, Daniela & Sciubba, Emanuela, 2010. "Trust, trustworthiness and social networks: Playing a trust game when networks are formed in the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 75(2), pages 156-167, August.
    26. Burnham, Terence C. & Cesarini, David & Johannesson, Magnus & Lichtenstein, Paul & Wallace, Björn, 2009. "Higher cognitive ability is associated with lower entries in a p-beauty contest," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 171-175, October.
    27. Andreas C. Drichoutis & Jayson L. Lusk, 2016. "What can multiple price lists really tell us about risk preferences?," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 89-106, December.
    28. Takahashi, Hiromasa & Shen, Junyi & Ogawa, Kazuhito, 2016. "An experimental examination of compensation schemes and level of effort in differentiated tasks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 61(C), pages 12-19.
    29. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    30. Noah Carl & Francesco C Billari, 2014. "Generalized Trust and Intelligence in the United States," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-10, March.
    31. Matthew Taylor, 2013. "Bias and brains: Risk aversion and cognitive ability across real and hypothetical settings," Journal of Risk and Uncertainty, Springer, vol. 46(3), pages 299-320, June.
    32. repec:cup:judgdm:v:5:y:2010:i:3:p:182-191 is not listed on IDEAS
    33. Corgnet, Brice & Espín, Antonio M. & Hernán-González, Roberto & Kujal, Praveen & Rassenti, Stephen, 2016. "To trust, or not to trust: Cognitive reflection in trust games," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 20-27.
    34. Buchan, Nancy R. & Croson, Rachel T.A. & Solnick, Sara, 2008. "Trust and gender: An examination of behavior and beliefs in the Investment Game," Journal of Economic Behavior & Organization, Elsevier, vol. 68(3-4), pages 466-476, December.
    35. repec:hal:pseose:hal-00617673 is not listed on IDEAS
    36. Garbarino, Ellen & Slonim, Robert, 2009. "The robustness of trust and reciprocity across a heterogeneous U.S. population," Journal of Economic Behavior & Organization, Elsevier, vol. 69(3), pages 226-240, March.
    37. Dietmar Fehr & Steffen Huck, 2016. "Who knows it is a game? On strategic awareness and cognitive ability," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 713-726, December.
    38. Brañas-Garza, Pablo & Smith, John, 2016. "Cognitive abilities and economic behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 1-4.
    39. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    40. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dorner, Zack & Lancsar, Emily, 2023. "Don’t pay the highly motivated too much," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    2. Graham, Byron & Bonner, Karen, 2022. "One size fits all? Using machine learning to study heterogeneity and dominance in the determinants of early-stage entrepreneurship," Journal of Business Research, Elsevier, vol. 152(C), pages 42-59.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas Eber & Patrick Roger & Tristan Roger, 2024. "Finance and intelligence: An overview of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 503-554, April.
    2. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    3. Allred, Sarah & Duffy, Sean & Smith, John, 2016. "Cognitive load and strategic sophistication," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 162-178.
    4. Rassenti, Stephen & Espin, Antonio M. & Kujal, Praveen, 2017. "Humans’ (incorrect) distrust of reflective decisions," CEPR Discussion Papers 11949, C.E.P.R. Discussion Papers.
    5. Antonio Cabrales & Antonio M. Espín & Praveen Kujal & Stephen Rassenti, 2017. "Humans’ (incorrect) distrust of reflective decisions," Working Papers 17-05, Chapman University, Economic Science Institute.
    6. Antonio M. Espin & Valerio Capraro & Brice Corgnet & Simon Gachter & Roberto Hernan-Gonzalez & Praveen Kujal & Stephen Rassenti, 2021. "Differences in Cognitive Reflection Mediate Gender Differences in Social Preferences," Working Papers 21-22, Chapman University, Economic Science Institute.
    7. Brañas-Garza, Pablo & Smith, John, 2016. "Cognitive abilities and economic behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 1-4.
    8. Amador, Luis & Brañas-Garza, Pablo & Espín, Antonio M. & Garcia, Teresa & Hernández, Ana, 2019. "Consistent and inconsistent choices under uncertainty: The role of cognitive abilities," MPRA Paper 95178, University Library of Munich, Germany.
    9. Duffy, Sean & Smith, John, 2014. "Cognitive load in the multi-player prisoner's dilemma game: Are there brains in games?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 51(C), pages 47-56.
    10. Chen, Chia-Ching & Chiu, I-Ming & Smith, John & Yamada, Tetsuji, 2013. "Too smart to be selfish? Measures of cognitive ability, social preferences, and consistency," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 112-122.
    11. Amador-Hidalgo, Luis & Brañas-Garza, Pablo & Espín, Antonio M. & García-Muñoz, Teresa & Hernández-Román, Ana, 2021. "Cognitive abilities and risk-taking: Errors, not preferences," European Economic Review, Elsevier, vol. 134(C).
    12. repec:cup:judgdm:v:15:y:2020:i:2:p:230-245 is not listed on IDEAS
    13. Oren Bar-Gill & Christoph Engel, 2020. "Property is Dummy Proof: An Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_02, Max Planck Institute for Research on Collective Goods.
    14. Joshua Zonca & Giorgio Coricelli & Luca Polonio, 2020. "Gaze patterns disclose the link between cognitive reflection and sophistication in strategic interaction," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(2), pages 230-245, March.
    15. repec:cup:judgdm:v:14:y:2019:i:3:p:234-279 is not listed on IDEAS
    16. Nobuyuki Hanaki & Nicolas Jacquemet & Stéphane Luchini & Adam Zylbersztejn, 2016. "Fluid intelligence and cognitive reflection in a strategic environment: evidence from dominance-solvable games," PSE-Ecole d'économie de Paris (Postprint) hal-01359231, HAL.
    17. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    18. Brice Corgnet & Cary Deck & Mark DeSantis & David Porter, 2022. "Forecasting Skills in Experimental Markets: Illusion or Reality?," Management Science, INFORMS, vol. 68(7), pages 5216-5232, July.
    19. Sean Duffy & J. J. Naddeo & David Owens & John Smith, 2024. "Cognitive Load and Mixed Strategies: On Brains and Minimax," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 26(03), pages 1-34, September.
    20. repec:cup:judgdm:v:14:y:2019:i:5:p:591-604 is not listed on IDEAS
    21. Daniel Horn & Hubert Janos Kiss, 2018. "Which preferences associate with school performance?—Lessons from an exploratory study with university students," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-32, February.
    22. Thomas Meissner & Xavier Gassmann & Corinne Faure & Joachim Schleich, 2023. "Individual characteristics associated with risk and time preferences: A multi country representative survey," Journal of Risk and Uncertainty, Springer, vol. 66(1), pages 77-107, February.
    23. van den Akker, Olmo R. & van Assen, Marcel A.L.M. & van Vugt, Mark & Wicherts, Jelte M., 2020. "Sex differences in trust and trustworthiness: A meta-analysis of the trust game and the gift-exchange game," Journal of Economic Psychology, Elsevier, vol. 81(C).

    More about this item

    Keywords

    Cognitive ability; Intrinsic motivation; Reasoning; Trust; Risk;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:85:y:2020:i:c:s221480431930357x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.