IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v176y2020icp634-652.html
   My bibliography  Save this article

Effort is not a monotonic function of skills: Results from a global mobile experiment

Author

Listed:
  • Grabiszewski, Konrad
  • Horenstein, Alex

Abstract

At the core of economic theory is the monotonicity hypothesis: an agent’s effort, as a function of their skills, is either non-decreasing or non-increasing, but not both. To test this hypothesis, we use data from Blues and Reds, a mobile app designed to conduct economic experiments that consists of a series of interactive puzzles. The sample includes 6,463 subjects from 141 countries. We measure subjects’ skills and effort levels using their response times. We replicate the same test 22 times. Surprisingly, each time we find that the optimal effort is not a monotonic function of skills but rather has a U-shape contradicting the monotonicity hypothesis.

Suggested Citation

  • Grabiszewski, Konrad & Horenstein, Alex, 2020. "Effort is not a monotonic function of skills: Results from a global mobile experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 634-652.
    • Handle: RePEc:eee:jeborg:v:176:y:2020:i:c:p:634-652
    DOI: 10.1016/j.jebo.2020.05.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268120301566
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jebo.2020.05.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Drew Fudenberg & Luis Rayo, 2019. "Training and Effort Dynamics in Apprenticeship," American Economic Review, American Economic Association, vol. 109(11), pages 3780-3812, November.
    2. R.J. Aumann & S. Hart (ed.), 2002. "Handbook of Game Theory with Economic Applications," Handbook of Game Theory with Economic Applications, Elsevier, edition 1, volume 3, number 3.
    3. Marina Agranov & Andrew Caplin & Chloe Tergiman, 2015. "Naive play and the process of choice in guessing games," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(2), pages 146-157, December.
    4. Ehrlinger, Joyce & Johnson, Kerri & Banner, Matthew & Dunning, David & Kruger, Justin, 2008. "Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent," Organizational Behavior and Human Decision Processes, Elsevier, vol. 105(1), pages 98-121, January.
    5. Gill, David & Prowse, Victoria L., 2017. "Using Response Times to Measure Strategic Complexity and the Value of Thinking in Games," IZA Discussion Papers 10518, Institute of Labor Economics (IZA).
    6. Charness, Gary & Gneezy, Uri & Henderson, Austin, 2018. "Experimental methods: Measuring effort in economics experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 74-87.
    7. Ariel Rubinstein, 2006. "Dilemmas of an Economic Theorist," Econometrica, Econometric Society, vol. 74(4), pages 865-883, July.
    8. Larbi Alaoui & Antonio Penta, 2016. "Endogenous Depth of Reasoning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1297-1333.
    9. David Gill & Victoria Prowse, 2016. "Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1619-1676.
    10. David Gill & Victoria Prowse, 2023. "Strategic Complexity and the Value of Thinking," The Economic Journal, Royal Economic Society, vol. 133(650), pages 761-786.
    11. Ignacio Palacios-Huerta & Oscar Volij, 2009. "Field Centipedes," American Economic Review, American Economic Association, vol. 99(4), pages 1619-1635, September.
    12. Arad, Ayala & Rubinstein, Ariel, 2012. "Multi-dimensional iterative reasoning in action: The case of the Colonel Blotto game," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 571-585.
    13. Milgrom, Paul & Shannon, Chris, 1994. "Monotone Comparative Statics," Econometrica, Econometric Society, vol. 62(1), pages 157-180, January.
    14. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    15. Agranov, Marina & Potamites, Elizabeth & Schotter, Andrew & Tergiman, Chloe, 2012. "Beliefs and endogenous cognitive levels: An experimental study," Games and Economic Behavior, Elsevier, vol. 75(2), pages 449-463.
    16. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 183-198.
    17. Vincenzo Verardi & Nicolas Debarsy, 2012. "Robinson's square root of N consistent semiparametric regression estimator in Stata," Stata Journal, StataCorp LP, vol. 12(4), pages 726-735, December.
    18. Dietmar Fehr & Steffen Huck, 2016. "Who knows it is a game? On strategic awareness and cognitive ability," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 713-726, December.
    19. Recalde, María P. & Riedl, Arno & Vesterlund, Lise, 2018. "Error-prone inference from response time: The case of intuitive generosity in public-good games," Journal of Public Economics, Elsevier, vol. 160(C), pages 132-147.
    20. Bonatti, Alessandro & Hörner, Johannes, 2017. "Career concerns with exponential learning," Theoretical Economics, Econometric Society, vol. 12(1), January.
    21. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part II: Application to Missions and Accountability of Government Agencies," Review of Economic Studies, Oxford University Press, vol. 66(1), pages 199-217.
    22. Ernst Fehr & Antonio Rangel, 2011. "Neuroeconomic Foundations of Economic Choice--Recent Advances," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 3-30, Fall.
    23. Susan Athey, 2002. "Monotone Comparative Statics under Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 187-223.
    24. Athey, Susan, 2001. "Single Crossing Properties and the Existence of Pure Strategy Equilibria in Games of Incomplete Information," Econometrica, Econometric Society, vol. 69(4), pages 861-889, July.
    25. Andrew Caplin & Daniel Martin, 2016. "The Dual-Process Drift Diffusion Model: Evidence From Response Times," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1274-1282, April.
    26. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    27. repec:cup:judgdm:v:5:y:2010:i:6:p:437-449 is not listed on IDEAS
    28. Vives, Xavier, 1990. "Nash equilibrium with strategic complementarities," Journal of Mathematical Economics, Elsevier, vol. 19(3), pages 305-321.
    29. Michael Woodford, 2014. "Stochastic Choice: An Optimizing Neuroeconomic Model," American Economic Review, American Economic Association, vol. 104(5), pages 495-500, May.
    30. Sen Geng, 2016. "Decision Time, Consideration Time, And Status Quo Bias," Economic Inquiry, Western Economic Association International, vol. 54(1), pages 433-449, January.
    31. Echenique, Federico & Saito, Kota, 2017. "Response time and utility," Journal of Economic Behavior & Organization, Elsevier, vol. 139(C), pages 49-59.
    32. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    33. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part II: Application to Missions and Accountability of Government Agencies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 199-217.
    34. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    35. Benjamin Enke & Florian Zimmermann, 2019. "Correlation Neglect in Belief Formation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 313-332.
    36. Johannes Lohse & Timo Goeschl & Johannes H. Diederich, 2017. "Giving is a Question of Time: Response Times and Contributions to an Environmental Public Good," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 67(3), pages 455-477, July.
    37. Schlösser, Thomas & Dunning, David & Johnson, Kerri L. & Kruger, Justin, 2013. "How unaware are the unskilled? Empirical tests of the “signal extraction” counterexplanation for the Dunning–Kruger effect in self-evaluation of performance," Journal of Economic Psychology, Elsevier, vol. 39(C), pages 85-100.
    38. Ariel Rubinstein, 2016. "A Typology of Players: Between Instinctive and Contemplative," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 859-890.
    39. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    40. Paul Ferraro, 2010. "Know Thyself: Competence and Self-awareness," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 38(2), pages 183-196, June.
    41. Ian Krajbich & Bastiaan Oud & Ernst Fehr, 2014. "Benefits of Neuroeconomic Modeling: New Policy Interventions and Predictors of Preference," American Economic Review, American Economic Association, vol. 104(5), pages 501-506, May.
    42. repec:mpr:mprres:7497 is not listed on IDEAS
    43. J. A. Mirrlees, 1971. "An Exploration in the Theory of Optimum Income Taxation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 38(2), pages 175-208.
    44. Marcus R. Munafò & Brian A. Nosek & Dorothy V. M. Bishop & Katherine S. Button & Christopher D. Chambers & Nathalie Percie du Sert & Uri Simonsohn & Eric-Jan Wagenmakers & Jennifer J. Ware & John P. A, 2017. "A manifesto for reproducible science," Nature Human Behaviour, Nature, vol. 1(1), pages 1-9, January.
    45. Elie Ofek & Muhamet Yildiz & Ernan Haruvy, 2007. "The Impact of Prior Decisions on Subsequent Valuations in a Costly Contemplation Model," Management Science, INFORMS, vol. 53(8), pages 1217-1233, August.
    46. Milgrom, Paul & Roberts, John, 1990. "Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities," Econometrica, Econometric Society, vol. 58(6), pages 1255-1277, November.
    47. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," Review of Economic Studies, Oxford University Press, vol. 66(1), pages 183-198.
    48. Gonzalo Cisternas, 2018. "Career Concerns and the Nature of Skills," American Economic Journal: Microeconomics, American Economic Association, vol. 10(2), pages 152-189, May.
    49. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    50. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhi Li & Po-Hsuan Lin & Si-Yuan Kong & Dongwu Wang & John Duffy, 2021. "Conducting large, repeated, multi-game economic experiments using mobile platforms," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-18, April.
    2. Konrad Grabiszewski & Alex Horenstein, 2022. "Profiling dynamic decision-makers," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-22, April.
    3. Grabiszewski, Konrad & Horenstein, Alex, 2022. "Measuring tree complexity with response times," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grabiszewski, Konrad & Horenstein, Alex, 2022. "Measuring tree complexity with response times," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    2. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    3. Konrad Grabiszewski & Alex Horenstein, 2022. "Profiling dynamic decision-makers," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-22, April.
    4. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    5. Recalde, María P. & Riedl, Arno & Vesterlund, Lise, 2018. "Error-prone inference from response time: The case of intuitive generosity in public-good games," Journal of Public Economics, Elsevier, vol. 160(C), pages 132-147.
    6. Cary Frydman & Ian Krajbich, 2022. "Using Response Times to Infer Others’ Private Information: An Application to Information Cascades," Management Science, INFORMS, vol. 68(4), pages 2970-2986, April.
    7. Moisson, Paul-Henri, 2024. "Meritocracy and Inequality," TSE Working Papers 24-1518, Toulouse School of Economics (TSE), revised Apr 2024.
    8. Alaoui, Larbi & Janezic, Katharina A. & Penta, Antonio, 2020. "Reasoning about others' reasoning," Journal of Economic Theory, Elsevier, vol. 189(C).
    9. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    10. Kets, Willemien & Kager, Wouter & Sandroni, Alvaro, 2022. "The value of a coordination game," Journal of Economic Theory, Elsevier, vol. 201(C).
    11. So, Tony, 2020. "Classroom experiments as a replication device," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    12. Avoyan, Ala & Schotter, Andrew, 2020. "Attention in games: An experimental study," European Economic Review, Elsevier, vol. 124(C).
    13. Leonidas Spiliopoulos & Andreas Ortmann, 2018. "The BCD of response time analysis in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 383-433, June.
    14. Mensch, Jeffrey, 2020. "On the existence of monotone pure-strategy perfect Bayesian equilibrium in games with complementarities," Journal of Economic Theory, Elsevier, vol. 187(C).
    15. Clithero, John A., 2018. "Improving out-of-sample predictions using response times and a model of the decision process," Journal of Economic Behavior & Organization, Elsevier, vol. 148(C), pages 344-375.
    16. Rabah Amir, 2005. "Supermodularity and Complementarity in Economics: An Elementary Survey," Southern Economic Journal, John Wiley & Sons, vol. 71(3), pages 636-660, January.
    17. Guidon Fenig & Giovanni Gallipoli & Yoram Halevy, 2018. "Piercing the 'Payoff Function' Veil: Tracing Beliefs and Motives," Working Papers tecipa-619, University of Toronto, Department of Economics.
    18. Krawczyk, Michał & Sylwestrzak, Marta, 2018. "Exploring the role of deliberation time in non-selfish behavior: The double response method," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 121-134.
    19. Andrew Schotter & Isabel Trevino, 2021. "Is response time predictive of choice? An experimental study of threshold strategies," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 87-117, March.
    20. Fudenberg, Drew & Georgiadis, George & Rayo, Luis, 2021. "Working to learn," Journal of Economic Theory, Elsevier, vol. 197(C).

    More about this item

    Keywords

    Monotonicity of choice; Effort; Skills; Experimental game theory; Mobile experiment;
    All these keywords.

    JEL classification:

    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:176:y:2020:i:c:p:634-652. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.