IDEAS home Printed from https://ideas.repec.org/a/kap/expeco/v15y2012i3p418-443.html
   My bibliography  Save this article

Random incentive systems in a dynamic choice experiment

Author

Listed:
  • Guido Baltussen
  • G. Post
  • Martijn Assem
  • Peter Wakker

Abstract

Experiments frequently use a random incentive system (RIS), where only tasks that are randomly selected at the end of the experiment are for real. The most common type pays every subject one out of her multiple tasks (within-subjects randomization). Recently, another type has become popular, where a subset of subjects is randomly selected, and only these subjects receive one real payment (between-subjects randomization). In earlier tests with simple, static tasks, RISs performed well. The present study investigates RISs in a more complex, dynamic choice experiment. We find that between-subjects randomization reduces risk aversion. While within-subjects randomization delivers unbiased measurements of risk aversion, it does not eliminate carry-over effects from previous tasks. Both types generate an increase in subjects’ error rates. These results suggest that caution is warranted when applying RISs to more complex and dynamic tasks. Copyright The Author(s) 2012

Suggested Citation

  • Guido Baltussen & G. Post & Martijn Assem & Peter Wakker, 2012. "Random incentive systems in a dynamic choice experiment," Experimental Economics, Springer;Economic Science Association, vol. 15(3), pages 418-443, September.
    • Handle: RePEc:kap:expeco:v:15:y:2012:i:3:p:418-443
    DOI: 10.1007/s10683-011-9306-4
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10683-011-9306-4
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10683-011-9306-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jinkwon Lee, 2008. "The effect of the background risk in a simple chance improving decision model," Journal of Risk and Uncertainty, Springer, vol. 36(1), pages 19-41, February.
    2. Green, Donald & Jacowitz, Karen E. & Kahneman, Daniel & McFadden, Daniel, 1998. "Referendum contingent valuation, anchoring, and willingness to pay for public goods," Resource and Energy Economics, Elsevier, vol. 20(2), pages 85-116, June.
    3. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    4. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    5. Bolle, Friedel, 1990. "High reward experiments without high expenditure for the experimenter?," Journal of Economic Psychology, Elsevier, vol. 11(2), pages 157-167, June.
    6. Myagkov, Mikhail & Plott, Charles R, 1997. "Exchange Economies and Loss Exposure: Experiments Exploring Prospect Theory and Competitive Equilibria in Market Environments," American Economic Review, American Economic Association, vol. 87(5), pages 801-828, December.
    7. Cho, Younghee & Luce, R. Duncan, 1995. "Tests of Hypotheses about Certainty Equivalents and Joint Receipt of Gambles," Organizational Behavior and Human Decision Processes, Elsevier, vol. 64(3), pages 229-248, December.
    8. Thierry Post & Martijn J. van den Assem & Guido Baltussen & Richard H. Thaler, 2008. "Deal or No Deal? Decision Making under Risk in a Large-Payoff Game Show," American Economic Review, American Economic Association, vol. 98(1), pages 38-71, March.
    9. Robert Brooks & Robert Faff & Daniel Mulino & Richard Scheelings, 2009. "Deal or No Deal, That is the Question: The Impact of Increasing Stakes and Framing Effects on Decision‐Making under Risk," International Review of Finance, International Review of Finance Ltd., vol. 9(1‐2), pages 27-50, March.
    10. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    11. R. N. Rosett, 1971. "Weak Experimental Verification of the Expected Utility Hypothesis," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 38(4), pages 481-492.
    12. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    13. Cohen, Michele & Jaffray, Jean-Yves & Said, Tanios, 1987. "Experimental comparison of individual behavior under risk and under uncertainty for gains and for losses," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(1), pages 1-22, February.
    14. Peter Moffatt, 2005. "Stochastic Choice and the Allocation of Cognitive Effort," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 369-388, December.
    15. Schunk, Daniel & Betsch, Cornelia, 2006. "Explaining heterogeneity in utility functions by individual differences in decision modes," Journal of Economic Psychology, Elsevier, vol. 27(3), pages 386-401, June.
    16. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    17. Harrison, Glenn W, 1989. "Theory and Misbehavior of First-Price Auctions," American Economic Review, American Economic Association, vol. 79(4), pages 749-762, September.
    18. Pavlo Blavatskyy & Ganna Pogrebna, 2008. "Risk Aversion when Gains are Likely and Unlikely: Evidence from a Natural Experiment with Large Stakes," Theory and Decision, Springer, vol. 64(2), pages 395-420, March.
    19. Gächter, Simon & Orzen, Henrik & Renner, Elke & Starmer, Chris, 2009. "Are experimental economists prone to framing effects? A natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 443-446, June.
    20. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    21. Richard H. Thaler & Eric J. Johnson, 1990. "Gambling with the House Money and Trying to Break Even: The Effects of Prior Outcomes on Risky Choice," Management Science, INFORMS, vol. 36(6), pages 643-660, June.
    22. Pavlo R. Blavatskyy & Ganna Pogrebna, 2010. "Models of stochastic choice and decision theories: why both are important for analyzing decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(6), pages 963-986.
    23. Peter Moffatt & Simon Peters, 2001. "Testing for the Presence of a Tremble in Economic Experiments," Experimental Economics, Springer;Economic Science Association, vol. 4(3), pages 221-228, December.
    24. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-1289, November.
    25. John Hey & Jinkwon Lee, 2005. "Do subjects remember the past?," Applied Economics, Taylor & Francis Journals, vol. 37(1), pages 9-18.
    26. John Hey & Jinkwon Lee, 2005. "Do Subjects Separate (or Are They Sophisticated)?," Experimental Economics, Springer;Economic Science Association, vol. 8(3), pages 233-265, September.
    27. Olivier Armantier, 2006. "Do Wealth Differences Affect Fairness Considerations?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 391-429, May.
    28. Keren, Gideon B. & Raaijmakers, Jeroen G. W., 1988. "On between-subjects versus within-subjects comparisons in testing utility theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(2), pages 233-247, April.
    29. Reilly, Robert J, 1982. "Preference Reversal: Further Evidence and Some Suggested Modifications in Experimental Design," American Economic Review, American Economic Association, vol. 72(3), pages 576-584, June.
    30. Matthew Rabin, 2002. "Inference by Believers in the Law of Small Numbers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 775-816.
    31. John D. Hey, 2018. "Experimental investigations of errors in decision making under risk," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 17, pages 381-388, World Scientific Publishing Co. Pte. Ltd..
    32. Chris Starmer, 2000. "Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 332-382, June.
    33. Langer, Thomas & Weber, Martin, 2008. "Does commitment or feedback influence myopic loss aversion?: An experimental analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 67(3-4), pages 810-819, September.
    34. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    35. Bettinger, Eric & Slonim, Robert, 2007. "Patience among children," Journal of Public Economics, Elsevier, vol. 91(1-2), pages 343-363, February.
    36. Camerer, Colin F & Ho, Teck-Hua, 1994. "Violations of the Betweenness Axiom and Nonlinearity in Probability," Journal of Risk and Uncertainty, Springer, vol. 8(2), pages 167-196, March.
    37. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    38. Beattie, Jane & Loomes, Graham, 1997. "The Impact of Incentives upon Risky Choice Experiments," Journal of Risk and Uncertainty, Springer, vol. 14(2), pages 155-168, March.
    39. Eric J. Johnson & David A. Schkade, 1989. "Bias in Utility Assessments: Further Evidence and Explanations," Management Science, INFORMS, vol. 35(4), pages 406-424, April.
    40. Wakker,Peter P., 2010. "Prospect Theory," Cambridge Books, Cambridge University Press, number 9780521765015.
    41. Kuhberger, Anton & Schulte-Mecklenbeck, Michael & Perner, Josef, 1999. "The Effects of Framing, Reflection, Probability, and Payoff on Risk Preference in Choice Tasks, ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 78(3), pages 204-231, June.
    42. Robin Cubitt & Chris Starmer & Robert Sugden, 1998. "On the Validity of the Random Lottery Incentive System," Experimental Economics, Springer;Economic Science Association, vol. 1(2), pages 115-131, September.
    43. Kuhberger, Anton & Schulte-Mecklenbeck, Michael & Perner, Josef, 2002. "Framing decisions: Hypothetical and real," Organizational Behavior and Human Decision Processes, Elsevier, vol. 89(2), pages 1162-1175, November.
    44. Kameda, Tatsuya & Davis, James H., 1990. "The function of the reference point in individual and group risk decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 46(1), pages 55-76, June.
    45. Cary Deck & Jungmin Lee & Javier Reyes, 2008. "Risk attitudes in large stake gambles: evidence from a game show," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 41-52.
    46. Wilcox, Nathaniel T, 1993. "Lottery Choice: Incentives, Complexity and Decision Time," Economic Journal, Royal Economic Society, vol. 103(421), pages 1397-1417, November.
    47. Sefton, Martin, 1992. "Incentives in simple bargaining games," Journal of Economic Psychology, Elsevier, vol. 13(2), pages 263-276, June.
    48. Grether, David M & Plott, Charles R, 1979. "Economic Theory of Choice and the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 69(4), pages 623-638, September.
    49. Jeffrey M. Wooldridge, 2003. "Cluster-Sample Methods in Applied Econometrics," American Economic Review, American Economic Association, vol. 93(2), pages 133-138, May.
    50. Cubitt, Robin P & Starmer, Chris & Sugden, Robert, 1998. "Dynamic Choice and the Common Ratio Effect: An Experimental Investigation," Economic Journal, Royal Economic Society, vol. 108(450), pages 1362-1380, September.
    51. Menahem E. Yaari, 1965. "Convexity in the Theory of Choice under Risk," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 79(2), pages 278-290.
    52. Cox, James C & Epstein, Seth, 1989. "Preference Reversals without the Independence Axiom," American Economic Review, American Economic Association, vol. 79(3), pages 408-426, June.
    53. Kahneman, Daniel, 2002. "Maps of Bounded Rationality," Nobel Prize in Economics documents 2002-4, Nobel Prize Committee.
    54. Ariely, Dan & Loewenstein, George & Prelec, Drazen, 2006. "Tom Sawyer and the construction of value," Journal of Economic Behavior & Organization, Elsevier, vol. 60(1), pages 1-10, May.
    55. Harrison, Glenn W, 1994. "Expected Utility Theory and the Experimentalists," Empirical Economics, Springer, vol. 19(2), pages 223-253.
    56. Camerer, Colin F, 1989. "An Experimental Test of Several Generalized Utility Theories," Journal of Risk and Uncertainty, Springer, vol. 2(1), pages 61-104, April.
    57. Holt, Charles A, 1986. "Preference Reversals and the Independence Axiom," American Economic Review, American Economic Association, vol. 76(3), pages 508-515, June.
    58. Stahl, Dale O. & Haruvy, Ernan, 2006. "Other-regarding preferences: Egalitarian warm glow, empathy, and group size," Journal of Economic Behavior & Organization, Elsevier, vol. 61(1), pages 20-41, September.
    59. Carlin, Paul S., 1992. "Violations of the reduction and independence axioms in Allais-type and common-ratio effect experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 19(2), pages 213-235, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    2. Peter Wakker & Veronika Köbberling & Christiane Schwieren, 2007. "Prospect-theory’s Diminishing Sensitivity Versus Economics’ Intrinsic Utility of Money: How the Introduction of the Euro can be Used to Disentangle the Two Empirically," Theory and Decision, Springer, vol. 63(3), pages 205-231, November.
    3. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    4. Stephan Jagau & Theo Offerman, 2018. "Defaults, normative anchors, and the occurrence of risky and cautious shifts," Journal of Risk and Uncertainty, Springer, vol. 56(3), pages 211-236, June.
    5. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    6. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    7. Ferdinand Vieider, 2011. "Separating real incentives and accountability," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 507-518, November.
    8. Glenn Harrison & J. Swarthout, 2014. "Experimental payment protocols and the Bipolar Behaviorist," Theory and Decision, Springer, vol. 77(3), pages 423-438, October.
    9. Glenn W. Harrison & J. Todd Swarthout, 2016. "Cumulative Prospect Theory in the Laboratory: A Reconsideration," Experimental Economics Center Working Paper Series 2016-04, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    10. Maria J. Ruiz Martos, 2018. "Sequential Common Consequence Effect and Incentives," ThE Papers 18/04, Department of Economic Theory and Economic History of the University of Granada..
    11. Peter Brooks & Horst Zank, 2005. "Loss Averse Behavior," Journal of Risk and Uncertainty, Springer, vol. 31(3), pages 301-325, December.
    12. Berg, Joyce E. & Dickhaut, John W. & Rietz, Thomas A., 2010. "Preference reversals: The impact of truth-revealing monetary incentives," Games and Economic Behavior, Elsevier, vol. 68(2), pages 443-468, March.
    13. Jinkwon Lee, 2008. "The effect of the background risk in a simple chance improving decision model," Journal of Risk and Uncertainty, Springer, vol. 36(1), pages 19-41, February.
    14. Nathalie Etchart-Vincent & Olivier l’Haridon, 2011. "Monetary incentives in the loss domain and behavior toward risk: An experimental comparison of three reward schemes including real losses," Journal of Risk and Uncertainty, Springer, vol. 42(1), pages 61-83, February.
    15. Ulrich Schmidt & Christian Seidl, 2014. "Reconsidering the common ratio effect: the roles of compound independence, reduction, and coalescing," Theory and Decision, Springer, vol. 77(3), pages 323-339, October.
    16. Clot, Sophie & Grolleau, Gilles & Ibanez, Lisette, 2018. "Shall we pay all? An experimental test of Random Incentivized Systems," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 73(C), pages 93-98.
    17. Elif Incekara-Hafalir & Eungsik Kim & Jack D. Stecher, 2021. "Is the Allais paradox due to appeal of certainty or aversion to zero?," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 751-771, September.
    18. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    19. Alexander Harin, 2024. "About a “Certain-uncertain†Inconsistency within the Generally Accepted Experimental Procedures of Behavioral Economics," International Journal of Economics and Financial Research, Academic Research Publishing Group, vol. 10(2), pages 17-30, 06-2024.
    20. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2010. "Behavioral econometrics for psychologists," Journal of Economic Psychology, Elsevier, vol. 31(4), pages 553-576, August.

    More about this item

    Keywords

    Random incentive system; Incentives; Experimental measurement; Risky choice; Risk aversion; Dynamic choice; Tremble; Within-subjects design; Between-subjects design; C91; D81;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:expeco:v:15:y:2012:i:3:p:418-443. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.