IDEAS home Printed from https://ideas.repec.org/a/kap/jrisku/v66y2023i2d10.1007_s11166-022-09389-6.html
   My bibliography  Save this article

Pay every subject or pay only some?

Author

Listed:
  • Lisa R. Anderson

    (College of William and Mary)

  • Beth A. Freeborn

    (Federal Trade Commission)

  • Patrick McAlvanah

    (Federal Trade Commission)

  • Andrew Turscak

    (College of William and Mary)

Abstract

Measuring risk tolerance is of interest to policymakers given its importance in decision-making, and previous research has shown that the scale of payoffs influences elicited risk aversion levels. Sometimes budget-conscious researchers pay only some subjects for their decisions when eliciting risk preferences, or pay smaller stakes to everyone. We test the effect of paying some versus paying all subjects in the context of risk preferences, controlling for the difference in stakes induced by paying only some subjects. Paying some subjects yields lower levels of risk aversion than paying everyone, but more risk aversion than paying all subjects lower stakes. Paying some subjects also impacts the ordering of subjects by elicited risk aversion. We estimate a simple structural model of latent risk aversion that derives a correction factor to approximate paying high stakes to all subjects. Paying some subjects high stakes meaningfully impacts the elicited level of risk aversion, but better approximates the condition of paying all subjects high stakes compared to paying everyone lower stakes.

Suggested Citation

  • Lisa R. Anderson & Beth A. Freeborn & Patrick McAlvanah & Andrew Turscak, 2023. "Pay every subject or pay only some?," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 161-188, April.
    • Handle: RePEc:kap:jrisku:v:66:y:2023:i:2:d:10.1007_s11166-022-09389-6
    DOI: 10.1007/s11166-022-09389-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11166-022-09389-6
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11166-022-09389-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Segal, Uzi, 1990. "Two-Stage Lotteries without the Reduction Axiom," Econometrica, Econometric Society, vol. 58(2), pages 349-377, March.
    2. Mohammed Abdellaoui & Peter Klibanoff & Lætitia Placido, 2015. "Experiments on Compound Risk in Relation to Simple Risk and to Ambiguity," Management Science, INFORMS, vol. 61(6), pages 1306-1322, June.
    3. Clot, Sophie & Grolleau, Gilles & Ibanez, Lisette, 2018. "Shall we pay all? An experimental test of Random Incentivized Systems," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 73(C), pages 93-98.
    4. David J. Freeman & Yoram Halevy & Terri Kneeland, 2019. "Eliciting risk preferences using choice lists," Quantitative Economics, Econometric Society, vol. 10(1), pages 217-237, January.
    5. Hajimoladarvish, Narges, 2018. "How do people reduce compound lotteries?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 75(C), pages 126-133.
    6. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
    7. Charness, Gary & Gneezy, Uri & Halladay, Brianna, 2016. "Experimental methods: Pay one or pay all," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 141-150.
    8. Han Bleichrodt & Jose Luis Pinto, 2000. "A Parameter-Free Elicitation of the Probability Weighting Function in Medical Decision Analysis," Management Science, INFORMS, vol. 46(11), pages 1485-1496, November.
    9. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    10. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    11. Helga Fehr-Duda & Adrian Bruhin & Thomas Epper & Renate Schubert, 2010. "Rationality on the rise: Why relative risk aversion increases with stake size," Journal of Risk and Uncertainty, Springer, vol. 40(2), pages 147-180, April.
    12. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency, Heterogeneity, and Granularity of Individual Behavior under Uncertainty," Economics Working Papers 0076, Institute for Advanced Study, School of Social Science.
    13. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    14. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    15. Levon Barseghyan & Jeffrey Prince & Joshua C. Teitelbaum, 2011. "Are Risk Preferences Stable across Contexts? Evidence from Insurance Data," American Economic Review, American Economic Association, vol. 101(2), pages 591-631, April.
    16. Binswanger, Hans P, 1981. "Attitudes toward Risk: Theoretical Implications of an Experiment in Rural India," Economic Journal, Royal Economic Society, vol. 91(364), pages 867-890, December.
    17. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2015. "Reduction of compound lotteries with objective probabilities: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 32-55.
    18. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
    19. Susan K. Laury, 2006. "Pay One or Pay All: Random Selection of One Choice for Payment," Experimental Economics Center Working Paper Series 2006-24, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    20. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    21. Guido Baltussen & G. Post & Martijn Assem & Peter Wakker, 2012. "Random incentive systems in a dynamic choice experiment," Experimental Economics, Springer;Economic Science Association, vol. 15(3), pages 418-443, September.
    22. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    23. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    24. Henry Stott, 2006. "Cumulative prospect theory's functional menagerie," Journal of Risk and Uncertainty, Springer, vol. 32(2), pages 101-130, March.
    25. George Wu & Richard Gonzalez, 1996. "Curvature of the Probability Weighting Function," Management Science, INFORMS, vol. 42(12), pages 1676-1690, December.
    26. Robin Cubitt & Chris Starmer & Robert Sugden, 1998. "On the Validity of the Random Lottery Incentive System," Experimental Economics, Springer;Economic Science Association, vol. 1(2), pages 115-131, September.
    27. Drazen Prelec, 1998. "The Probability Weighting Function," Econometrica, Econometric Society, vol. 66(3), pages 497-528, May.
    28. Robert B. Barsky & F. Thomas Juster & Miles S. Kimball & Matthew D. Shapiro, 1997. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 537-579.
    29. Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
    30. Mickael Beaud & Marc Willinger, 2015. "Are People Risk Vulnerable?," Management Science, INFORMS, vol. 61(3), pages 624-636, March.
    31. Christoph March & Anthony Ziegelmeyer & Ben Greiner & René Cyranek, 2016. "Pay Few Subjects but Pay Them Well: Cost-Effectiveness of Random Incentive Systems," CESifo Working Paper Series 5988, CESifo.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    2. Vieider, Ferdinand M. & Truong, Nghi & Martinsson, Peter & Pham Khanh Nam & Martinsson, Peter, 2013. "Risk preferences and development revisited: A field experiment in Vietnam," Discussion Papers, WZB Junior Research Group Risk and Development SP II 2013-403, WZB Berlin Social Science Center.
    3. Hajimoladarvish, Narges, 2018. "How do people reduce compound lotteries?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 75(C), pages 126-133.
    4. Patrick DeJarnette & David Dillenberger & Daniel Gottlieb & Pietro Ortoleva, 2020. "Time Lotteries and Stochastic Impatience," Econometrica, Econometric Society, vol. 88(2), pages 619-656, March.
    5. Aurélien Baillon & Han Bleichrodt & Vitalie Spinu, 2020. "Searching for the Reference Point," Management Science, INFORMS, vol. 66(1), pages 93-112, January.
    6. Ferdinand M. Vieider & Peter Martinsson & Pham Khanh Nam & Nghi Truong, 2019. "Risk preferences and development revisited," Theory and Decision, Springer, vol. 86(1), pages 1-21, February.
    7. Aleksandr Alekseev, 2022. "Give me a challenge or give me a raise," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 170-202, February.
    8. Adam Booij & Bernard Praag & Gijs Kuilen, 2010. "A parametric analysis of prospect theory’s functionals for the general population," Theory and Decision, Springer, vol. 68(1), pages 115-148, February.
    9. Stephan Jagau & Theo Offerman, 2018. "Defaults, normative anchors, and the occurrence of risky and cautious shifts," Journal of Risk and Uncertainty, Springer, vol. 56(3), pages 211-236, June.
    10. Filiz-Ozbay, Emel & Guryan, Jonathan & Hyndman, Kyle & Kearney, Melissa & Ozbay, Erkut Y., 2015. "Do lottery payments induce savings behavior? Evidence from the lab," Journal of Public Economics, Elsevier, vol. 126(C), pages 1-24.
    11. Anna Conte & M. Vittoria Levati & Chiara Nardi, 2018. "Risk Preferences and the Role of Emotions," Economica, London School of Economics and Political Science, vol. 85(338), pages 305-328, April.
    12. Ulrich Schmidt & Christian Seidl, 2014. "Reconsidering the common ratio effect: the roles of compound independence, reduction, and coalescing," Theory and Decision, Springer, vol. 77(3), pages 323-339, October.
    13. Charness, Gary & Gneezy, Uri & Halladay, Brianna, 2016. "Experimental methods: Pay one or pay all," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 141-150.
    14. Sébastien Duchêne & Adrien Nguyen-Huu & Dimitri Dubois & Marc Willinger, 2022. "Risk-return trade-offs in the context of environmental impact: a lab-in-the-field experiment with finance professionals," CEE-M Working Papers hal-03883121, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    15. Ranoua Bouchouicha & Ferdinand M. Vieider, 2017. "Accommodating stake effects under prospect theory," Journal of Risk and Uncertainty, Springer, vol. 55(1), pages 1-28, August.
    16. Patrick DeJarnette & David Dillenberger & Daniel Gottlieb & Pietro Ortoleva, 2014. "Time Lotteries, Second Version," PIER Working Paper Archive 15-026v2, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 12 Jan 2018.
    17. Marc Scholten & Daniel Read, 2014. "Prospect theory and the “forgotten” fourfold pattern of risk preferences," Journal of Risk and Uncertainty, Springer, vol. 48(1), pages 67-83, February.
    18. Jonathan Chapman & Erik Snowberg & Stephanie Wang & Colin Camerer, 2018. "Loss Attitudes in the U.S. Population: Evidence from Dynamically Optimized Sequential Experimentation (DOSE)," NBER Working Papers 25072, National Bureau of Economic Research, Inc.
    19. Nathaniel T. Wilcox, 2024. "Conditional independence in a binary choice experiment," Journal of Risk and Uncertainty, Springer, vol. 68(3), pages 205-225, June.
    20. Víctor González-Jiménez, 2021. "Incentive contracts when agents distort probabilities," Vienna Economics Papers vie2101, University of Vienna, Department of Economics.

    More about this item

    Keywords

    Experimental methodology; Payment methods; Incentives; Risk elicitation;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jrisku:v:66:y:2023:i:2:d:10.1007_s11166-022-09389-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.