IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/120898.html
   My bibliography  Save this paper

Incentives and Payment Mechanisms in Preference Elicitation

Author

Listed:
  • Drichoutis, Andreas C.
  • Palma, Marco
  • Feldman, Paul

Abstract

Previous literature analyzing the effects of incentive compatibility of experimental payment mechanisms is dominated by theory. With overwhelming evidence of theory violations in a multiplicity of domains, we fill this gap by empirically exploring the effects of different payment mechanisms in induced preference elicitation using a large sample of over 3800 participants across three experiments. In Experiment 1, we collected responses for offer prices to sell a card like in Cason and Plott (2014), systematically varying on a between-subjects basis the way subjects received payments over repeated rounds, by either paying for all decisions (and various modifications) or just one, as well as making the payments certain, probabilistic or purely hypothetical. While we find that the magnitude of the induced value and the range of the prices used to draw a random price significantly affect misbidding behavior, neither the payment mechanism nor the certainty of payment affected misbidding. In Experiment 2, we replaced the BDM mechanism with a second price auction and found similar results, albeit less misbidding rates. In Experiment 3, we examine the effect of payment mechanisms on choice under risk and find portfolio effects (i.e., paying all rounds) when the lottery pairs do not involve options with certainty. Overall, our empirical exercise shows that payment mechanism design considerations should place more weight on the choice architecture rather than on incentive compatibility.

Suggested Citation

  • Drichoutis, Andreas C. & Palma, Marco & Feldman, Paul, 2024. "Incentives and Payment Mechanisms in Preference Elicitation," MPRA Paper 120898, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:120898
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/120898/1/MPRA_paper_120898.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Charness, Gary & Gneezy, Uri & Halladay, Brianna, 2016. "Experimental methods: Pay one or pay all," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 141-150.
    2. Harrison, Glenn W, 1989. "Theory and Misbehavior of First-Price Auctions," American Economic Review, American Economic Association, vol. 79(4), pages 749-762, September.
    3. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2020. "Incentives in experiments with objective lotteries," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 1-29, March.
    4. Uri Gneezy & Alex Imas & John List, 2015. "Estimating Individual Ambiguity Aversion: A Simple Approach," Artefactual Field Experiments 00588, The Field Experiments Website.
    5. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    6. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    7. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    8. Kagel, John H. & Levin, Dan, 1986. "The Winner's Curse and Public Information in Common Value Auctions," American Economic Review, American Economic Association, vol. 76(5), pages 894-920, December.
    9. Segal, Uzi, 1988. "Does the Preference Reversal Phenomenon Necessarily Contradict the Independence Axiom?," American Economic Review, American Economic Association, vol. 78(1), pages 233-236, March.
    10. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    11. Karni, Edi & Safra, Zvi, 1987. ""Preference Reversal' and the Observability of Preferences by Experimental Methods," Econometrica, Econometric Society, vol. 55(3), pages 675-685, May.
    12. Grether, David M & Plott, Charles R, 1979. "Economic Theory of Choice and the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 69(4), pages 623-638, September.
    13. Glenn Harrison & J. Swarthout, 2014. "Experimental payment protocols and the Bipolar Behaviorist," Theory and Decision, Springer, vol. 77(3), pages 423-438, October.
    14. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    15. Ham, John C. & Kagel, John H. & Lehrer, Steven F., 2005. "Randomization, endogeneity and laboratory experiments: the role of cash balances in private value auctions," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 175-205.
    16. Yi Li, 2021. "The ABC mechanism: an incentive compatible payoff mechanism for elicitation of outcome and probability transformations," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 1019-1046, September.
    17. Hansen, Robert G & Lott, John R, Jr, 1991. "The Winner's Curse and Public Information in Common Value Auctions: Comment," American Economic Review, American Economic Association, vol. 81(1), pages 347-361, March.
    18. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    19. Beattie, Jane & Loomes, Graham, 1997. "The Impact of Incentives upon Risky Choice Experiments," Journal of Risk and Uncertainty, Springer, vol. 14(2), pages 155-168, March.
    20. Gary Charness & Catherine Eckel & Uri Gneezy & Agne Kajackaite, 2018. "Complexity in risk elicitation may affect the conclusions: A demonstration using gender differences," Journal of Risk and Uncertainty, Springer, vol. 56(1), pages 1-17, February.
    21. Robin Cubitt & Chris Starmer & Robert Sugden, 1998. "On the Validity of the Random Lottery Incentive System," Experimental Economics, Springer;Economic Science Association, vol. 1(2), pages 115-131, September.
    22. Cathleen Johnson & Aurélien Baillon & Han Bleichrodt & Zhihua Li & Dennie Dolder & Peter P. Wakker, 2021. "Prince: An improved method for measuring incentivized preferences," Journal of Risk and Uncertainty, Springer, vol. 62(1), pages 1-28, February.
    23. David Danz & Lise Vesterlund & Alistair J. Wilson, 2022. "Belief Elicitation and Behavioral Incentive Compatibility," American Economic Review, American Economic Association, vol. 112(9), pages 2851-2883, September.
    24. John H. Kagel & Colin M. Campbell & Dan Levin, 1999. "The Winner's Curse and Public Information in Common Value Auctions: Reply," American Economic Review, American Economic Association, vol. 89(1), pages 325-334, March.
    25. Holt, Charles A, 1986. "Preference Reversals and the Independence Axiom," American Economic Review, American Economic Association, vol. 76(3), pages 508-515, June.
    26. David J. Freeman & Guy Mayraz, 2019. "Why choice lists increase risk taking," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 131-154, March.
    27. David Buschena & David Zilberman, 2008. "Generalized expected utility, heteroscedastic error, and path dependence in risky choice," Journal of Risk and Uncertainty, Springer, vol. 36(2), pages 201-201, April.
    28. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    29. Molnar, Andras, 2019. "SMARTRIQS: A Simple Method Allowing Real-Time Respondent Interaction in Qualtrics Surveys," Journal of Behavioral and Experimental Finance, Elsevier, vol. 22(C), pages 161-169.
    30. Pavlo Blavatskyy & Andreas Ortmann & Valentyn Panchenko, 2022. "On the Experimental Robustness of the Allais Paradox," American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 143-163, February.
    31. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    32. Mutz, Diana C. & Pemantle, Robin, 2015. "Standards for Experimental Research: Encouraging a Better Understanding of Experimental Methods," Journal of Experimental Political Science, Cambridge University Press, vol. 2(2), pages 192-215, January.
    33. Daniel J. Benjamin & Mark Alan Fontana & Miles Kimball, 2020. "Reconsidering Risk Aversion," GRU Working Paper Series GRU_2020_026, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    34. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    35. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    36. Christina McGranaghan & Kirby Nielsen & Ted O'Donoghue & Jason Somerville & Charles D. Sprenger, 2024. "Distinguishing Common Ratio Preferences from Common Ratio Effects Using Paired Valuation Tasks," American Economic Review, American Economic Association, vol. 114(2), pages 307-347, February.
    37. Machina, Mark J, 1989. "Dynamic Consistency and Non-expected Utility Models of Choice under Uncertainty," Journal of Economic Literature, American Economic Association, vol. 27(4), pages 1622-1668, December.
    38. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    39. Andreas Hackethal & Michael Kirchler & Christine Laudenbach & Michael Razen & Annika Weber, 2023. "On the role of monetary incentives in risk preference elicitation experiments," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 189-213, April.
    40. Timothy N. Cason & Charles R. Plott, 2014. "Misconceptions and Game Form Recognition: Challenges to Theories of Revealed Preference and Framing," Journal of Political Economy, University of Chicago Press, vol. 122(6), pages 1235-1270.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brown, Alexander L. & Healy, Paul J., 2018. "Separated decisions," European Economic Review, Elsevier, vol. 101(C), pages 20-34.
    2. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    3. Yi Li, 2021. "The ABC mechanism: an incentive compatible payoff mechanism for elicitation of outcome and probability transformations," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 1019-1046, September.
    4. David J. Freeman & Guy Mayraz, 2019. "Why choice lists increase risk taking," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 131-154, March.
    5. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2015. "Reduction of compound lotteries with objective probabilities: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 32-55.
    6. Glenn Harrison & J. Swarthout, 2014. "Experimental payment protocols and the Bipolar Behaviorist," Theory and Decision, Springer, vol. 77(3), pages 423-438, October.
    7. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    8. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    9. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    10. Herranz-Zarzoso, Noemí & Sabater-Grande, Gerardo & Jaramillo-Gutiérrez, Ainhoa, 2020. "Framing and repetition effects on risky choices: A behavioural approach," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    11. Galliera, Arianna, 2018. "Self-selecting random or cumulative pay? A bargaining experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 106-120.
    12. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2020. "Incentives in experiments with objective lotteries," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 1-29, March.
    13. Anna Conte & M. Vittoria Levati & Chiara Nardi, 2018. "Risk Preferences and the Role of Emotions," Economica, London School of Economics and Political Science, vol. 85(338), pages 305-328, April.
    14. Charness, Gary & Gneezy, Uri & Halladay, Brianna, 2016. "Experimental methods: Pay one or pay all," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 141-150.
    15. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    16. Guido Baltussen & G. Post & Martijn Assem & Peter Wakker, 2012. "Random incentive systems in a dynamic choice experiment," Experimental Economics, Springer;Economic Science Association, vol. 15(3), pages 418-443, September.
    17. Arianna Galliera & Noemi Pace, 2015. "To Switch or Not to Switch Payment Scheme? Determinants and Effects in a Bargaining Game," Working Papers 2015:33, Department of Economics, University of Venice "Ca' Foscari".
    18. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    19. Amelia Ahles & Marco A. Palma & Andreas C. Drichoutis, 2024. "Testing the effectiveness of lottery incentives in online experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 106(4), pages 1435-1453, August.
    20. Jonathan Chapman & Erik Snowberg & Stephanie Wang & Colin Camerer, 2018. "Loss Attitudes in the U.S. Population: Evidence from Dynamically Optimized Sequential Experimentation (DOSE)," NBER Working Papers 25072, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    Becker-DeGroot-Marschak mechanism; second price auction; risk choices; preference elicitation; choice architecture;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D44 - Microeconomics - - Market Structure, Pricing, and Design - - - Auctions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:120898. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.