IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-52311-8.html
   My bibliography  Save this article

Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task

Author

Listed:
  • Daniel F. Hill

    (University of Cambridge)

  • Robert W. Hickman

    (University of Cambridge)

  • Alaa Al-Mohammad

    (University of Cambridge)

  • Arkadiusz Stasiak

    (University of Cambridge)

  • Wolfram Schultz

    (University of Cambridge)

Abstract

The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward (“incentive compatibility”). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals’ bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.

Suggested Citation

  • Daniel F. Hill & Robert W. Hickman & Alaa Al-Mohammad & Arkadiusz Stasiak & Wolfram Schultz, 2024. "Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52311-8
    DOI: 10.1038/s41467-024-52311-8
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-52311-8
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-52311-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alexandre Pastor-Bernier & Arkadiusz Stasiak & Wolfram Schultz, 2019. "Orbitofrontal signals for two-component choice options comply with indifference curves of Revealed Preference Theory," Nature Communications, Nature, vol. 10(1), pages 1-19, December.
    2. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    3. Timothy N. Cason & Charles R. Plott, 2014. "Misconceptions and Game Form Recognition: Challenges to Theories of Revealed Preference and Framing," Journal of Political Economy, University of Chicago Press, vol. 122(6), pages 1235-1270.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    2. Kim, Younjun, 2015. "Essays on firm location decisions, regional development and choices under risk," ISU General Staff Papers 201501010800005579, Iowa State University, Department of Economics.
    3. Fehr, Dietmar & Hakimov, Rustamdjan & Kübler, Dorothea, 2015. "The willingness to pay–willingness to accept gap: A failed replication of Plott and Zeiler," European Economic Review, Elsevier, vol. 78(C), pages 120-128.
    4. Bull, Charles & Courty, Pascal & Doyon, Maurice & Rondeau, Daniel, 2019. "Failure of the Becker–DeGroot–Marschak mechanism in inexperienced subjects: New tests of the game form misconception hypothesis," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 235-253.
    5. Jonathan Chapman & Mark Dean & Pietro Ortoleva & Erik Snowberg & Colin Camerer, 2018. "Econographics," CESifo Working Paper Series 7202, CESifo.
      • Jonathan Chapman & Mark Dean & Pietro Ortoleva & Erik Snowberg & Colin Camerer, 2018. "Econographics," NBER Working Papers 24931, National Bureau of Economic Research, Inc.
    6. Julianna M. Butler & Christian A. Vossler, 2018. "What is an Unregulated and Potentially Misleading Label Worth? The case of “Natural”-Labelled Groceries," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 70(2), pages 545-564, June.
    7. Lichters, Marcel & Wackershauser, Verena & Han, Shixing & Vogt, Bodo, 2019. "On the applicability of the BDM mechanism in product evaluation," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 1-7.
    8. Melo, Grace & Palma, Marco A. & Ribera, Luis A., 2024. "Are experts overoptimistic about the success of food market labeling information?," 2024 Annual Meeting, July 28-30, New Orleans, LA 343870, Agricultural and Applied Economics Association.
    9. David de Meza & Diane Reyniers, 2013. "Debiasing the Becker – DeGroot – Marschak valuation mechanism," Economics Bulletin, AccessEcon, vol. 33(2), pages 1446-1456.
    10. Banzhaf, H. Spencer, 2016. "Constructing markets: environmental economics and the contingent valuation controversy," MPRA Paper 78814, University Library of Munich, Germany.
    11. Lauren Chenarides & Carola Grebitus & Jayson L Lusk & Iryna Printezis, 2022. "A calibrated choice experiment method," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(5), pages 971-1004.
    12. Friedrichsen, Jana & Engelmann, Dirk, 2018. "Who cares about social image?," European Economic Review, Elsevier, vol. 110(C), pages 61-77.
    13. Benoît, Jean-Pierre & Dubra, Juan, 2014. "A Theory of Rational Attitude Polarization," MPRA Paper 60129, University Library of Munich, Germany.
    14. James Berry & Greg Fischer & Raymond Guiteras, 2020. "Eliciting and Utilizing Willingness to Pay: Evidence from Field Trials in Northern Ghana," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1436-1473.
    15. Engelmann, Dirk & Friedrichsen, Jana & Kübler, Dorothea, 2018. "Fairness in Markets and Market Experiments," Rationality and Competition Discussion Paper Series 64, CRC TRR 190 Rationality and Competition.
    16. Qin, Botao, 2019. "Endowment effect and the gap between WTP and WTA," MPRA Paper 95764, University Library of Munich, Germany.
    17. Freeman, David & Manzini, Paola & Mariotti, Marco & Mittone, Luigi, 2016. "Procedures for eliciting time preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PA), pages 235-242.
    18. Parkhurst, Gregory M. & Nowell, Clifford, 2014. "The Role of Confidence in Truthful Revelation of Private Values," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 0, pages 1-16.
    19. Dietmar Fehr & Günther Fink & Kelsey Jack, 2019. "Poverty, Seasonal Scarcity and Exchange Asymmetries," NBER Working Papers 26357, National Bureau of Economic Research, Inc.
    20. Randolph Sloof & Ferdinand A. Siemens, 2017. "Illusion of control and the pursuit of authority," Experimental Economics, Springer;Economic Science Association, vol. 20(3), pages 556-573, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52311-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.