IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-48548-y.html
   My bibliography  Save this article

Heterogeneity in strategy use during arbitration between experiential and observational learning

Author

Listed:
  • Caroline J. Charpentier

    (California Institute of Technology
    University of Maryland)

  • Qianying Wu

    (California Institute of Technology)

  • Seokyoung Min

    (California Institute of Technology)

  • Weilun Ding

    (California Institute of Technology)

  • Jeffrey Cockburn

    (California Institute of Technology)

  • John P. O’Doherty

    (California Institute of Technology)

Abstract

To navigate our complex social world, it is crucial to deploy multiple learning strategies, such as learning from directly experiencing action outcomes or from observing other people’s behavior. Despite the prevalence of experiential and observational learning in humans and other social animals, it remains unclear how people favor one strategy over the other depending on the environment, and how individuals vary in their strategy use. Here, we describe an arbitration mechanism in which the prediction errors associated with each learning strategy influence their weight over behavior. We designed an online behavioral task to test our computational model, and found that while a substantial proportion of participants relied on the proposed arbitration mechanism, there was some meaningful heterogeneity in how people solved this task. Four other groups were identified: those who used a fixed mixture between the two strategies, those who relied on a single strategy and non-learners with irrelevant strategies. Furthermore, groups were found to differ on key behavioral signatures, and on transdiagnostic symptom dimensions, in particular autism traits and anxiety. Together, these results demonstrate how large heterogeneous datasets and computational methods can be leveraged to better characterize individual differences.

Suggested Citation

  • Caroline J. Charpentier & Qianying Wu & Seokyoung Min & Weilun Ding & Jeffrey Cockburn & John P. O’Doherty, 2024. "Heterogeneity in strategy use during arbitration between experiential and observational learning," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48548-y
    DOI: 10.1038/s41467-024-48548-y
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-48548-y
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-48548-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Samuel Zorowitz & Johanne Solis & Yael Niv & Daniel Bennett, 2023. "Inattentive responding can induce spurious associations between task behaviour and symptom measures," Nature Human Behaviour, Nature, vol. 7(10), pages 1667-1681, October.
    2. Stefano Palminteri & Emma J Kilford & Giorgio Coricelli & Sarah-Jayne Blakemore, 2016. "The Computational Development of Reinforcement Learning during Adolescence," PLOS Computational Biology, Public Library of Science, vol. 12(6), pages 1-25, June.
    3. Jessica Aylward & Vincent Valton & Woo-Young Ahn & Rebecca L. Bond & Peter Dayan & Jonathan P. Roiser & Oliver J. Robinson, 2019. "Altered learning under uncertainty in unmedicated mood and anxiety disorders," Nature Human Behaviour, Nature, vol. 3(10), pages 1116-1123, October.
    4. Payam Piray & Amir Dezfouli & Tom Heskes & Michael J Frank & Nathaniel D Daw, 2019. "Hierarchical Bayesian inference for concurrent model fitting and comparison for group studies," PLOS Computational Biology, Public Library of Science, vol. 15(6), pages 1-34, June.
    5. Andreea O Diaconescu & Christoph Mathys & Lilian A E Weber & Jean Daunizeau & Lars Kasper & Ekaterina I Lomakina & Ernst Fehr & Klaas E Stephan, 2014. "Inferring on the Intentions of Others by Hierarchical Bayesian Learning," PLOS Computational Biology, Public Library of Science, vol. 10(9), pages 1-19, September.
    6. Ondrej Zika & Katja Wiech & Andrea Reinecke & Michael Browning & Nicolas W. Schuck, 2023. "Trait anxiety is associated with hidden state inference during aversive reversal learning," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    7. Lindsay E. Hunter & Elana A. Meer & Claire M. Gillan & Ming Hsu & Nathaniel D. Daw, 2022. "Increased and biased deliberation in social anxiety," Nature Human Behaviour, Nature, vol. 6(1), pages 146-154, January.
    8. Timothy E. J. Behrens & Laurence T. Hunt & Mark W. Woolrich & Matthew F. S. Rushworth, 2008. "Associative learning of social value," Nature, Nature, vol. 456(7219), pages 245-249, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Payam Piray & Nathaniel D. Daw, 2021. "A model for learning based on the joint estimation of stochasticity and volatility," Nature Communications, Nature, vol. 12(1), pages 1-16, December.
    2. repec:cup:judgdm:v:16:y:2021:i:6:p:1413-1438 is not listed on IDEAS
    3. Jacqueline N. Zadelaar & Joost A. Agelink van Rentergem & Jessica V. Schaaf & Tycho J. Dekkers & Nathalie de Vent & Laura M. S. Dekkers & Maria C. Olthof & Brenda R. J. Jansen & Hilde M. Huizenga, 2021. "Development of decision making based on internal and external information: A hierarchical Bayesian approach," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(6), pages 1413-1438, November.
    4. Payam Piray & Nathaniel D Daw, 2020. "A simple model for learning in volatile environments," PLOS Computational Biology, Public Library of Science, vol. 16(7), pages 1-26, July.
    5. Jacqueline Scholl & Nils Kolling & Natalie Nelissen & Michael Browning & Matthew F S Rushworth & Catherine J Harmer, 2017. "Beyond negative valence: 2-week administration of a serotonergic antidepressant enhances both reward and effort learning signals," PLOS Biology, Public Library of Science, vol. 15(2), pages 1-30, February.
    6. Holger Mohr & Katharina Zwosta & Dimitrije Markovic & Sebastian Bitzer & Uta Wolfensteller & Hannes Ruge, 2018. "Deterministic response strategies in a trial-and-error learning task," PLOS Computational Biology, Public Library of Science, vol. 14(11), pages 1-19, November.
    7. Carolyn Yoon & Richard Gonzalez & Antoine Bechara & Gregory Berns & Alain Dagher & Laurette Dubé & Scott Huettel & Joseph Kable & Israel Liberzon & Hilke Plassmann & Ale Smidts & Charles Spence, 2012. "Decision neuroscience and consumer decision making," Marketing Letters, Springer, vol. 23(2), pages 473-485, June.
    8. Andreea O Diaconescu & Christoph Mathys & Lilian A E Weber & Jean Daunizeau & Lars Kasper & Ekaterina I Lomakina & Ernst Fehr & Klaas E Stephan, 2014. "Inferring on the Intentions of Others by Hierarchical Bayesian Learning," PLOS Computational Biology, Public Library of Science, vol. 10(9), pages 1-19, September.
    9. Florent Meyniel & Maxime Maheu & Stanislas Dehaene, 2016. "Human Inferences about Sequences: A Minimal Transition Probability Model," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
    10. Biele, Guido & Rieskamp, Jörg & Krugel, Lea K. & Heekeren, Hauke R., 2011. "The neural basis of following advice," SFB 649 Discussion Papers 2011-038, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    11. Dan Bang & Rani Moran & Nathaniel D. Daw & Stephen M. Fleming, 2022. "Neurocomputational mechanisms of confidence in self and others," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    12. George I. Christopoulos & Xiao-Xiao Liu & Ying-yi Hong, 2017. "Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning," Journal of Business Ethics, Springer, vol. 144(4), pages 699-715, September.
    13. Damon Tomlin & Andrea Nedic & Deborah A Prentice & Philip Holmes & Jonathan D Cohen, 2013. "The Neural Substrates of Social Influence on Decision Making," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-11, January.
    14. Joseph Simon IV & Erin L. Rich, 2024. "Neural populations in macaque anterior cingulate cortex encode social image identities," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    15. Marieke Jepma & Jessica V Schaaf & Ingmar Visser & Hilde M Huizenga, 2020. "Uncertainty-driven regulation of learning and exploration in adolescents: A computational account," PLOS Computational Biology, Public Library of Science, vol. 16(9), pages 1-29, September.
    16. Marco Colosio & Anna Shestakova & Vadim Nikulin & Anna Shpektor & Vasily Klucharev, 2015. "Neural Mechanisms of the Postdecisional Spreading-of-Alternatives Effect: Eeg Study," HSE Working papers WP BRP 50/PSY/2015, National Research University Higher School of Economics.
    17. Uri Hertz & Maria Kelly & Robb B Rutledge & Joel Winston & Nicholas Wright & Raymond J Dolan & Bahador Bahrami, 2016. "Oxytocin Effect on Collective Decision Making: A Randomized Placebo Controlled Study," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-16, April.
    18. Maël Lebreton & Karin Bacily & Stefano Palminteri & Jan B Engelmann, 2019. "Contextual influence on confidence judgments in human reinforcement learning," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-27, April.
    19. Ting Xiang & Debajyoti Ray & Terry Lohrenz & Peter Dayan & P Read Montague, 2012. "Computational Phenotyping of Two-Person Interactions Reveals Differential Neural Response to Depth-of-Thought," PLOS Computational Biology, Public Library of Science, vol. 8(12), pages 1-9, December.
    20. Tsutomu Harada, 2021. "Three heads are better than two: Comparing learning properties and performances across individuals, dyads, and triads through a computational approach," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-16, June.
    21. Raja Rajendra Timilsina & Koji Kotani & Yoshinori Nakagawa & Tatsuyoshi Saijo, 2023. "Does Being Intergenerationally Accountable Resolve the Intergenerational Sustainability Dilemma?," Land Economics, University of Wisconsin Press, vol. 99(4), pages 644-667.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48548-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.