Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making
Author
Abstract
Suggested Citation
DOI: 10.1371/journal.pcbi.1009070
Download full text from publisher
References listed on IDEAS
- Thomas Akam & Rui Costa & Peter Dayan, 2015. "Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-25, December.
- Roland T. Rust & David C. Schmittlein, 1985. "A Bayesian Cross-Validated Likelihood Method for Comparing Alternative Specifications of Quantitative Models," Marketing Science, INFORMS, vol. 4(1), pages 20-40.
- Mathias Pessiglione & Ben Seymour & Guillaume Flandin & Raymond J. Dolan & Chris D. Frith, 2006. "Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans," Nature, Nature, vol. 442(7106), pages 1042-1045, August.
- Sam Gijsen & Miro Grundei & Robert T Lange & Dirk Ostwald & Felix Blankenburg, 2021. "Neural surprise in somatosensory Bayesian learning," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-36, February.
- Florent Meyniel & Maxime Maheu & Stanislas Dehaene, 2016. "Human Inferences about Sequences: A Minimal Transition Probability Model," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
- Jean Daunizeau & Vincent Adam & Lionel Rigoux, 2014. "VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data," PLOS Computational Biology, Public Library of Science, vol. 10(1), pages 1-16, January.
- Samuel J Gershman & Angela Radulescu & Kenneth A Norman & Yael Niv, 2014. "Statistical Computations Underlying the Dynamics of Memory Updating," PLOS Computational Biology, Public Library of Science, vol. 10(11), pages 1-13, November.
- Wouter Kool & Fiery A Cushman & Samuel J Gershman, 2016. "When Does Model-Based Control Pay Off?," PLOS Computational Biology, Public Library of Science, vol. 12(8), pages 1-34, August.
- Vincent Moens & Alexandre Zénon, 2019. "Learning and forgetting using reinforced Bayesian change detection," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-41, April.
- Carolina Feher da Silva & Todd A. Hare, 2020. "Humans primarily use model-based inference in the two-stage task," Nature Human Behaviour, Nature, vol. 4(10), pages 1053-1066, October.
- E Fong & C C Holmes, 2020. "On the marginal likelihood and cross-validation," Biometrika, Biometrika Trust, vol. 107(2), pages 489-496.
- Micha Heilbron & Florent Meyniel, 2019. "Confidence resets reveal hierarchical adaptive learning in humans," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-24, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Farid Anvari & Stephan Billinger & Pantelis P. Analytis & Vithor Rosa Franco & Davide Marchiori, 2024. "Testing the convergent validity, domain generality, and temporal stability of selected measures of people’s tendency to explore," Nature Communications, Nature, vol. 15(1), pages 1-23, December.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Florent Meyniel, 2020. "Brain dynamics for confidence-weighted learning," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-27, June.
- Maël Lebreton & Karin Bacily & Stefano Palminteri & Jan B Engelmann, 2019. "Contextual influence on confidence judgments in human reinforcement learning," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-27, April.
- Stefano Palminteri & Emma J Kilford & Giorgio Coricelli & Sarah-Jayne Blakemore, 2016. "The Computational Development of Reinforcement Learning during Adolescence," PLOS Computational Biology, Public Library of Science, vol. 12(6), pages 1-25, June.
- Bruno Miranda & W M Nishantha Malalasekera & Timothy E Behrens & Peter Dayan & Steven W Kennerley, 2020. "Combined model-free and model-sensitive reinforcement learning in non-human primates," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-25, June.
- Antoine Collomb-Clerc & Maëlle C. M. Gueguen & Lorella Minotti & Philippe Kahane & Vincent Navarro & Fabrice Bartolomei & Romain Carron & Jean Regis & Stephan Chabardès & Stefano Palminteri & Julien B, 2023. "Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
- Stefano Palminteri & Mehdi Khamassi & Mateus Joffily & Giorgio Coricelli, 2015. "Contextual modulation of value signals in reward and punishment learning," Post-Print halshs-01236045, HAL.
- Flavia Mancini & Suyi Zhang & Ben Seymour, 2022. "Computational and neural mechanisms of statistical pain learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
- Sam Gijsen & Miro Grundei & Robert T Lange & Dirk Ostwald & Felix Blankenburg, 2021. "Neural surprise in somatosensory Bayesian learning," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-36, February.
- Romane Cecchi & Antoine Collomb-Clerc & Inès Rachidi & Lorella Minotti & Philippe Kahane & Mathias Pessiglione & Julien Bastin, 2024. "Direct stimulation of anterior insula and ventromedial prefrontal cortex disrupts economic choices," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
- Manuel Glauco Carbone & Icro Maremmani, 2024. "Chronic Cocaine Use and Parkinson’s Disease: An Interpretative Model," IJERPH, MDPI, vol. 21(8), pages 1-23, August.
- Namwoon Kim & Jin K. Han & Rajendra K. Srivastava, 2002. "A Dynamic IT Adoption Model for the SOHO Market: PC Generational Decisions with Technological Expectations," Management Science, INFORMS, vol. 48(2), pages 222-240, February.
- Kim, Namwoon & Srivastava, Rajendra K., 2007. "Modeling cross-price effects on inter-category dynamics: The case of three computing platforms," Omega, Elsevier, vol. 35(3), pages 290-301, June.
- Dyrland, Kjetil & Lundervold, Alexander Selvikvåg & Porta Mana, PierGianLuca, 2022. "Don’t guess what’s true: choose what’s optimal. A probability transducer for machine-learning classifiers," OSF Preprints vct9y_v1, Center for Open Science.
- Abhik Roy & Jagmohan Raju, 2011. "The influence of demand factors on dynamic competitive pricing strategy: An empirical study," Marketing Letters, Springer, vol. 22(3), pages 259-281, September.
- Eric T. Bradlow & David C. Schmittlein, 2000. "The Little Engines That Could: Modeling the Performance of World Wide Web Search Engines," Marketing Science, INFORMS, vol. 19(1), pages 43-62, June.
- Zixuan Tang & Chen Qu & Yang Hu & Julien Benistant & Frederic Moisan & Edmund Derrington & Jean-Claude Dreher, 2023. "Strengths of social ties modulate brain computations for third-party punishment," Post-Print hal-04325737, HAL.
- Hanan Shteingart & Tal Neiman & Yonatan Loewenstein, 2012. "The Role of First Impression in Operant Learning," Discussion Paper Series dp626, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
- Kuhnen, Camelia M. & Miu, Andrei C., 2017.
"Socioeconomic status and learning from financial information,"
Journal of Financial Economics, Elsevier, vol. 124(2), pages 349-372.
- Camelia M. Kuhnen & Andrei C. Miu, 2015. "Socioeconomic Status and Learning from Financial Information," NBER Working Papers 21214, National Bureau of Economic Research, Inc.
- Camelia Kuhnen & Andrei Mui, 2015. "Socioeconomic Status and Learning from Financial Information," Working Papers 2015-018, Human Capital and Economic Opportunity Working Group.
- Julie J Lee & Mehdi Keramati, 2017. "Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans," PLOS Computational Biology, Public Library of Science, vol. 13(9), pages 1-15, September.
- Islam, Towhidul & Meade, Nigel, 2000. "Modelling diffusion and replacement," European Journal of Operational Research, Elsevier, vol. 125(3), pages 551-570, September.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1009070. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.