When Does Model-Based Control Pay Off?
Author
Abstract
Suggested Citation
DOI: 10.1371/journal.pcbi.1005090
Download full text from publisher
References listed on IDEAS
- Amir Dezfouli & Bernard W Balleine, 2013. "Actions, Action Sequences and Habits: Evidence That Goal-Directed and Habitual Action Control Are Hierarchically Organized," PLOS Computational Biology, Public Library of Science, vol. 9(12), pages 1-14, December.
- David K. Levine & Drew Fudenberg, 2006.
"A Dual-Self Model of Impulse Control,"
American Economic Review, American Economic Association, vol. 96(5), pages 1449-1476, December.
- Drew Fudenberg & David K. Levine, 2004. "A Dual Self Model of Impulse Control," Harvard Institute of Economic Research Working Papers 2049, Harvard - Institute of Economic Research.
- Fudenberg, Drew & Levine, David, 2006. "A Dual-Self Model of Impulse Control," Scholarly Articles 3196335, Harvard University Department of Economics.
- Drew Fudenberg & David K Levine, 2005. "A Dual Self Model of Impulse Control," Levine's Working Paper Archive 618897000000000876, David K. Levine.
- Drew Fudenberg & David K. Levine, 2006. "A Dual Self Model of Impulse Control," Harvard Institute of Economic Research Working Papers 2112, Harvard - Institute of Economic Research.
- Andrew Westbrook & Daria Kester & Todd S Braver, 2013. "What Is the Subjective Cost of Cognitive Effort? Load, Trait, and Aging Effects Revealed by Economic Preference," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
- Thomas Akam & Rui Costa & Peter Dayan, 2015. "Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-25, December.
- Peter Smittenaar & George Prichard & Thomas H B FitzGerald & Joern Diedrichsen & Raymond J Dolan, 2014. "Transcranial Direct Current Stimulation of Right Dorsolateral Prefrontal Cortex Does Not Affect Model-Based or Model-Free Reinforcement Learning in Humans," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-8, January.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Bruno Miranda & W M Nishantha Malalasekera & Timothy E Behrens & Peter Dayan & Steven W Kennerley, 2020. "Combined model-free and model-sensitive reinforcement learning in non-human primates," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-25, June.
- Carolina Feher da Silva & Todd A Hare, 2018. "A note on the analysis of two-stage task results: How changes in task structure affect what model-free and model-based strategies predict about the effects of reward and transition on the stay probabi," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-13, April.
- Mikhail S. Spektor & Hannah Seidler, 2022. "Violations of economic rationality due to irrelevant information during learning in decision from experience," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 17(2), pages 425-448, March.
- Nitzan Shahar & Tobias U Hauser & Michael Moutoussis & Rani Moran & Mehdi Keramati & NSPN consortium & Raymond J Dolan, 2019. "Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-25, February.
- repec:cup:judgdm:v:17:y:2022:i:2:p:425-448 is not listed on IDEAS
- He A Xu & Alireza Modirshanechi & Marco P Lehmann & Wulfram Gerstner & Michael H Herzog, 2021. "Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making," PLOS Computational Biology, Public Library of Science, vol. 17(6), pages 1-32, June.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Bruno Miranda & W M Nishantha Malalasekera & Timothy E Behrens & Peter Dayan & Steven W Kennerley, 2020. "Combined model-free and model-sensitive reinforcement learning in non-human primates," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-25, June.
- Amir Dezfouli & Bernard W Balleine, 2019. "Learning the structure of the world: The adaptive nature of state-space and action representations in multi-stage decision-making," PLOS Computational Biology, Public Library of Science, vol. 15(9), pages 1-22, September.
- Thomas Akam & Rui Costa & Peter Dayan, 2015. "Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-25, December.
- Kerri Brick & Martine Visser & Justine Burns, 2012.
"Risk Aversion: Experimental Evidence from South African Fishing Communities,"
American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(1), pages 133-152.
- Justine Burns & Kerri Brick & Martine Visser, 2011. "Risk Aversion: Experimental Evidence from South African Fishing Communities," Working Papers 227, Economic Research Southern Africa.
- Lohse, Johannes & Goeschl, Timo & Diederich , Johannes, 2014. "Giving is a question of time: Response times and contributions to a real world public good," Working Papers 0566, University of Heidelberg, Department of Economics.
- André Lapied & Thomas Rongiconi, 2013.
"Ambiguity as a Source of Temptation: Modeling Unstable Beliefs,"
Working Papers
halshs-00797631, HAL.
- André Lapied & Thomas Rongiconi, 2013. "Ambiguity as a Source of Temptation: Modeling Unstable Beliefs," AMSE Working Papers 1316, Aix-Marseille School of Economics, France.
- Laureti, Carolina & Szafarz, Ariane, 2023.
"Banking regulation and costless commitment contracts for time-inconsistent agents,"
Economic Modelling, Elsevier, vol. 129(C).
- Carolina Laureti & Ariane Szafarz, 2023. "Banking Regulation and Costless Commitment Contracts for Time-Inconsistent Agents," Working Papers CEB 23-010, ULB -- Universite Libre de Bruxelles.
- Stefano DellaVigna, 2009.
"Psychology and Economics: Evidence from the Field,"
Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
- Stefano DellaVigna, 2007. "Psychology and Economics: Evidence from the Field," NBER Working Papers 13420, National Bureau of Economic Research, Inc.
- Khwaja, Ahmed & Silverman, Dan & Sloan, Frank, 2007.
"Time preference, time discounting, and smoking decisions,"
Journal of Health Economics, Elsevier, vol. 26(5), pages 927-949, September.
- Ahmed Khwaja & Dan Silverman & Frank Sloan, 2006. "Time Preference, Time Discounting, and Smoking Decisions," NBER Working Papers 12615, National Bureau of Economic Research, Inc.
- Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2014.
"Dual criteria decisions,"
Journal of Economic Psychology, Elsevier, vol. 41(C), pages 101-113.
- Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet, 2009. "Dual Criteria Decisions," Working Papers 02-2009, Copenhagen Business School, Department of Economics.
- Steffen Andersen & Cristian Badarinza & Lu Liu & Julie Marx & Tarun Ramadorai, 2022.
"Reference Dependence in the Housing Market,"
American Economic Review, American Economic Association, vol. 112(10), pages 3398-3440, October.
- Andersen, Steffen & Badarinza, Cristian & Liu, Lu & Marx, Julie & Ramadorai, Tarun, 2022. "Reference Dependence in the Housing Market," CEPR Discussion Papers 14147, C.E.P.R. Discussion Papers.
- Peysakhovich, Alexander, 2014. "How to commit (if you must): Commitment contracts and the dual-self model," Journal of Economic Behavior & Organization, Elsevier, vol. 101(C), pages 100-112.
- Sébastien Foudi, 2024. "Are risk attitude, impatience, and impulsivity related to the individual discount rate? Evidence from energy-efficient durable goods," Theory and Decision, Springer, vol. 96(4), pages 627-661, June.
- Anett John, 2020. "When Commitment Fails: Evidence from a Field Experiment," Management Science, INFORMS, vol. 66(2), pages 503-529, February.
- Gharad Bryan & Dean Karlan & Scott Nelson, 2009.
"Commitment Contracts,"
Working Papers
980, Economic Growth Center, Yale University.
- Bryan, Gharad & Karlan, Dean S. & Nelson, Scott, 2009. "Commitment Contracts," Center Discussion Papers 54536, Yale University, Economic Growth Center.
- Bryan, Gharad & Karlan, Dean & Nelson, Scott, 2009. "Commitment Contracts," Working Papers 73, Yale University, Department of Economics.
- David Card & Gordon B. Dahl, 2011.
"Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 103-143.
- David Card & Gordon Dahl, 2009. "Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior," NBER Working Papers 15497, National Bureau of Economic Research, Inc.
- Card, David & Dahl, Gordon B., 2010. "Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior," IZA Discussion Papers 4869, Institute of Labor Economics (IZA).
- David Card & Gordon Dahl, 2009. "Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior," RCER Working Papers 546, University of Rochester - Center for Economic Research (RCER).
- Ashraf, Nava & Karlan, Dean & Yin, Wesley, 2010.
"Female Empowerment: Impact of a Commitment Savings Product in the Philippines,"
World Development, Elsevier, vol. 38(3), pages 333-344, March.
- Karlan, Dean S. & Ashraf, Nava & Yin, Wesley, 2006. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," Center Discussion Papers 28380, Yale University, Economic Growth Center.
- Dean Karlan & Nava Ashraf & Wesley Yin, 2007. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," Working Papers 106, Center for Global Development.
- Karlan, Dean & Ashraf, Nava & Yin, Wesley, 2007. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," CEPR Discussion Papers 6195, C.E.P.R. Discussion Papers.
- Nava Ashraf & Dean Karlan & Wesley Yin, 2006. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," Working Papers 949, Economic Growth Center, Yale University.
- Griffith, Rachel & O'Connell, Martin & Smith, Kate & Cherchye, Laurens & De Rock, Bram & Vermeulen, Frederic, 2017.
"A new year, a new you? Heterogeneity and self-control in food purchases,"
CEPR Discussion Papers
12499, C.E.P.R. Discussion Papers.
- Cherchye, Laurens & De Rock, Bram & Griffith, Rachel & O’Connell, Martin & Smith, Kate & Vermeulen, Frederic, 2017. "A New Year, a New You? Heterogeneity and Self-Control in Food Purchases," IZA Discussion Papers 11205, Institute of Labor Economics (IZA).
- Laurens Cherchye & Bram De Rock & Rachel Griffith & Martin O'Connell & Kate Smith & Frederic Vermeulen, 2017. "A new year, a new you? Heterogeneity and self-control in food purchases," Working Papers of Department of Economics, Leuven 603330, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
- Laurens Cherchye & Bram De Rock & Rachel Griffith & Martin O'Connell & Kate Smith & Frederic Vermeulen, 2017. "A New Year, a New You ?Heterogeneity and Self-control in Food Purchases," Working Papers ECARES ECARES 2017-46, ULB -- Universite Libre de Bruxelles.
- Antoni Bosch-Domènech & Pablo Brañas-Garza & Antonio M. Espín, 2013.
"Fetal testosterone (2D:4D) as predictor of cognitive reflection,"
Economics Working Papers
1371, Department of Economics and Business, Universitat Pompeu Fabra.
- Antoni Bosch-Domènech & Pablo Brañas-Garza & Antonio M. Espín, 2013. "Fetal testosterone (2D:4D) as predictor of cognitive reflection," Working Papers 13-18, Chapman University, Economic Science Institute.
- Pablo Brañas-Garza & Antonio M. EspÃn & Antoni Bosch-Domènech, 2015. "Can exposure to prenatal sex hormones (2D:4D) predict cognitive reflection?," Working Papers 698, Barcelona School of Economics.
- Alós-Ferrer, Carlos & Ritzberger, Klaus, 2017. "Does backwards induction imply subgame perfection?," Games and Economic Behavior, Elsevier, vol. 103(C), pages 19-29.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1005090. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.