IDEAS home Printed from https://ideas.repec.org/p/hrv/faseco/4686777.html
   My bibliography  Save this paper

Reinforcement Learning and Savings Behavior

Author

Listed:
  • Metrick, Andrew
  • Laibson, David I.
  • Choi, James J.
  • Madrian, Brigitte

Abstract

We show that individual investors over-extrapolate from their personal experience when making savings decisions. Investors who experience particularly rewarding outcomes from saving in their 401(k)—a high average and/or low variance return—increase their 401(k) savings rate more than investors who have less rewarding experiences with saving. This finding is not driven by aggregate time-series shocks, income effects, rational learning about investing skill, investor fixed effects, or time-varying investor-level heterogeneity that is correlated with portfolio allocations to stock, bond, and cash asset classes. We discuss implications for the equity premium puzzle and interventions aimed at improving household financial outcomes.

Suggested Citation

  • Metrick, Andrew & Laibson, David I. & Choi, James J. & Madrian, Brigitte, 2009. "Reinforcement Learning and Savings Behavior," Scholarly Articles 4686777, Harvard University Department of Economics.
    • Handle: RePEc:hrv:faseco:4686777
    as

    Download full text from publisher

    File URL: http://dash.harvard.edu/bitstream/handle/1/4686777/Laibson_ReinforcementLearning.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard H. Thaler & Shlomo Benartzi, 2004. "Save More Tomorrow (TM): Using Behavioral Economics to Increase Employee Saving," Journal of Political Economy, University of Chicago Press, vol. 112(S1), pages 164-187, February.
    2. Gur Huberman & Sheena Iyengar & Wei Jiang, 2007. "Defined Contribution Pension Plans: Determinants of Participation and Contributions Rates," Journal of Financial Services Research, Springer;Western Finance Association, vol. 31(1), pages 1-32, February.
    3. Shlomo Benartzi, 2001. "Excessive Extrapolation and the Allocation of 401(k) Accounts to Company Stock," Journal of Finance, American Finance Association, vol. 56(5), pages 1747-1764, October.
    4. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    5. Laurent E. Calvet & John Y. Campbell & Paolo Sodini, 2009. "Fight or Flight? Portfolio Rebalancing by Individual Investors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 301-348.
    6. Constantinides, George M., 1984. "Optimal stock trading with personal taxes : Implications for prices and the abnormal January returns," Journal of Financial Economics, Elsevier, vol. 13(1), pages 65-89, March.
    7. Markku Kaustia & Samuli Knüpfer, 2008. "Do Investors Overweight Personal Experience? Evidence from IPO Subscriptions," Journal of Finance, American Finance Association, vol. 63(6), pages 2679-2702, December.
    8. James J. Choi & David Laibson & Brigitte C. Madrian, 2010. "Why Does the Law of One Price Fail? An Experiment on Index Mutual Funds," The Review of Financial Studies, Society for Financial Studies, vol. 23(4), pages 1405-1432, April.
    9. James J. Choi & David Laibson & Brigitte C. Madrian, 2011. "$100 Bills on the Sidewalk: Suboptimal Investment in 401(k) Plans," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 748-763, August.
    10. James J. Choi & David Laibson & Brigitte C. Madrian, 2010. "Why Does the Law of One Price Fail? An Experiment on Index Mutual Funds," Review of Financial Studies, Society for Financial Studies, vol. 23(4), pages 1405-1432, April.
    11. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    12. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    13. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    14. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    15. Shefrin, Hersh & Statman, Meir, 1985. "The Disposition to Sell Winners Too Early and Ride Losers Too Long: Theory and Evidence," Journal of Finance, American Finance Association, vol. 40(3), pages 777-790, July.
    16. repec:bla:jfinan:v:59:y:2004:i:1:p:137-163 is not listed on IDEAS
    17. Wise, David A. (ed.), 2004. "Perspectives on the Economics of Aging," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226903057, September.
    18. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    19. repec:bla:jfinan:v:53:y:1998:i:5:p:1775-1798 is not listed on IDEAS
    20. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    21. Gary Charness & Dan Levin, 2005. "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, American Economic Association, vol. 95(4), pages 1300-1309, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    2. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    3. Barber, Brad M. & Odean, Terrance, 2013. "The Behavior of Individual Investors," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1533-1570, Elsevier.
    4. Itzhak Venezia, 2018. "Lecture Notes in Behavioral Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 10751, August.
    5. Balasubramaniam, Vimal & Anagol, Santosh, 2018. "Learning from Noise: Evidence from India’s IPO Lotteries," CEPR Discussion Papers 13314, C.E.P.R. Discussion Papers.
    6. James Choi & David Laibson & Brigitte Madrain & Andrew Metrick, 2007. "Reinforcement Learning in Investment Behavior," Levine's Bibliography 122247000000001737, UCLA Department of Economics.
    7. Guiso, Luigi & Sodini, Paolo, 2013. "Household Finance: An Emerging Field," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1397-1532, Elsevier.
    8. Anagol, Santosh & Balasubramaniam, Vimal & Ramadorai, Tarun, 2021. "Learning from noise: Evidence from India’s IPO lotteries," Journal of Financial Economics, Elsevier, vol. 140(3), pages 965-986.
    9. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2011. "Behavioral economics perspectives on public sector pension plans," Journal of Pension Economics and Finance, Cambridge University Press, vol. 10(2), pages 315-336, April.
    10. Osili, Una Okonkwo & Paulson, Anna, 2014. "Crises and confidence: Systemic banking crises and depositor behavior," Journal of Financial Economics, Elsevier, vol. 111(3), pages 646-660.
    11. Peiran Jiao, 2015. "The Double-Channeled Effects of Experience on Individual Investment Decisions: Experimental Evidence," Economics Series Working Papers 766, University of Oxford, Department of Economics.
    12. Jonathan Huntley & Valentina Michelangeli & Felix Reichling, 2021. "What drives investors to chase returns?," Temi di discussione (Economic working papers) 1334, Bank of Italy, Economic Research and International Relations Area.
    13. David Hirshleife, 2015. "Behavioral Finance," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 133-159, December.
    14. Hwang, Joon Ho & Kim, Min-Su, 2015. "Misunderstanding of the binomial distribution, market inefficiency, and learning behavior: Evidence from an exotic sports betting market," European Journal of Operational Research, Elsevier, vol. 243(1), pages 333-344.
    15. Prachi Deuskar & Deng Pan & Fei Wu & Hongfeng Zhou, 2021. "How does regret affect investor behaviour? Evidence from Chinese stock markets," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(S1), pages 1851-1896, April.
    16. Sautua, Santiago I., 2020. "When diversification clashes with the reinforcement heuristic: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 174(C), pages 196-211.
    17. John Y. Campbell, 2016. "Restoring Rational Choice: The Challenge of Consumer Financial Regulation," American Economic Review, American Economic Association, vol. 106(5), pages 1-30, May.
    18. Mitchell, O.S. & Piggott, J., 2016. "Workplace-Linked Pensions for an Aging Demographic," Handbook of the Economics of Population Aging, in: Piggott, John & Woodland, Alan (ed.), Handbook of the Economics of Population Aging, edition 1, volume 1, chapter 0, pages 865-904, Elsevier.
    19. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    20. Cici, Gjergji, 2011. "The prevalence of the disposition effect in mutual funds' trades," CFR Working Papers 11-05 [rev.], University of Cologne, Centre for Financial Research (CFR).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hrv:faseco:4686777. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Office for Scholarly Communication (email available below). General contact details of provider: https://edirc.repec.org/data/deharus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.