IDEAS home Printed from https://ideas.repec.org/a/ibn/ijspjl/v10y2021i2p110.html
   My bibliography  Save this article

A Q-learning Approach to a Consumption-Investment Problem

Author

Listed:
  • Ruy Lopez-Rios

Abstract

The paper deals with a discrete-time consumption investment problem with an infinite horizon. This problem is formulated as a Markov decision process with an expected total discounted utility as an objective function. This paper aims to presents a procedure to approximate the solution via machine learning, specifically, a Q-learning technique. The numerical results of the problem are provided.

Suggested Citation

  • Ruy Lopez-Rios, 2021. "A Q-learning Approach to a Consumption-Investment Problem," International Journal of Statistics and Probability, Canadian Center of Science and Education, vol. 10(2), pages 110-110, March.
    • Handle: RePEc:ibn:ijspjl:v:10:y:2021:i:2:p:110
    as

    Download full text from publisher

    File URL: http://www.ccsenet.org/journal/index.php/ijsp/article/download/0/0/44805/47397
    Download Restriction: no
    File URL: http://www.ccsenet.org/journal/index.php/ijsp/article/view/0/44805
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul A. Samuelson, 2011. "Lifetime Portfolio Selection by Dynamic Stochastic Programming," World Scientific Book Chapters, in: Leonard C MacLean & Edward O Thorp & William T Ziemba (ed.), THE KELLY CAPITAL GROWTH INVESTMENT CRITERION THEORY and PRACTICE, chapter 31, pages 465-472, World Scientific Publishing Co. Pte. Ltd..
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert C. Merton, 2006. "Paul Samuelson and Financial Economics," The American Economist, Sage Publications, vol. 50(2), pages 9-31, October.
    2. Kevin Milligan, 2005. "Life‐cycle asset accumulation and allocation in Canada," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 38(3), pages 1057-1106, August.
    3. Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2020. "Heterogeneity and Persistence in Returns to Wealth," Econometrica, Econometric Society, vol. 88(1), pages 115-170, January.
    4. John H. Cochrane, 1999. "New facts in finance," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 23(Q III), pages 36-58.
    5. Mr. Christopher Carroll & Mr. Martin Sommer & Mr. Jiri Slacalek, 2012. "Dissecting Saving Dynamics: Measuring Wealth, Precautionary, and Credit Effects," IMF Working Papers 2012/219, International Monetary Fund.
    6. Montserrat Guillén & Jean Pinquet, 2008. "Long-Term Care: Risk Description of a Spanish Portfolio and Economic Analysis of the Timing of Insurance Purchase," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 33(4), pages 659-672, October.
    7. Zhang, Xili & Zhang, Weiguo & Xiao, Weilin, 2013. "Multi-period portfolio optimization under possibility measures," Economic Modelling, Elsevier, vol. 35(C), pages 401-408.
    8. Robert Östling & Erik Lindqvist & David Cesarini & Joseph Briggs, 2016. "Wealth, Portfolio Allocations, and Risk Preference," 2016 Meeting Papers 1089, Society for Economic Dynamics.
    9. Tanaka, Ken'ichiro & Toda, Alexis Akira, 2015. "Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis," University of California at San Diego, Economics Working Paper Series qt7g23r5kh, Department of Economics, UC San Diego.
    10. Prat, Georges, 2013. "Equity risk premium and time horizon: What do the U.S. secular data say?," Economic Modelling, Elsevier, vol. 34(C), pages 76-88.
    11. Regis Houssou & Olivier Besson, 2010. "Indifference of Defaultable Bonds with Stochastic Intensity models," Papers 1003.4118, arXiv.org.
    12. Annette Vissing-Jorgensen, 2000. "Towards an Explanation of Household Portfolio Choice Heterogeneity: Nonfinancial Income and Participation Cost Structures," Econometric Society World Congress 2000 Contributed Papers 1102, Econometric Society.
    13. Lizyayev, Andrey & Ruszczyński, Andrzej, 2012. "Tractable Almost Stochastic Dominance," European Journal of Operational Research, Elsevier, vol. 218(2), pages 448-455.
    14. Penikas, Henry, 2010. "Copula-Models in Foreign Exchange Risk-Management of a Bank," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 17(1), pages 62-87.
    15. Abiry, Raphael & Ferdinandusse, Marien & Ludwig, Alexander & Nerlich, Carolin, 2022. "Climate change mitigation: How effective is green quantitative easing?," ZEW Discussion Papers 22-027, ZEW - Leibniz Centre for European Economic Research.
    16. Hermansson, Cecilia, 2018. "Can self-assessed financial risk measures explain and predict bank customers’ objective financial risk?," Journal of Economic Behavior & Organization, Elsevier, vol. 148(C), pages 226-240.
    17. Tansel Yilmazer & Angela Lyons, 2010. "Marriage and the Allocation of Assets in Women’s Defined Contribution Plans," Journal of Family and Economic Issues, Springer, vol. 31(2), pages 121-137, June.
    18. Fu, Chenpeng & Lari-Lavassani, Ali & Li, Xun, 2010. "Dynamic mean-variance portfolio selection with borrowing constraint," European Journal of Operational Research, Elsevier, vol. 200(1), pages 312-319, January.
    19. Stephen Foerster & Juhani T. Linnainmaa & Brian T. Melzer & Alessandro Previtero, 2017. "Retail Financial Advice: Does One Size Fit All?," Journal of Finance, American Finance Association, vol. 72(4), pages 1441-1482, August.
    20. repec:idb:brikps:365 is not listed on IDEAS
    21. Drobetz, Wolfgang & Kugler, Peter & Wanzenried, Gabrielle & Zimmermann, Heinz, 2009. "Heterogeneity in asset allocation decisions: Empirical evidence from Switzerland," International Review of Financial Analysis, Elsevier, vol. 18(1-2), pages 84-93, March.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijspjl:v:10:y:2021:i:2:p:110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.