IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v64y2024i4d10.1007_s10614-023-10509-w.html
   My bibliography  Save this article

Portfolio Allocation with Dynamic Risk Preferences via Reinforcement Learning

Author

Listed:
  • Ting-Fu Chen

    (National Central University)

  • Xian-Ji Kuang

    (National Chengchi University)

  • Szu-Lang Liao

    (National Chengchi University)

  • Shih-Kuei Lin

    (National Chengchi University)

Abstract

In the realm of investment, the mean–variance model serves as an efficacious method for constructing investment portfolios, as it is underpinned by a robust economic theory and is ubiquitously employed in both academia and practice. Nevertheless, there is currently no satisfactory approach for ascertaining the risk preference parameters within the model for investors. This paper proposes a novel reinforcement learning (RL) framework integrated with the mean–variance model, designed to dynamically adjust investors’ risk preference parameters during the portfolio construction process. Our RL portfolio is not only readily implementable but also exhibits strong economic interpretability. In our empirical analysis employing Taiwan 50 Index market data, our designed RL portfolio outperforms both the buy-and-hold strategy and portfolios with static risk preference parameters. Concurrently, through our meticulously crafted reward function, RL demonstrates heightened accuracy in selecting suitable risk preferences when market return differences are more pronounced, underscoring the effectiveness of RL methods in dynamically adjusting risk preference parameters during periods of elevated market volatility.

Suggested Citation

  • Ting-Fu Chen & Xian-Ji Kuang & Szu-Lang Liao & Shih-Kuei Lin, 2024. "Portfolio Allocation with Dynamic Risk Preferences via Reinforcement Learning," Computational Economics, Springer;Society for Computational Economics, vol. 64(4), pages 2033-2052, October.
  • Handle: RePEc:kap:compec:v:64:y:2024:i:4:d:10.1007_s10614-023-10509-w
    DOI: 10.1007/s10614-023-10509-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10509-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-023-10509-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Suleyman Basak & Georgy Chabakauri, 2010. "Dynamic Mean-Variance Asset Allocation," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 2970-3016, August.
    2. Rosenberg, Joshua V. & Engle, Robert F., 2002. "Empirical pricing kernels," Journal of Financial Economics, Elsevier, vol. 64(3), pages 341-372, June.
    3. Yan Zhang & Yonghong Wu & Shuang Li & Benchawan Wiwatanapataphee, 2017. "Mean-Variance Asset Liability Management with State-Dependent Risk Aversion," North American Actuarial Journal, Taylor & Francis Journals, vol. 21(1), pages 87-106, January.
    4. Li, Yongwu & Li, Zhongfei, 2013. "Optimal time-consistent investment and reinsurance strategies for mean–variance insurers with state dependent risk aversion," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 86-97.
    5. Tomas Björk & Agatha Murgoci & Xun Yu Zhou, 2014. "Mean–Variance Portfolio Optimization With State-Dependent Risk Aversion," Mathematical Finance, Wiley Blackwell, vol. 24(1), pages 1-24, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alia, Ishak & Chighoub, Farid & Sohail, Ayesha, 2016. "A characterization of equilibrium strategies in continuous-time mean–variance problems for insurers," Insurance: Mathematics and Economics, Elsevier, vol. 68(C), pages 212-223.
    2. Yang Shen & Bin Zou, 2021. "Mean-Variance Investment and Risk Control Strategies -- A Time-Consistent Approach via A Forward Auxiliary Process," Papers 2101.03954, arXiv.org.
    3. Li, Yongwu & Qiao, Han & Wang, Shouyang & Zhang, Ling, 2015. "Time-consistent investment strategy under partial information," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 187-197.
    4. Liang, Zongxia & Song, Min, 2015. "Time-consistent reinsurance and investment strategies for mean–variance insurer under partial information," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 66-76.
    5. Sun, Jingyun & Li, Zhongfei & Zeng, Yan, 2016. "Precommitment and equilibrium investment strategies for defined contribution pension plans under a jump–diffusion model," Insurance: Mathematics and Economics, Elsevier, vol. 67(C), pages 158-172.
    6. Chi Kin Lam & Yuhong Xu & Guosheng Yin, 2016. "Dynamic portfolio selection without risk-free assets," Papers 1602.04975, arXiv.org.
    7. Van Staden, Pieter M. & Dang, Duy-Minh & Forsyth, Peter A., 2018. "Time-consistent mean–variance portfolio optimization: A numerical impulse control approach," Insurance: Mathematics and Economics, Elsevier, vol. 83(C), pages 9-28.
    8. Xiang Meng, 2019. "Dynamic Mean-Variance Portfolio Optimisation," Papers 1907.03093, arXiv.org.
    9. Luca De Gennaro Aquino & Sascha Desmettre & Yevhen Havrylenko & Mogens Steffensen, 2024. "Equilibrium control theory for Kihlstrom-Mirman preferences in continuous time," Papers 2407.16525, arXiv.org, revised Oct 2024.
    10. Liyuan Wang & Zhiping Chen, 2019. "Stochastic Game Theoretic Formulation for a Multi-Period DC Pension Plan with State-Dependent Risk Aversion," Mathematics, MDPI, vol. 7(1), pages 1-16, January.
    11. Chen, Kexin & Wong, Hoi Ying, 2019. "Time-consistent mean-variance hedging of an illiquid asset with a cointegrated liquid asset," Finance Research Letters, Elsevier, vol. 29(C), pages 184-192.
    12. Marcel Nutz & Yuchong Zhang, 2019. "Conditional Optimal Stopping: A Time-Inconsistent Optimization," Papers 1901.05802, arXiv.org, revised Oct 2019.
    13. Junna Bi & Jun Cai & Yan Zeng, 2021. "Equilibrium reinsurance-investment strategies with partial information and common shock dependence," Annals of Operations Research, Springer, vol. 307(1), pages 1-24, December.
    14. Li, Bin & Li, Danping & Xiong, Dewen, 2016. "Alpha-robust mean-variance reinsurance-investment strategy," Journal of Economic Dynamics and Control, Elsevier, vol. 70(C), pages 101-123.
    15. Oumar Mbodji & Traian A. Pirvu, 2023. "Portfolio Time Consistency and Utility Weighted Discount Rates," Papers 2402.05113, arXiv.org.
    16. Shi, Yun & Cui, Xiangyu & Li, Duan, 2015. "Discrete-time behavioral portfolio selection under cumulative prospect theory," Journal of Economic Dynamics and Control, Elsevier, vol. 61(C), pages 283-302.
    17. Xue Dong He & Hanqing Jin & Xun Yu Zhou, 2015. "Dynamic Portfolio Choice When Risk Is Measured by Weighted VaR," Mathematics of Operations Research, INFORMS, vol. 40(3), pages 773-796, March.
    18. Min Dai & Hanqing Jin & Steven Kou & Yuhong Xu, 2021. "Robo-advising: a dynamic mean-variance approach," Digital Finance, Springer, vol. 3(2), pages 81-97, June.
    19. Zhou, Zhongbao & Xiao, Helu & Yin, Jialing & Zeng, Ximei & Lin, Ling, 2016. "Pre-commitment vs. time-consistent strategies for the generalized multi-period portfolio optimization with stochastic cash flows," Insurance: Mathematics and Economics, Elsevier, vol. 68(C), pages 187-202.
    20. Zongxia Liang & Sheng Wang & Jianming Xia, 2024. "An Integral Equation Arising from Time-Consistent Portfolio Selection," Papers 2412.02446, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:64:y:2024:i:4:d:10.1007_s10614-023-10509-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.