IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v64y2024i4d10.1007_s10614-023-10509-w.html
   My bibliography  Save this article

Portfolio Allocation with Dynamic Risk Preferences via Reinforcement Learning

Author

Listed:
  • Ting-Fu Chen

    (National Central University)

  • Xian-Ji Kuang

    (National Chengchi University)

  • Szu-Lang Liao

    (National Chengchi University)

  • Shih-Kuei Lin

    (National Chengchi University)

Abstract

In the realm of investment, the mean–variance model serves as an efficacious method for constructing investment portfolios, as it is underpinned by a robust economic theory and is ubiquitously employed in both academia and practice. Nevertheless, there is currently no satisfactory approach for ascertaining the risk preference parameters within the model for investors. This paper proposes a novel reinforcement learning (RL) framework integrated with the mean–variance model, designed to dynamically adjust investors’ risk preference parameters during the portfolio construction process. Our RL portfolio is not only readily implementable but also exhibits strong economic interpretability. In our empirical analysis employing Taiwan 50 Index market data, our designed RL portfolio outperforms both the buy-and-hold strategy and portfolios with static risk preference parameters. Concurrently, through our meticulously crafted reward function, RL demonstrates heightened accuracy in selecting suitable risk preferences when market return differences are more pronounced, underscoring the effectiveness of RL methods in dynamically adjusting risk preference parameters during periods of elevated market volatility.

Suggested Citation

  • Ting-Fu Chen & Xian-Ji Kuang & Szu-Lang Liao & Shih-Kuei Lin, 2024. "Portfolio Allocation with Dynamic Risk Preferences via Reinforcement Learning," Computational Economics, Springer;Society for Computational Economics, vol. 64(4), pages 2033-2052, October.
  • Handle: RePEc:kap:compec:v:64:y:2024:i:4:d:10.1007_s10614-023-10509-w
    DOI: 10.1007/s10614-023-10509-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10509-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-023-10509-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rosenberg, Joshua V. & Engle, Robert F., 2002. "Empirical pricing kernels," Journal of Financial Economics, Elsevier, vol. 64(3), pages 341-372, June.
    2. Li, Yongwu & Li, Zhongfei, 2013. "Optimal time-consistent investment and reinsurance strategies for mean–variance insurers with state dependent risk aversion," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 86-97.
    3. Tomas Björk & Agatha Murgoci & Xun Yu Zhou, 2014. "Mean–Variance Portfolio Optimization With State-Dependent Risk Aversion," Mathematical Finance, Wiley Blackwell, vol. 24(1), pages 1-24, January.
    4. Suleyman Basak & Georgy Chabakauri, 2010. "Dynamic Mean-Variance Asset Allocation," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 2970-3016, August.
    5. Yan Zhang & Yonghong Wu & Shuang Li & Benchawan Wiwatanapataphee, 2017. "Mean-Variance Asset Liability Management with State-Dependent Risk Aversion," North American Actuarial Journal, Taylor & Francis Journals, vol. 21(1), pages 87-106, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alia, Ishak & Chighoub, Farid & Sohail, Ayesha, 2016. "A characterization of equilibrium strategies in continuous-time mean–variance problems for insurers," Insurance: Mathematics and Economics, Elsevier, vol. 68(C), pages 212-223.
    2. Yang Shen & Bin Zou, 2021. "Mean-Variance Investment and Risk Control Strategies -- A Time-Consistent Approach via A Forward Auxiliary Process," Papers 2101.03954, arXiv.org.
    3. Chi Kin Lam & Yuhong Xu & Guosheng Yin, 2016. "Dynamic portfolio selection without risk-free assets," Papers 1602.04975, arXiv.org.
    4. Li, Yongwu & Qiao, Han & Wang, Shouyang & Zhang, Ling, 2015. "Time-consistent investment strategy under partial information," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 187-197.
    5. Van Staden, Pieter M. & Dang, Duy-Minh & Forsyth, Peter A., 2018. "Time-consistent mean–variance portfolio optimization: A numerical impulse control approach," Insurance: Mathematics and Economics, Elsevier, vol. 83(C), pages 9-28.
    6. Liang, Zongxia & Song, Min, 2015. "Time-consistent reinsurance and investment strategies for mean–variance insurer under partial information," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 66-76.
    7. Sun, Jingyun & Li, Zhongfei & Zeng, Yan, 2016. "Precommitment and equilibrium investment strategies for defined contribution pension plans under a jump–diffusion model," Insurance: Mathematics and Economics, Elsevier, vol. 67(C), pages 158-172.
    8. Xiang Meng, 2019. "Dynamic Mean-Variance Portfolio Optimisation," Papers 1907.03093, arXiv.org.
    9. Luca De Gennaro Aquino & Sascha Desmettre & Yevhen Havrylenko & Mogens Steffensen, 2024. "Equilibrium control theory for Kihlstrom-Mirman preferences in continuous time," Papers 2407.16525, arXiv.org, revised Oct 2024.
    10. Zongxia Liang & Sheng Wang & Jianming Xia & Fengyi Yuan, 2024. "Dynamic portfolio selection under generalized disappointment aversion," Papers 2401.08323, arXiv.org, revised Mar 2024.
    11. Liyuan Wang & Zhiping Chen, 2019. "Stochastic Game Theoretic Formulation for a Multi-Period DC Pension Plan with State-Dependent Risk Aversion," Mathematics, MDPI, vol. 7(1), pages 1-16, January.
    12. Agostino Capponi & Sveinn Olafsson & Thaleia Zariphopoulou, 2019. "Personalized Robo-Advising: Enhancing Investment through Client Interaction," Papers 1911.01391, arXiv.org, revised Nov 2020.
    13. Chen, Kexin & Wong, Hoi Ying, 2019. "Time-consistent mean-variance hedging of an illiquid asset with a cointegrated liquid asset," Finance Research Letters, Elsevier, vol. 29(C), pages 184-192.
    14. Marcel Nutz & Yuchong Zhang, 2019. "Conditional Optimal Stopping: A Time-Inconsistent Optimization," Papers 1901.05802, arXiv.org, revised Oct 2019.
    15. Christensen, Sören & Lindensjö, Kristoffer, 2020. "On time-inconsistent stopping problems and mixed strategy stopping times," Stochastic Processes and their Applications, Elsevier, vol. 130(5), pages 2886-2917.
    16. Agostino Capponi & Sveinn Ólafsson & Thaleia Zariphopoulou, 2022. "Personalized Robo-Advising: Enhancing Investment Through Client Interaction," Management Science, INFORMS, vol. 68(4), pages 2485-2512, April.
    17. Shen, Yang & Zou, Bin, 2021. "Mean–variance investment and risk control strategies — A time-consistent approach via a forward auxiliary process," Insurance: Mathematics and Economics, Elsevier, vol. 97(C), pages 68-80.
    18. Dong-Mei Zhu & Jia-Wen Gu & Feng-Hui Yu & Tak-Kuen Siu & Wai-Ki Ching, 2021. "Optimal pairs trading with dynamic mean-variance objective," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 94(1), pages 145-168, August.
    19. Chen, Zhiping & Yang, Peng, 2020. "Robust optimal reinsurance–investment strategy with price jumps and correlated claims," Insurance: Mathematics and Economics, Elsevier, vol. 92(C), pages 27-46.
    20. Junna Bi & Jun Cai & Yan Zeng, 2021. "Equilibrium reinsurance-investment strategies with partial information and common shock dependence," Annals of Operations Research, Springer, vol. 307(1), pages 1-24, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:64:y:2024:i:4:d:10.1007_s10614-023-10509-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.