IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2207.07467.html
   My bibliography  Save this paper

Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions

Author

Listed:
  • Phillip Murray
  • Ben Wood
  • Hans Buehler
  • Magnus Wiese
  • Mikko S. Pakkanen

Abstract

We present a method for finding optimal hedging policies for arbitrary initial portfolios and market states. We develop a novel actor-critic algorithm for solving general risk-averse stochastic control problems and use it to learn hedging strategies across multiple risk aversion levels simultaneously. We demonstrate the effectiveness of the approach with a numerical example in a stochastic volatility environment.

Suggested Citation

  • Phillip Murray & Ben Wood & Hans Buehler & Magnus Wiese & Mikko S. Pakkanen, 2022. "Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions," Papers 2207.07467, arXiv.org.
    • Handle: RePEc:arx:papers:2207.07467
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2207.07467
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Blanka Horvath & Josef Teichmann & Zan Zuric, 2021. "Deep Hedging under Rough Volatility," Swiss Finance Institute Research Paper Series 21-88, Swiss Finance Institute.
    2. Mark Broadie & Özgür Kaya, 2006. "Exact Simulation of Stochastic Volatility and Other Affine Jump Diffusion Processes," Operations Research, INFORMS, vol. 54(2), pages 217-231, April.
    3. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    4. Sebastian Becker & Patrick Cheridito & Arnulf Jentzen, 2020. "Pricing and Hedging American-Style Options with Deep Learning," JRFM, MDPI, vol. 13(7), pages 1-12, July.
    5. Sebastian Becker & Patrick Cheridito & Arnulf Jentzen, 2019. "Pricing and hedging American-style options with deep learning," Papers 1912.11060, arXiv.org, revised Jul 2020.
    6. Blanka Horvath & Josef Teichmann & Žan Žurič, 2021. "Deep Hedging under Rough Volatility," Risks, MDPI, vol. 9(7), pages 1-20, July.
    7. Sebastian Jaimungal, 2022. "Reinforcement learning and stochastic optimisation," Finance and Stochastics, Springer, vol. 26(1), pages 103-129, January.
    8. Blanka Horvath & Josef Teichmann & Zan Zuric, 2021. "Deep Hedging under Rough Volatility," Papers 2102.01962, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emmanuel Gnabeyeu & Omar Karkar & Imad Idboufous, 2024. "Solving The Dynamic Volatility Fitting Problem: A Deep Reinforcement Learning Approach," Papers 2410.11789, arXiv.org.
    2. Iuga, Iulia Cristina & Mudakkar, Syeda Rabab & Dragolea, Larisa Loredana, 2024. "Agricultural commodities market reaction to COVID-19," Research in International Business and Finance, Elsevier, vol. 69(C).
    3. El Amine Cherrat & Snehal Raj & Iordanis Kerenidis & Abhishek Shekhar & Ben Wood & Jon Dee & Shouvanik Chakrabarti & Richard Chen & Dylan Herman & Shaohan Hu & Pierre Minssen & Ruslan Shaydulin & Yue , 2023. "Quantum Deep Hedging," Papers 2303.16585, arXiv.org, revised Nov 2023.
    4. Masanori Hirano & Kentaro Minami & Kentaro Imajo, 2023. "Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling," Papers 2307.13217, arXiv.org.
    5. Yannick Limmer & Blanka Horvath, 2023. "Robust Hedging GANs," Papers 2307.02310, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masanori Hirano & Kentaro Imajo & Kentaro Minami & Takuya Shimada, 2023. "Efficient Learning of Nested Deep Hedging using Multiple Options," Papers 2305.12264, arXiv.org.
    2. Masanori Hirano & Kentaro Minami & Kentaro Imajo, 2023. "Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling," Papers 2307.13217, arXiv.org.
    3. Hainaut, Donatien & Akbaraly, Adnane, 2023. "Risk management with Local Least Squares Monte-Carlo," LIDAM Discussion Papers ISBA 2023003, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. Calypso Herrera & Florian Krach & Pierre Ruyssen & Josef Teichmann, 2021. "Optimal Stopping via Randomized Neural Networks," Papers 2104.13669, arXiv.org, revised Dec 2023.
    5. Alexandre Carbonneau & Fr'ed'eric Godin, 2021. "Deep equal risk pricing of financial derivatives with non-translation invariant risk measures," Papers 2107.11340, arXiv.org.
    6. Ofelia Bonesini & Antoine Jacquier & Alexandre Pannier, 2023. "Rough volatility, path-dependent PDEs and weak rates of convergence," Papers 2304.03042, arXiv.org.
    7. Ludovic Gouden`ege & Andrea Molent & Antonino Zanette, 2023. "Backward Hedging for American Options with Transaction Costs," Papers 2305.06805, arXiv.org, revised Jun 2023.
    8. Beatrice Acciaio & Anastasis Kratsios & Gudmund Pammer, 2022. "Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformer," Papers 2201.13094, arXiv.org, revised Mar 2023.
    9. Alexandre Carbonneau & Fr'ed'eric Godin, 2021. "Deep Equal Risk Pricing of Financial Derivatives with Multiple Hedging Instruments," Papers 2102.12694, arXiv.org.
    10. Daniele Angelini & Matthieu Garcin, 2024. "Market information of the fractional stochastic regularity model," Papers 2409.07159, arXiv.org.
    11. Kang Gao & Stephen Weston & Perukrishnen Vytelingum & Namid R. Stillman & Wayne Luk & Ce Guo, 2023. "Deeper Hedging: A New Agent-based Model for Effective Deep Hedging," Papers 2310.18755, arXiv.org.
    12. Shota Imaki & Kentaro Imajo & Katsuya Ito & Kentaro Minami & Kei Nakagawa, 2021. "No-Transaction Band Network: A Neural Network Architecture for Efficient Deep Hedging," Papers 2103.01775, arXiv.org.
    13. Carsten Chong & Marc Hoffmann & Yanghui Liu & Mathieu Rosenbaum & Gr'egoire Szymanski, 2022. "Statistical inference for rough volatility: Minimax Theory," Papers 2210.01214, arXiv.org, revised Feb 2024.
    14. Almut Veraart & Luitgard Veraart, 2012. "Stochastic volatility and stochastic leverage," Annals of Finance, Springer, vol. 8(2), pages 205-233, May.
    15. Song-Ping Zhu & Xin-Jiang He, 2018. "A hybrid computational approach for option pricing," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 5(03), pages 1-16, September.
    16. Jaehyuk Choi, 2024. "Exact simulation scheme for the Ornstein-Uhlenbeck driven stochastic volatility model with the Karhunen-Lo\`eve expansions," Papers 2402.09243, arXiv.org.
    17. Pascal Franc{c}ois & Genevi`eve Gauthier & Fr'ed'eric Godin & Carlos Octavio P'erez Mendoza, 2024. "Enhancing Deep Hedging of Options with Implied Volatility Surface Feedback Information," Papers 2407.21138, arXiv.org.
    18. John Ery & Loris Michel, 2021. "Solving optimal stopping problems with Deep Q-Learning," Papers 2101.09682, arXiv.org, revised Jun 2024.
    19. Chenxu Li, 2016. "Bessel Processes, Stochastic Volatility, And Timer Options," Mathematical Finance, Wiley Blackwell, vol. 26(1), pages 122-148, January.
    20. Bara Kim & In-Suk Wee, 2014. "Pricing of geometric Asian options under Heston's stochastic volatility model," Quantitative Finance, Taylor & Francis Journals, vol. 14(10), pages 1795-1809, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2207.07467. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.