IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2410.22568.html
   My bibliography  Save this paper

Fast Deep Hedging with Second-Order Optimization

Author

Listed:
  • Konrad Mueller
  • Amira Akkari
  • Lukas Gonon
  • Ben Wood

Abstract

Hedging exotic options in presence of market frictions is an important risk management task. Deep hedging can solve such hedging problems by training neural network policies in realistic simulated markets. Training these neural networks may be delicate and suffer from slow convergence, particularly for options with long maturities and complex sensitivities to market parameters. To address this, we propose a second-order optimization scheme for deep hedging. We leverage pathwise differentiability to construct a curvature matrix, which we approximate as block-diagonal and Kronecker-factored to efficiently precondition gradients. We evaluate our method on a challenging and practically important problem: hedging a cliquet option on a stock with stochastic volatility by trading in the spot and vanilla options. We find that our second-order scheme can optimize the policy in 1/4 of the number of steps that standard adaptive moment-based optimization takes.

Suggested Citation

  • Konrad Mueller & Amira Akkari & Lukas Gonon & Ben Wood, 2024. "Fast Deep Hedging with Second-Order Optimization," Papers 2410.22568, arXiv.org.
    • Handle: RePEc:arx:papers:2410.22568
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2410.22568
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Carbonneau, Alexandre, 2021. "Deep hedging of long-term financial derivatives," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 327-340.
    3. Martin Schweizer, 1995. "Variance-Optimal Hedging in Discrete Time," Mathematics of Operations Research, INFORMS, vol. 20(1), pages 1-32, February.
    4. Johannes Ruf & Weiguan Wang, 2019. "Neural networks for option pricing and hedging: a literature review," Papers 1911.05620, arXiv.org, revised May 2020.
    5. Blanka Horvath & Josef Teichmann & Zan Zuric, 2021. "Deep Hedging under Rough Volatility," Swiss Finance Institute Research Paper Series 21-88, Swiss Finance Institute.
    6. Mark Broadie & Özgür Kaya, 2006. "Exact Simulation of Stochastic Volatility and Other Affine Jump Diffusion Processes," Operations Research, INFORMS, vol. 54(2), pages 217-231, April.
    7. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    8. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    9. Blanka Horvath & Josef Teichmann & Zan Zuric, 2021. "Deep Hedging under Rough Volatility," Papers 2102.01962, arXiv.org.
    10. Ben Hambly & Renyuan Xu & Huining Yang, 2023. "Recent advances in reinforcement learning in finance," Mathematical Finance, Wiley Blackwell, vol. 33(3), pages 437-503, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pascal Franc{c}ois & Genevi`eve Gauthier & Fr'ed'eric Godin & Carlos Octavio P'erez Mendoza, 2024. "Is the difference between deep hedging and delta hedging a statistical arbitrage?," Papers 2407.14736, arXiv.org, revised Oct 2024.
    2. Pascal Franc{c}ois & Genevi`eve Gauthier & Fr'ed'eric Godin & Carlos Octavio P'erez Mendoza, 2024. "Enhancing Deep Hedging of Options with Implied Volatility Surface Feedback Information," Papers 2407.21138, arXiv.org.
    3. Alexandre Carbonneau & Fr'ed'eric Godin, 2021. "Deep equal risk pricing of financial derivatives with non-translation invariant risk measures," Papers 2107.11340, arXiv.org.
    4. Masanori Hirano & Kentaro Imajo & Kentaro Minami & Takuya Shimada, 2023. "Efficient Learning of Nested Deep Hedging using Multiple Options," Papers 2305.12264, arXiv.org.
    5. Phillip Murray & Ben Wood & Hans Buehler & Magnus Wiese & Mikko S. Pakkanen, 2022. "Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions," Papers 2207.07467, arXiv.org.
    6. Reilly Pickard & Yuri Lawryshyn, 2023. "Deep Reinforcement Learning for Dynamic Stock Option Hedging: A Review," Mathematics, MDPI, vol. 11(24), pages 1-19, December.
    7. Flavio Angelini & Stefano Herzel, 2015. "Evaluating discrete dynamic strategies in affine models," Quantitative Finance, Taylor & Francis Journals, vol. 15(2), pages 313-326, February.
    8. Alexandre Carbonneau & Fr'ed'eric Godin, 2021. "Deep Equal Risk Pricing of Financial Derivatives with Multiple Hedging Instruments," Papers 2102.12694, arXiv.org.
    9. Daniele Angelini & Matthieu Garcin, 2024. "Market information of the fractional stochastic regularity model," Papers 2409.07159, arXiv.org.
    10. Horikawa, Hiroaki & Nakagawa, Kei, 2024. "Relationship between deep hedging and delta hedging: Leveraging a statistical arbitrage strategy," Finance Research Letters, Elsevier, vol. 62(PA).
    11. Kang Gao & Stephen Weston & Perukrishnen Vytelingum & Namid R. Stillman & Wayne Luk & Ce Guo, 2023. "Deeper Hedging: A New Agent-based Model for Effective Deep Hedging," Papers 2310.18755, arXiv.org.
    12. Masanori Hirano & Kentaro Minami & Kentaro Imajo, 2023. "Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling," Papers 2307.13217, arXiv.org.
    13. Shota Imaki & Kentaro Imajo & Katsuya Ito & Kentaro Minami & Kei Nakagawa, 2021. "No-Transaction Band Network: A Neural Network Architecture for Efficient Deep Hedging," Papers 2103.01775, arXiv.org.
    14. Xianhua Peng & Xiang Zhou & Bo Xiao & Yi Wu, 2024. "A Risk Sensitive Contract-unified Reinforcement Learning Approach for Option Hedging," Papers 2411.09659, arXiv.org.
    15. Almut Veraart & Luitgard Veraart, 2012. "Stochastic volatility and stochastic leverage," Annals of Finance, Springer, vol. 8(2), pages 205-233, May.
    16. Song-Ping Zhu & Xin-Jiang He, 2018. "A hybrid computational approach for option pricing," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 5(03), pages 1-16, September.
    17. Jaehyuk Choi, 2024. "Exact simulation scheme for the Ornstein-Uhlenbeck driven stochastic volatility model with the Karhunen-Lo\`eve expansions," Papers 2402.09243, arXiv.org.
    18. Blanka Horvath & Josef Teichmann & Žan Žurič, 2021. "Deep Hedging under Rough Volatility," Risks, MDPI, vol. 9(7), pages 1-20, July.
    19. Boris Ter-Avanesov & Homayoon Beigi, 2024. "MLP, XGBoost, KAN, TDNN, and LSTM-GRU Hybrid RNN with Attention for SPX and NDX European Call Option Pricing," Papers 2409.06724, arXiv.org, revised Oct 2024.
    20. A. Max Reppen & H. Mete Soner & Valentin Tissot-Daguette, 2022. "Deep Stochastic Optimization in Finance," Papers 2205.04604, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2410.22568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.