IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.06774.html
   My bibliography  Save this paper

Hedging American Put Options with Deep Reinforcement Learning

Author

Listed:
  • Reilly Pickard
  • Finn Wredenhagen
  • Julio DeJesus
  • Mario Schlener
  • Yuri Lawryshyn

Abstract

This article leverages deep reinforcement learning (DRL) to hedge American put options, utilizing the deep deterministic policy gradient (DDPG) method. The agents are first trained and tested with Geometric Brownian Motion (GBM) asset paths and demonstrate superior performance over traditional strategies like the Black-Scholes (BS) Delta, particularly in the presence of transaction costs. To assess the real-world applicability of DRL hedging, a second round of experiments uses a market calibrated stochastic volatility model to train DRL agents. Specifically, 80 put options across 8 symbols are collected, stochastic volatility model coefficients are calibrated for each symbol, and a DRL agent is trained for each of the 80 options by simulating paths of the respective calibrated model. Not only do DRL agents outperform the BS Delta method when testing is conducted using the same calibrated stochastic volatility model data from training, but DRL agents achieves better results when hedging the true asset path that occurred between the option sale date and the maturity. As such, not only does this study present the first DRL agents tailored for American put option hedging, but results on both simulated and empirical market testing data also suggest the optimality of DRL agents over the BS Delta method in real-world scenarios. Finally, note that this study employs a model-agnostic Chebyshev interpolation method to provide DRL agents with option prices at each time step when a stochastic volatility model is used, thereby providing a general framework for an easy extension to more complex underlying asset processes.

Suggested Citation

  • Reilly Pickard & Finn Wredenhagen & Julio DeJesus & Mario Schlener & Yuri Lawryshyn, 2024. "Hedging American Put Options with Deep Reinforcement Learning," Papers 2405.06774, arXiv.org.
    • Handle: RePEc:arx:papers:2405.06774
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2405.06774
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    2. Kathrin Glau & Mirco Mahlstedt & Christian Potz, 2018. "A new approach for American option pricing: The Dynamic Chebyshev method," Papers 1806.05579, arXiv.org.
    3. Ali Fathi & Bernhard Hientzsch, 2023. "A Comparison of Reinforcement Learning and Deep Trajectory Based Stochastic Control Agents for Stepwise Mean-Variance Hedging," Papers 2302.07996, arXiv.org, revised Nov 2023.
    4. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    5. Jay Cao & Jacky Chen & Soroush Farghadani & John Hull & Zissis Poulos & Zeyu Wang & Jun Yuan, 2022. "Gamma and Vega Hedging Using Deep Distributional Reinforcement Learning," Papers 2205.05614, arXiv.org, revised Jan 2023.
    6. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    7. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    8. Jay Cao & Jacky Chen & John Hull & Zissis Poulos, 2021. "Deep Hedging of Derivatives Using Reinforcement Learning," Papers 2103.16409, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reilly Pickard & F. Wredenhagen & Y. Lawryshyn, 2024. "Optimizing Deep Reinforcement Learning for American Put Option Hedging," Papers 2405.08602, arXiv.org.
    2. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    3. Zoran Stoiljkovic, 2023. "Applying Reinforcement Learning to Option Pricing and Hedging," Papers 2310.04336, arXiv.org.
    4. Ben Hambly & Renyuan Xu & Huining Yang, 2023. "Recent advances in reinforcement learning in finance," Mathematical Finance, Wiley Blackwell, vol. 33(3), pages 437-503, July.
    5. O. Samimi & Z. Mardani & S. Sharafpour & F. Mehrdoust, 2017. "LSM Algorithm for Pricing American Option Under Heston–Hull–White’s Stochastic Volatility Model," Computational Economics, Springer;Society for Computational Economics, vol. 50(2), pages 173-187, August.
    6. Song-Ping Zhu & Xin-Jiang He, 2018. "A hybrid computational approach for option pricing," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 5(03), pages 1-16, September.
    7. Xuemei Gao & Dongya Deng & Yue Shan, 2014. "Lattice Methods for Pricing American Strangles with Two-Dimensional Stochastic Volatility Models," Discrete Dynamics in Nature and Society, Hindawi, vol. 2014, pages 1-6, April.
    8. Hainaut, Donatien & Akbaraly, Adnane, 2023. "Risk management with Local Least Squares Monte-Carlo," LIDAM Discussion Papers ISBA 2023003, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    9. Somayeh Moazeni & Thomas F. Coleman & Yuying Li, 2016. "Smoothing and parametric rules for stochastic mean-CVaR optimal execution strategy," Annals of Operations Research, Springer, vol. 237(1), pages 99-120, February.
    10. Lars Stentoft, 2008. "American Option Pricing Using GARCH Models and the Normal Inverse Gaussian Distribution," Journal of Financial Econometrics, Oxford University Press, vol. 6(4), pages 540-582, Fall.
    11. Seiji Harikae & James S. Dyer & Tianyang Wang, 2021. "Valuing Real Options in the Volatile Real World," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 171-189, January.
    12. Calypso Herrera & Florian Krach & Pierre Ruyssen & Josef Teichmann, 2021. "Optimal Stopping via Randomized Neural Networks," Papers 2104.13669, arXiv.org, revised Dec 2023.
    13. Stefan Haring & Ronald Hochreiter, 2015. "Efficient and robust calibration of the Heston option pricing model for American options using an improved Cuckoo Search Algorithm," Papers 1507.08937, arXiv.org.
    14. David Heath & Eckhard Platen, 2002. "A variance reduction technique based on integral representations," Quantitative Finance, Taylor & Francis Journals, vol. 2(5), pages 362-369.
    15. A. Max Reppen & H. Mete Soner & Valentin Tissot-Daguette, 2022. "Deep Stochastic Optimization in Finance," Papers 2205.04604, arXiv.org.
    16. Lars Stentoft, 2008. "Option Pricing using Realized Volatility," CREATES Research Papers 2008-13, Department of Economics and Business Economics, Aarhus University.
    17. Lim, Terence & Lo, Andrew W. & Merton, Robert C. & Scholes, Myron S., 2006. "The Derivatives Sourcebook," Foundations and Trends(R) in Finance, now publishers, vol. 1(5–6), pages 365-572, April.
    18. Mehrdoust, Farshid & Noorani, Idin & Hamdi, Abdelouahed, 2023. "Two-factor Heston model equipped with regime-switching: American option pricing and model calibration by Levenberg–Marquardt optimization algorithm," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 204(C), pages 660-678.
    19. Fan, Chenxi & Luo, Xingguo & Wu, Qingbiao, 2017. "Stochastic volatility vs. jump diffusions: Evidence from the Chinese convertible bond market," International Review of Economics & Finance, Elsevier, vol. 49(C), pages 1-16.
    20. Duy Nguyen, 2018. "A hybrid Markov chain-tree valuation framework for stochastic volatility jump diffusion models," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 1-30, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.06774. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.