IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2310.04336.html
   My bibliography  Save this paper

Applying Reinforcement Learning to Option Pricing and Hedging

Author

Listed:
  • Zoran Stoiljkovic

Abstract

This thesis provides an overview of the recent advances in reinforcement learning in pricing and hedging financial instruments, with a primary focus on a detailed explanation of the Q-Learning Black Scholes approach, introduced by Halperin (2017). This reinforcement learning approach bridges the traditional Black and Scholes (1973) model with novel artificial intelligence algorithms, enabling option pricing and hedging in a completely model-free and data-driven way. This paper also explores the algorithm's performance under different state variables and scenarios for a European put option. The results reveal that the model is an accurate estimator under different levels of volatility and hedging frequency. Moreover, this method exhibits robust performance across various levels of option's moneyness. Lastly, the algorithm incorporates proportional transaction costs, indicating diverse impacts on profit and loss, affected by different statistical properties of the state variables.

Suggested Citation

  • Zoran Stoiljkovic, 2023. "Applying Reinforcement Learning to Option Pricing and Hedging," Papers 2310.04336, arXiv.org.
    • Handle: RePEc:arx:papers:2310.04336
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2310.04336
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Leland, Hayne E, 1985. "Option Pricing and Replication with Transactions Costs," Journal of Finance, American Finance Association, vol. 40(5), pages 1283-1301, December.
    2. Robert C. Merton, 2005. "Theory of rational option pricing," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 8, pages 229-288, World Scientific Publishing Co. Pte. Ltd..
    3. Jay Cao & Jacky Chen & John Hull & Zissis Poulos, 2021. "Deep Hedging of Derivatives Using Reinforcement Learning," Papers 2103.16409, arXiv.org.
    4. Goodell, John W. & Kumar, Satish & Lim, Weng Marc & Pattnaik, Debidutta, 2021. "Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    5. Andrew Y. Chen & Tom Zimmermann, 2022. "Open Source Cross-Sectional Asset Pricing," Critical Finance Review, now publishers, vol. 11(2), pages 207-264, May.
    6. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    7. David Silver & Julian Schrittwieser & Karen Simonyan & Ioannis Antonoglou & Aja Huang & Arthur Guez & Thomas Hubert & Lucas Baker & Matthew Lai & Adrian Bolton & Yutian Chen & Timothy Lillicrap & Fan , 2017. "Mastering the game of Go without human knowledge," Nature, Nature, vol. 550(7676), pages 354-359, October.
    8. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    9. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    10. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    11. Igor Halperin, 2019. "The QLBS Q-Learner goes NuQLear: fitted Q iteration, inverse RL, and option portfolios," Quantitative Finance, Taylor & Francis Journals, vol. 19(9), pages 1543-1553, September.
    12. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    13. Klaus Grobys & James W. Kolari & Joachim Niang, 2022. "Man versus machine: on artificial intelligence and hedge funds performance," Applied Economics, Taylor & Francis Journals, vol. 54(40), pages 4632-4646, August.
    14. Hull, John C & White, Alan D, 1987. "The Pricing of Options on Assets with Stochastic Volatilities," Journal of Finance, American Finance Association, vol. 42(2), pages 281-300, June.
    15. Cox, John C. & Ross, Stephen A. & Rubinstein, Mark, 1979. "Option pricing: A simplified approach," Journal of Financial Economics, Elsevier, vol. 7(3), pages 229-263, September.
    16. Hull, John & White, Alan, 2017. "Optimal delta hedging for options," Journal of Banking & Finance, Elsevier, vol. 82(C), pages 180-190.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    2. Ben Hambly & Renyuan Xu & Huining Yang, 2023. "Recent advances in reinforcement learning in finance," Mathematical Finance, Wiley Blackwell, vol. 33(3), pages 437-503, July.
    3. Mark Broadie & Jerome B. Detemple, 2004. "ANNIVERSARY ARTICLE: Option Pricing: Valuation Models and Applications," Management Science, INFORMS, vol. 50(9), pages 1145-1177, September.
    4. Lim, Terence & Lo, Andrew W. & Merton, Robert C. & Scholes, Myron S., 2006. "The Derivatives Sourcebook," Foundations and Trends(R) in Finance, now publishers, vol. 1(5–6), pages 365-572, April.
    5. Duffie, Darrell, 2003. "Intertemporal asset pricing theory," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 11, pages 639-742, Elsevier.
    6. Katarzyna Toporek, 2012. "Simple is better. Empirical comparison of American option valuation methods," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 29.
    7. Lars Stentoft, 2008. "Option Pricing using Realized Volatility," CREATES Research Papers 2008-13, Department of Economics and Business Economics, Aarhus University.
    8. Suresh M. Sundaresan, 2000. "Continuous‐Time Methods in Finance: A Review and an Assessment," Journal of Finance, American Finance Association, vol. 55(4), pages 1569-1622, August.
    9. Li, Chenxu & Ye, Yongxin, 2019. "Pricing and Exercising American Options: an Asymptotic Expansion Approach," Journal of Economic Dynamics and Control, Elsevier, vol. 107(C), pages 1-1.
    10. Cosma, Antonio & Galluccio, Stefano & Scaillet, Olivier, 2012. "Valuing American options using fast recursive projections," Working Papers unige:41856, University of Geneva, Geneva School of Economics and Management.
    11. Chen, Ding & Härkönen, Hannu J. & Newton, David P., 2014. "Advancing the universality of quadrature methods to any underlying process for option pricing," Journal of Financial Economics, Elsevier, vol. 114(3), pages 600-612.
    12. Stentoft, Lars, 2011. "American option pricing with discrete and continuous time models: An empirical comparison," Journal of Empirical Finance, Elsevier, vol. 18(5), pages 880-902.
    13. Francesco Rotondi, 2019. "American Options on High Dividend Securities: A Numerical Investigation," Risks, MDPI, vol. 7(2), pages 1-20, May.
    14. Michael A. Kouritzin, 2016. "Explicit Heston Solutions and Stochastic Approximation for Path-dependent Option Pricing," Papers 1608.02028, arXiv.org, revised Apr 2018.
    15. Zafar Ahmad & Reilly Browne & Rezaul Chowdhury & Rathish Das & Yushen Huang & Yimin Zhu, 2023. "Fast American Option Pricing using Nonlinear Stencils," Papers 2303.02317, arXiv.org, revised Oct 2023.
    16. Chan, Tat Lung (Ron), 2019. "Efficient computation of european option prices and their sensitivities with the complex fourier series method," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    17. Minqiang Li, 2010. "A quasi-analytical interpolation method for pricing American options under general multi-dimensional diffusion processes," Review of Derivatives Research, Springer, vol. 13(2), pages 177-217, July.
    18. Chuang-Chang Chang & Jun-Biao Lin & Wei-Che Tsai & Yaw-Huei Wang, 2012. "Using Richardson extrapolation techniques to price American options with alternative stochastic processes," Review of Quantitative Finance and Accounting, Springer, vol. 39(3), pages 383-406, October.
    19. Michael A. Kouritzin, 2018. "Explicit Heston Solutions And Stochastic Approximation For Path-Dependent Option Pricing," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 21(01), pages 1-45, February.
    20. Blessing Taruvinga & Boda Kang & Christina Sklibosios Nikitopoulos, 2018. "Pricing American Options with Jumps in Asset and Volatility," Research Paper Series 394, Quantitative Finance Research Centre, University of Technology, Sydney.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2310.04336. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.