IDEAS home Printed from https://ideas.repec.org/a/spr/metcap/v24y2022i3d10.1007_s11009-021-09871-9.html
   My bibliography  Save this article

Solving Elliptic Equations with Brownian Motion: Bias Reduction and Temporal Difference Learning

Author

Listed:
  • Cameron Martin

    (University of Toronto)

  • Hongyuan Zhang

    (Carnegie Mellon University)

  • Julia Costacurta

    (Stanford University)

  • Mihai Nica

    (University of Guelph)

  • Adam R Stinchcombe

    (University of Toronto)

Abstract

The Feynman-Kac formula provides a way to understand solutions to elliptic partial differential equations in terms of expectations of continuous time Markov processes. This connection allows for the creation of numerical schemes for solutions based on samples of these Markov processes which have advantages over traditional numerical methods in some cases. However, naïve numerical implementations suffer from issues related to statistical bias and sampling efficiency. We present methods to discretize the stochastic process appearing in the Feynman-Kac formula that reduce the bias of the numerical scheme. We also propose using temporal difference learning to assemble information from random samples in a way that is more efficient than the traditional Monte Carlo method.

Suggested Citation

  • Cameron Martin & Hongyuan Zhang & Julia Costacurta & Mihai Nica & Adam R Stinchcombe, 2022. "Solving Elliptic Equations with Brownian Motion: Bias Reduction and Temporal Difference Learning," Methodology and Computing in Applied Probability, Springer, vol. 24(3), pages 1603-1626, September.
    • Handle: RePEc:spr:metcap:v:24:y:2022:i:3:d:10.1007_s11009-021-09871-9
    DOI: 10.1007/s11009-021-09871-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11009-021-09871-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11009-021-09871-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lejay, Antoine & Maire, Sylvain, 2007. "Computing the principal eigenvalue of the Laplace operator by a stochastic method," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 73(6), pages 351-363.
    2. Mark Broadie & Paul Glasserman & Steven Kou, 1997. "A Continuity Correction for Discrete Barrier Options," Mathematical Finance, Wiley Blackwell, vol. 7(4), pages 325-349, October.
    3. Hwang, Chi-Ok & Mascagni, Michael & Given, James A., 2003. "A Feynman–Kac path-integral implementation for Poisson’s equation using an h-conditioned Green’s function," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 62(3), pages 347-355.
    4. Gobet, Emmanuel & Menozzi, Stéphane, 2010. "Stopped diffusion processes: Boundary corrections and overshoot," Stochastic Processes and their Applications, Elsevier, vol. 120(2), pages 130-162, February.
    5. Justin Sirignano & Konstantinos Spiliopoulos, 2017. "DGM: A deep learning algorithm for solving partial differential equations," Papers 1708.07469, arXiv.org, revised Sep 2018.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herrmann, Samuel & Massin, Nicolas, 2023. "Exact simulation of the first passage time through a given level of jump diffusions," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 203(C), pages 553-576.
    2. Sheng-Feng Luo & Hsin-Chieh Wong, 2023. "Continuity correction: on the pricing of discrete double barrier options," Review of Derivatives Research, Springer, vol. 26(1), pages 51-90, April.
    3. Kristina O. F. Williams & Benjamin F. Akers, 2023. "Numerical Simulation of the Korteweg–de Vries Equation with Machine Learning," Mathematics, MDPI, vol. 11(13), pages 1-14, June.
    4. Hilscher, Jens & Raviv, Alon, 2014. "Bank stability and market discipline: The effect of contingent capital on risk taking and default probability," Journal of Corporate Finance, Elsevier, vol. 29(C), pages 542-560.
    5. William Lefebvre & Enzo Miller, 2021. "Linear-quadratic stochastic delayed control and deep learning resolution," Working Papers hal-03145949, HAL.
    6. Zhouzhou Gu & Mathieu Lauri`ere & Sebastian Merkel & Jonathan Payne, 2024. "Global Solutions to Master Equations for Continuous Time Heterogeneous Agent Macroeconomic Models," Papers 2406.13726, arXiv.org.
    7. Ernst, Philip A. & Rogers, L.C.G. & Zhou, Quan, 2017. "The value of foresight," Stochastic Processes and their Applications, Elsevier, vol. 127(12), pages 3913-3927.
    8. Andrzej Daniluk & Evgeny Lakshtanov & Rafal Muchorski, 2024. "Denoised Monte Carlo for option pricing and Greeks estimation," Papers 2402.12528, arXiv.org.
    9. Emmanuel Gobet, 2009. "Advanced Monte Carlo methods for barrier and related exotic options," Post-Print hal-00319947, HAL.
    10. repec:hal:wpaper:hal-03458299 is not listed on IDEAS
    11. Parand, K. & Aghaei, A.A. & Jani, M. & Ghodsi, A., 2021. "A new approach to the numerical solution of Fredholm integral equations using least squares-support vector regression," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 180(C), pages 114-128.
    12. Dell'Era Mario, M.D., 2008. "Pricing of the European Options by Spectral Theory," MPRA Paper 17429, University Library of Munich, Germany.
    13. William Lefebvre & Enzo Miller, 2021. "Linear-quadratic stochastic delayed control and deep learning resolution," Papers 2102.09851, arXiv.org, revised Feb 2021.
    14. Christian Skaug & Arvid Naess, 2007. "Fast and accurate pricing of discretely monitored barrier options by numerical path integration," Computational Economics, Springer;Society for Computational Economics, vol. 30(2), pages 143-151, September.
    15. A. Max Reppen & H. Mete Soner & Valentin Tissot-Daguette, 2022. "Deep Stochastic Optimization in Finance," Papers 2205.04604, arXiv.org.
    16. Sebastian Jaimungal, 2022. "Reinforcement learning and stochastic optimisation," Finance and Stochastics, Springer, vol. 26(1), pages 103-129, January.
    17. Xie, Fei & He, Zhijian & Wang, Xiaoqun, 2019. "An importance sampling-based smoothing approach for quasi-Monte Carlo simulation of discrete barrier options," European Journal of Operational Research, Elsevier, vol. 274(2), pages 759-772.
    18. N. Hilber & N. Reich & C. Schwab & C. Winter, 2009. "Numerical methods for Lévy processes," Finance and Stochastics, Springer, vol. 13(4), pages 471-500, September.
    19. Shuaiqiang Liu & Cornelis W. Oosterlee & Sander M. Bohte, 2019. "Pricing Options and Computing Implied Volatilities using Neural Networks," Risks, MDPI, vol. 7(1), pages 1-22, February.
    20. Bastien Baldacci & Joffrey Derchu & Iuliia Manziuk, 2020. "An approximate solution for options market-making in high dimension," Papers 2009.00907, arXiv.org.
    21. Alexandre Pannier & Cristopher Salvi, 2024. "A path-dependent PDE solver based on signature kernels," Papers 2403.11738, arXiv.org, revised Oct 2024.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metcap:v:24:y:2022:i:3:d:10.1007_s11009-021-09871-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.