IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb649/sfb649dp2009-026.html
   My bibliography  Save this paper

Regression methods for stochastic control problems and their convergence analysis

Author

Listed:
  • Belomestny, Denis
  • Kolodko, Anastasia
  • Schoenmakers, John G. M.

Abstract

In this paper we develop several regression algorithms for solving general stochastic optimal control problems via Monte Carlo. This type of algorithms is particularly useful for problems with a highdimensional state space and complex dependence structure of the underlying Markov process with respect to some control. The main idea behind the algorithms is to simulate a set of trajectories under some reference measure and to use the Bellman principle combined with fast methods for approximating conditional expectations and functional optimization. Theoretical properties of the presented algorithms are investigated and the convergence to the optimal solution is proved under some assumptions. Finally, the presented methods are applied in a numerical example of a high-dimensional controlled Bermudan basket option in a financial market with a large investor.

Suggested Citation

  • Belomestny, Denis & Kolodko, Anastasia & Schoenmakers, John G. M., 2009. "Regression methods for stochastic control problems and their convergence analysis," SFB 649 Discussion Papers 2009-026, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    • Handle: RePEc:zbw:sfb649:sfb649dp2009-026
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/25342/1/599991771.PDF
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    2. Monoyios, Michael, 2004. "Option pricing with transaction costs using a Markov chain approximation," Journal of Economic Dynamics and Control, Elsevier, vol. 28(5), pages 889-913, February.
    3. Bruno Bouchard & Ivar Ekeland & Nizar Touzi, 2004. "On the Malliavin approach to Monte Carlo approximation of conditional expectations," Finance and Stochastics, Springer, vol. 8(1), pages 45-71, January.
    4. Denis Belomestny & Grigori Milstein & Vladimir Spokoiny, 2009. "Regression methods in pricing American and Bermudan options using consumption processes," Quantitative Finance, Taylor & Francis Journals, vol. 9(3), pages 315-327.
    5. repec:dau:papers:123456789/1802 is not listed on IDEAS
    6. René Carmona & Nizar Touzi, 2008. "Optimal Multiple Stopping And Valuation Of Swing Options," Mathematical Finance, Wiley Blackwell, vol. 18(2), pages 239-268, April.
    7. Martin B. Haugh & Leonid Kogan, 2004. "Pricing American Options: A Duality Approach," Operations Research, INFORMS, vol. 52(2), pages 258-270, April.
    8. N. Meinshausen & B. M. Hambly, 2004. "Monte Carlo Methods For The Valuation Of Multiple‐Exercise Options," Mathematical Finance, Wiley Blackwell, vol. 14(4), pages 557-583, October.
    9. L. C. G. Rogers, 2002. "Monte Carlo valuation of American options," Mathematical Finance, Wiley Blackwell, vol. 12(3), pages 271-286, July.
    10. Broadie, Mark & Glasserman, Paul, 1997. "Pricing American-style securities using simulation," Journal of Economic Dynamics and Control, Elsevier, vol. 21(8-9), pages 1323-1352, June.
    11. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Yeo, 2023. "An analysis of least squares regression and neural networks approximation for the pricing of swing options," Papers 2307.04510, arXiv.org.
    2. John Schoenmakers & Junbo Huang & Jianing Zhang, 2011. "Optimal dual martingales, their analysis and application to new algorithms for Bermudan products," Papers 1111.6038, arXiv.org, revised Feb 2012.
    3. Lajos Gergely Gyurko & Ben Hambly & Jan Hendrik Witte, 2011. "Monte Carlo methods via a dual approach for some discrete time stochastic control problems," Papers 1112.4351, arXiv.org.
    4. Nicholas Andrew Yap Swee Guan, 2015. "Regression and Convex Switching System Methods for Stochastic Control Problems with Applications to Multiple-Exercise Options," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 26, July-Dece.
    5. Fort Gersende & Gobet Emmanuel & Moulines Eric, 2017. "MCMC design-based non-parametric regression for rare event. Application to nested risk computations," Monte Carlo Methods and Applications, De Gruyter, vol. 23(1), pages 21-42, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Schoenmakers, 2012. "A pure martingale dual for multiple stopping," Finance and Stochastics, Springer, vol. 16(2), pages 319-334, April.
    2. Denis Belomestny & Grigori Milstein & Vladimir Spokoiny, 2009. "Regression methods in pricing American and Bermudan options using consumption processes," Quantitative Finance, Taylor & Francis Journals, vol. 9(3), pages 315-327.
    3. Nicolas Essis-Breton & Patrice Gaillardetz, 2020. "Fast Lower and Upper Estimates for the Price of Constrained Multiple Exercise American Options by Single Pass Lookahead Search and Nearest-Neighbor Martingale," Papers 2002.11258, arXiv.org.
    4. Denis Belomestny & G. Milstein & John Schoenmakers, 2010. "Sensitivities for Bermudan options by regression methods," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 33(2), pages 117-138, November.
    5. repec:hum:wpaper:sfb649dp2006-051 is not listed on IDEAS
    6. Cosma, Antonio & Galluccio, Stefano & Pederzoli, Paola & Scaillet, Olivier, 2020. "Early Exercise Decision in American Options with Dividends, Stochastic Volatility, and Jumps," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 55(1), pages 331-356, February.
    7. Antonio Cosma & Stefano Galluccio & Paola Pederzoli & O. Scaillet, 2012. "Valuing American Options Using Fast Recursive Projections," Swiss Finance Institute Research Paper Series 12-26, Swiss Finance Institute.
    8. Ammann, Manuel & Kind, Axel & Wilde, Christian, 2008. "Simulation-based pricing of convertible bonds," Journal of Empirical Finance, Elsevier, vol. 15(2), pages 310-331, March.
    9. Dragos Florin Ciocan & Velibor V. Mišić, 2022. "Interpretable Optimal Stopping," Management Science, INFORMS, vol. 68(3), pages 1616-1638, March.
    10. Ludovic Gouden`ege & Andrea Molent & Antonino Zanette, 2019. "Variance Reduction Applied to Machine Learning for Pricing Bermudan/American Options in High Dimension," Papers 1903.11275, arXiv.org, revised Dec 2019.
    11. Bradley Sturt, 2021. "A nonparametric algorithm for optimal stopping based on robust optimization," Papers 2103.03300, arXiv.org, revised Mar 2023.
    12. Jain, Shashi & Roelofs, Ferry & Oosterlee, Cornelis W., 2013. "Valuing modular nuclear power plants in finite time decision horizon," Energy Economics, Elsevier, vol. 36(C), pages 625-636.
    13. Aleksandrov, Nikolay & Espinoza, Raphael & Gyurkó, Lajos, 2013. "Optimal oil production and the world supply of oil," Journal of Economic Dynamics and Control, Elsevier, vol. 37(7), pages 1248-1263.
    14. Ravi Kashyap, 2016. "Options as Silver Bullets: Valuation of Term Loans, Inventory Management, Emissions Trading and Insurance Risk Mitigation using Option Theory," Papers 1609.01274, arXiv.org, revised Mar 2022.
    15. Mark Broadie & Menghui Cao, 2008. "Improved lower and upper bound algorithms for pricing American options by simulation," Quantitative Finance, Taylor & Francis Journals, vol. 8(8), pages 845-861.
    16. Vladislav Kargin, 2005. "Lattice Option Pricing By Multidimensional Interpolation," Mathematical Finance, Wiley Blackwell, vol. 15(4), pages 635-647, October.
    17. Chen Liu & Henry Schellhorn & Qidi Peng, 2019. "American Option Pricing With Regression: Convergence Analysis," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 22(08), pages 1-31, December.
    18. Christian Bender & Anastasia Kolodko & John Schoenmakers, 2008. "Enhanced policy iteration for American options via scenario selection," Quantitative Finance, Taylor & Francis Journals, vol. 8(2), pages 135-146.
    19. Leif Andersen & Mark Broadie, 2004. "Primal-Dual Simulation Algorithm for Pricing Multidimensional American Options," Management Science, INFORMS, vol. 50(9), pages 1222-1234, September.
    20. Juri Hinz & Tanya Tarnopolskaya & Jeremy Yee, 2020. "Efficient algorithms of pathwise dynamic programming for decision optimization in mining operations," Annals of Operations Research, Springer, vol. 286(1), pages 583-615, March.
    21. Fujiwara, Hajime & Kijima, Masaaki, 2007. "Pricing of path-dependent American options by Monte Carlo simulation," Journal of Economic Dynamics and Control, Elsevier, vol. 31(11), pages 3478-3502, November.

    More about this item

    Keywords

    Optimal stochastic control; Regression methods; Convergence analysis.;
    All these keywords.

    JEL classification:

    • R12 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Size and Spatial Distributions of Regional Economic Activity; Interregional Trade (economic geography)

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb649:sfb649dp2009-026. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.