IDEAS home Printed from https://ideas.repec.org/a/eee/spapps/v124y2014i12p3887-3920.html
   My bibliography  Save this article

Infinite horizon stopping problems with (nearly) total reward criteria

Author

Listed:
  • Palczewski, Jan
  • Stettner, Łukasz

Abstract

We study an infinite horizon optimal stopping Markov problem which is either undiscounted (total reward) or with a general Markovian discount rate. Using ergodic properties of the underlying Markov process, we establish the feasibility of the stopping problem and prove the existence of optimal and ε-optimal stopping times. We show the continuity of the value function and its variational characterisation (in the viscosity sense) under different sets of assumptions satisfied by large classes of diffusion and jump–diffusion processes. In the case of a general discounted problem we relax a classical assumption that the discount rate is uniformly separated from zero.

Suggested Citation

  • Palczewski, Jan & Stettner, Łukasz, 2014. "Infinite horizon stopping problems with (nearly) total reward criteria," Stochastic Processes and their Applications, Elsevier, vol. 124(12), pages 3887-3920.
    • Handle: RePEc:eee:spapps:v:124:y:2014:i:12:p:3887-3920
    DOI: 10.1016/j.spa.2014.07.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304414914001653
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.spa.2014.07.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Veretennikov, A. Yu., 1997. "On polynomial mixing bounds for stochastic differential equations," Stochastic Processes and their Applications, Elsevier, vol. 70(1), pages 115-127, October.
    2. René Carmona & Nizar Touzi, 2008. "Optimal Multiple Stopping And Valuation Of Swing Options," Mathematical Finance, Wiley Blackwell, vol. 18(2), pages 239-268, April.
    3. Wang, Jian, 2010. "Regularity of semigroups generated by Lévy type operators via coupling," Stochastic Processes and their Applications, Elsevier, vol. 120(9), pages 1680-1700, August.
    4. Kulik, Alexey M., 2009. "Exponential ergodicity of the solutions to SDE's with a jump noise," Stochastic Processes and their Applications, Elsevier, vol. 119(2), pages 602-632, February.
    5. Masuda, Hiroki, 2007. "Ergodicity and exponential [beta]-mixing bounds for multidimensional diffusions with jumps," Stochastic Processes and their Applications, Elsevier, vol. 117(1), pages 35-56, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. E. Löcherbach, 2020. "Convergence to Equilibrium for Time-Inhomogeneous Jump Diffusions with State-Dependent Jump Intensity," Journal of Theoretical Probability, Springer, vol. 33(4), pages 2280-2314, December.
    2. Liang, Mingjie & Wang, Jian, 2020. "Gradient estimates and ergodicity for SDEs driven by multiplicative Lévy noises via coupling," Stochastic Processes and their Applications, Elsevier, vol. 130(5), pages 3053-3094.
    3. Song, Yan-Hong, 2016. "Algebraic ergodicity for SDEs driven by Lévy processes," Statistics & Probability Letters, Elsevier, vol. 119(C), pages 108-115.
    4. Charlotte Dion & Sarah Lemler, 2020. "Nonparametric drift estimation for diffusions with jumps driven by a Hawkes process," Statistical Inference for Stochastic Processes, Springer, vol. 23(3), pages 489-515, October.
    5. Soren Christensen & Albrecht Irle & Stephan Jurgens, 2012. "Optimal multiple stopping with random waiting times," Papers 1205.1966, arXiv.org.
    6. Anatolii A. Puhalskii, 2003. "On Large Deviation Convergence of Invariant Measures," Journal of Theoretical Probability, Springer, vol. 16(3), pages 689-724, July.
    7. Liangchen Li & Michael Ludkovski, 2018. "Stochastic Switching Games," Papers 1807.03893, arXiv.org.
    8. Yuji Sakamoto & Nakahiro Yoshida, 2009. "Third-order asymptotic expansion of M-estimators for diffusion processes," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(3), pages 629-661, September.
    9. Oleksii Kulyk, 2023. "Support Theorem for Lévy-driven Stochastic Differential Equations," Journal of Theoretical Probability, Springer, vol. 36(3), pages 1720-1742, September.
    10. Schmisser, Émeline, 2019. "Non parametric estimation of the diffusion coefficients of a diffusion with jumps," Stochastic Processes and their Applications, Elsevier, vol. 129(12), pages 5364-5405.
    11. Guillin, A. & Liptser, R., 2005. "MDP for integral functionals of fast and slow processes with averaging," Stochastic Processes and their Applications, Elsevier, vol. 115(7), pages 1187-1207, July.
    12. Cayé, Thomas & Herdegen, Martin & Muhle-Karbe, Johannes, 2020. "Scaling limits of processes with fast nonlinear mean reversion," Stochastic Processes and their Applications, Elsevier, vol. 130(4), pages 1994-2031.
    13. Anatolii A. Puhalskii & Michael Jay Stutzer, 2016. "On minimising a portfolio's shortfall probability," Papers 1602.02192, arXiv.org, revised May 2017.
    14. Alexander Veretennikov, 2023. "Polynomial Recurrence for SDEs with a Gradient-Type Drift, Revisited," Mathematics, MDPI, vol. 11(14), pages 1-16, July.
    15. Belomestny, Denis & Kolodko, Anastasia & Schoenmakers, John G. M., 2009. "Regression methods for stochastic control problems and their convergence analysis," SFB 649 Discussion Papers 2009-026, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    16. Raimund M. Kovacevic, 2019. "Valuation and pricing of electricity delivery contracts: the producer’s view," Annals of Operations Research, Springer, vol. 275(2), pages 421-460, April.
    17. Pavel V. Gapeev & Peter M. Kort & Maria N. Lavrutich & Jacco J. J. Thijssen, 2022. "Optimal Double Stopping Problems for Maxima and Minima of Geometric Brownian Motions," Methodology and Computing in Applied Probability, Springer, vol. 24(2), pages 789-813, June.
    18. Katia Colaneri & Tiziano De Angelis, 2019. "A class of recursive optimal stopping problems with applications to stock trading," Papers 1905.02650, arXiv.org, revised Jun 2021.
    19. Belleh Fontem, 2022. "An optimal stopping policy for car rental businesses with purchasing customers," Annals of Operations Research, Springer, vol. 317(1), pages 47-76, October.
    20. Bal'azs Gerencs'er & Mikl'os R'asonyi, 2020. "Invariant measures for multidimensional fractional stochastic volatility models," Papers 2002.04832, arXiv.org, revised Aug 2021.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:spapps:v:124:y:2014:i:12:p:3887-3920. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/505572/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.