IDEAS home Printed from https://ideas.repec.org/a/eee/spapps/v124y2014i12p3887-3920.html
   My bibliography  Save this article

Infinite horizon stopping problems with (nearly) total reward criteria

Author

Listed:
  • Palczewski, Jan
  • Stettner, Łukasz

Abstract

We study an infinite horizon optimal stopping Markov problem which is either undiscounted (total reward) or with a general Markovian discount rate. Using ergodic properties of the underlying Markov process, we establish the feasibility of the stopping problem and prove the existence of optimal and ε-optimal stopping times. We show the continuity of the value function and its variational characterisation (in the viscosity sense) under different sets of assumptions satisfied by large classes of diffusion and jump–diffusion processes. In the case of a general discounted problem we relax a classical assumption that the discount rate is uniformly separated from zero.

Suggested Citation

  • Palczewski, Jan & Stettner, Łukasz, 2014. "Infinite horizon stopping problems with (nearly) total reward criteria," Stochastic Processes and their Applications, Elsevier, vol. 124(12), pages 3887-3920.
    • Handle: RePEc:eee:spapps:v:124:y:2014:i:12:p:3887-3920
    DOI: 10.1016/j.spa.2014.07.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304414914001653
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.spa.2014.07.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Veretennikov, A. Yu., 1997. "On polynomial mixing bounds for stochastic differential equations," Stochastic Processes and their Applications, Elsevier, vol. 70(1), pages 115-127, October.
    2. René Carmona & Nizar Touzi, 2008. "Optimal Multiple Stopping And Valuation Of Swing Options," Mathematical Finance, Wiley Blackwell, vol. 18(2), pages 239-268, April.
    3. Wang, Jian, 2010. "Regularity of semigroups generated by Lévy type operators via coupling," Stochastic Processes and their Applications, Elsevier, vol. 120(9), pages 1680-1700, August.
    4. Kulik, Alexey M., 2009. "Exponential ergodicity of the solutions to SDE's with a jump noise," Stochastic Processes and their Applications, Elsevier, vol. 119(2), pages 602-632, February.
    5. Masuda, Hiroki, 2007. "Ergodicity and exponential [beta]-mixing bounds for multidimensional diffusions with jumps," Stochastic Processes and their Applications, Elsevier, vol. 117(1), pages 35-56, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. E. Löcherbach, 2020. "Convergence to Equilibrium for Time-Inhomogeneous Jump Diffusions with State-Dependent Jump Intensity," Journal of Theoretical Probability, Springer, vol. 33(4), pages 2280-2314, December.
    2. Song, Yan-Hong, 2016. "Algebraic ergodicity for SDEs driven by Lévy processes," Statistics & Probability Letters, Elsevier, vol. 119(C), pages 108-115.
    3. Liang, Mingjie & Wang, Jian, 2020. "Gradient estimates and ergodicity for SDEs driven by multiplicative Lévy noises via coupling," Stochastic Processes and their Applications, Elsevier, vol. 130(5), pages 3053-3094.
    4. Charlotte Dion & Sarah Lemler, 2020. "Nonparametric drift estimation for diffusions with jumps driven by a Hawkes process," Statistical Inference for Stochastic Processes, Springer, vol. 23(3), pages 489-515, October.
    5. Anatolii A. Puhalskii, 2003. "On Large Deviation Convergence of Invariant Measures," Journal of Theoretical Probability, Springer, vol. 16(3), pages 689-724, July.
    6. Yuji Sakamoto & Nakahiro Yoshida, 2009. "Third-order asymptotic expansion of M-estimators for diffusion processes," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(3), pages 629-661, September.
    7. Oleksii Kulyk, 2023. "Support Theorem for Lévy-driven Stochastic Differential Equations," Journal of Theoretical Probability, Springer, vol. 36(3), pages 1720-1742, September.
    8. Schmisser, Émeline, 2019. "Non parametric estimation of the diffusion coefficients of a diffusion with jumps," Stochastic Processes and their Applications, Elsevier, vol. 129(12), pages 5364-5405.
    9. Cayé, Thomas & Herdegen, Martin & Muhle-Karbe, Johannes, 2020. "Scaling limits of processes with fast nonlinear mean reversion," Stochastic Processes and their Applications, Elsevier, vol. 130(4), pages 1994-2031.
    10. Alexander Veretennikov, 2023. "Polynomial Recurrence for SDEs with a Gradient-Type Drift, Revisited," Mathematics, MDPI, vol. 11(14), pages 1-16, July.
    11. Pavel V. Gapeev & Peter M. Kort & Maria N. Lavrutich & Jacco J. J. Thijssen, 2022. "Optimal Double Stopping Problems for Maxima and Minima of Geometric Brownian Motions," Methodology and Computing in Applied Probability, Springer, vol. 24(2), pages 789-813, June.
    12. Belleh Fontem, 2022. "An optimal stopping policy for car rental businesses with purchasing customers," Annals of Operations Research, Springer, vol. 317(1), pages 47-76, October.
    13. Kulik, Alexei & Pavlyukevich, Ilya, 2021. "Moment bounds for dissipative semimartingales with heavy jumps," Stochastic Processes and their Applications, Elsevier, vol. 141(C), pages 274-308.
    14. Noh, Jungsik & Lee, Seung Y. & Lee, Sangyeol, 2012. "Quantile regression estimation for discretely observed SDE models with compound Poisson jumps," Economics Letters, Elsevier, vol. 117(3), pages 734-738.
    15. Yuma Uehara, 2023. "Bootstrap method for misspecified ergodic Lévy driven stochastic differential equation models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(4), pages 533-565, August.
    16. Kanaya, Shin, 2017. "Convergence Rates Of Sums Of Α-Mixing Triangular Arrays: With An Application To Nonparametric Drift Function Estimation Of Continuous-Time Processes," Econometric Theory, Cambridge University Press, vol. 33(5), pages 1121-1153, October.
    17. Rodrigo S. Targino & Gareth W. Peters & Georgy Sofronov & Pavel V. Shevchenko, 2017. "Optimal Exercise Strategies for Operational Risk Insurance via Multiple Stopping Times," Methodology and Computing in Applied Probability, Springer, vol. 19(2), pages 487-518, June.
    18. Chen, Xiaohong & Hansen, Lars Peter & Carrasco, Marine, 2010. "Nonlinearity and temporal dependence," Journal of Econometrics, Elsevier, vol. 155(2), pages 155-169, April.
    19. Pavel V. Gapeev, 2022. "Perpetual American Double Lookback Options on Drawdowns and Drawups with Floating Strikes," Methodology and Computing in Applied Probability, Springer, vol. 24(2), pages 749-788, June.
    20. Long, Mingsi & Zhang, Hongzhong, 2019. "On the optimality of threshold type strategies in single and recursive optimal stopping under Lévy models," Stochastic Processes and their Applications, Elsevier, vol. 129(8), pages 2821-2849.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:spapps:v:124:y:2014:i:12:p:3887-3920. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/505572/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.