Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons
Author
Abstract
Suggested Citation
DOI: 10.1007/s10957-020-01681-2
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- János Flesch & Arkadi Predtetchinski & Eilon Solan, 2017. "Sporadic Overtaking Optimality in Markov Decision Problems," Dynamic Games and Applications, Springer, vol. 7(2), pages 212-228, June.
- Alexander J. Zaslavski, 2014. "Turnpike Phenomenon and Infinite Horizon Optimal Control," Springer Optimization and Its Applications, Springer, edition 127, number 978-3-319-08828-0, June.
- Méder, Z.Z. & Flesch, J. & Peeters, R.J.A.P., 2012. "Optimal choice for finite and infinite horizons," Research Memorandum 024, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
- Arie Leizarowitz, 1996. "Overtaking and Almost-Sure Optimality for Infinite Horizon Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 21(1), pages 158-181, February.
- Andrzej S. Nowak & Oscar Vega-Amaya, 1999. "A counterexample on overtaking optimality," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 49(3), pages 435-439, July.
- Emilio De Santis & Fabio Spizzichino, 2016. "Usual and stochastic tail orders between hitting times for two Markov chains," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 32(4), pages 526-538, July.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- János Flesch & Arkadi Predtetchinski & Eilon Solan, 2017. "Sporadic Overtaking Optimality in Markov Decision Problems," Dynamic Games and Applications, Springer, vol. 7(2), pages 212-228, June.
- Adam Jonsson, 2023. "An axiomatic approach to Markov decision processes," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 97(1), pages 117-133, February.
- Francesco Bartaloni, 2021. "Existence of the Optimum in Shallow Lake Type Models with Hysteresis Effect," Journal of Optimization Theory and Applications, Springer, vol. 190(2), pages 358-392, August.
- Grüne, Lars & Semmler, Willi & Stieler, Marleen, 2015.
"Using nonlinear model predictive control for dynamic decision problems in economics,"
Journal of Economic Dynamics and Control, Elsevier, vol. 60(C), pages 112-133.
- Willi Semmler & Lars Grüne & Marleen Stieler, 2013. "Using Nonlinear Model Predictive Control for Dynamic Decision Problems in Economics," EcoMod2013 5782, EcoMod.
- Duersch, Peter & Oechssler, Jörg & Schipper, Burkhard C., 2012.
"Unbeatable imitation,"
Games and Economic Behavior, Elsevier, vol. 76(1), pages 88-96.
- Duersch, Peter & Oechssler, Joerg & Schipper, Burkhard C, 2010. "Unbeatable Imitation," MPRA Paper 20856, University Library of Munich, Germany.
- Burkhard Schipper & Peter Duersch & Joerg Oechssler, 2012. "Unbeatable Imitation," Working Papers 44, University of California, Davis, Department of Economics.
- Burkhard C. Schipper & Peter Duersch & Joerg Oechssler, 2011. "Unbeatable Imitation," Working Papers 271, University of California, Davis, Department of Economics.
- Duersch, Peter & Oechssler, Jörg & Schipper, Burkhard C., 2010. "Unbeatable Imitation," Working Papers 0499, University of Heidelberg, Department of Economics.
- Nowak, Andrzej S., 2008. "Equilibrium in a dynamic game of capital accumulation with the overtaking criterion," Economics Letters, Elsevier, vol. 99(2), pages 233-237, May.
- Rui Fang & Xiaohu Li, 2020. "A stochastic model of cyber attacks with imperfect detection," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 49(9), pages 2158-2175, May.
- Lars Grüne & Christopher M. Kellett & Steven R. Weller, 2017. "On the Relation Between Turnpike Properties for Finite and Infinite Horizon Optimal Control Problems," Journal of Optimization Theory and Applications, Springer, vol. 173(3), pages 727-745, June.
- Arie Leizarowitz, 2003. "An Algorithm to Identify and Compute Average Optimal Policies in Multichain Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 28(3), pages 553-586, August.
- Arie Leizarowitz & Alexander J. Zaslavski, 2007. "Uniqueness and Stability of Optimal Policies of Finite State Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 32(1), pages 156-167, February.
- Duersch, Peter & Oechssler, Jörg & Schipper, Burkhard C., 2012.
"Unbeatable imitation,"
Games and Economic Behavior,
Elsevier, vol. 76(1), pages 88-96.
- Duersch, Peter & Oechssler, Jörg & Schipper, Burkhard C., 2010. "Unbeatable Imitation," Working Papers 0499, University of Heidelberg, Department of Economics.
- Burkhard Schipper & Peter Duersch & Joerg Oechssler, 2012. "Unbeatable Imitation," Working Papers 125, University of California, Davis, Department of Economics.
- Burkhard C. Schipper & Peter Duersch & Joerg Oechssler, 2011. "Unbeatable Imitation," Working Papers 103, University of California, Davis, Department of Economics.
- Duersch, Peter & Oechssler, Joerg & Schipper, Burkhard C, 2010. "Unbeatable Imitation," MPRA Paper 20856, University Library of Munich, Germany.
- Vivek S. Borkar & Vladimir Gaitsgory, 2019. "Linear Programming Formulation of Long-Run Average Optimal Control Problem," Journal of Optimization Theory and Applications, Springer, vol. 181(1), pages 101-125, April.
- Alessandro Arlotto & J. Michael Steele, 2016. "A Central Limit Theorem for Temporally Nonhomogenous Markov Chains with Applications to Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 41(4), pages 1448-1468, November.
More about this item
Keywords
Markov decision process; Reachability objective; Safety objective; Overtaking optimality; Perron–Frobenius eigenvalue;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:185:y:2020:i:3:d:10.1007_s10957-020-01681-2. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.