Constrained continuous-time Markov decision processes with average criteria
Author
Abstract
Suggested Citation
DOI: 10.1007/s00186-007-0154-0
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Jorge Alvarez-Mena & Onésimo Hernández-Lerma, 2002. "Convergence of the optimal values of constrained Markov control processes," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 55(3), pages 461-484, June.
- Masayuki Horiguchi, 2001. "Markov decision processes with a stopping time constraint," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 53(2), pages 279-295, June.
- Eugene A. Feinberg, 2000. "Constrained Discounted Markov Decision Processes and Hamiltonian Cycles," Mathematics of Operations Research, INFORMS, vol. 25(1), pages 130-140, February.
- Yasemin Serin & Vidyadhar Kulkarni, 2005. "Markov decision processes under observability constraints," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 61(2), pages 311-328, June.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Yonghui Huang & Qingda Wei & Xianping Guo, 2013. "Constrained Markov decision processes with first passage criteria," Annals of Operations Research, Springer, vol. 206(1), pages 197-219, July.
- Guo, Xianping & Ye, Liuer & Yin, George, 2012. "A mean–variance optimization problem for discounted Markov decision processes," European Journal of Operational Research, Elsevier, vol. 220(2), pages 423-429.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Guo, Xianping & Zhang, Wenzhao, 2014. "Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints," European Journal of Operational Research, Elsevier, vol. 238(2), pages 486-496.
- Eugene A. Feinberg & Uriel G. Rothblum, 2012. "Splitting Randomized Stationary Policies in Total-Reward Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 37(1), pages 129-153, February.
- Lauren B. Davis & Thom J. Hodgson & Russell E. King & Wenbin Wei, 2009. "Technical note: A computationally efficient algorithm for undiscounted Markov decision processes with restricted observations," Naval Research Logistics (NRL), John Wiley & Sons, vol. 56(1), pages 86-92, February.
- Vladimir Ejov & Jerzy A. Filar & Michael Haythorpe & Giang T. Nguyen, 2009. "Refined MDP-Based Branch-and-Fix Algorithm for the Hamiltonian Cycle Problem," Mathematics of Operations Research, INFORMS, vol. 34(3), pages 758-768, August.
- Ali Eshragh & Jerzy Filar & Michael Haythorpe, 2011. "A hybrid simulation-optimization algorithm for the Hamiltonian cycle problem," Annals of Operations Research, Springer, vol. 189(1), pages 103-125, September.
- Vivek Borkar & Jerzy Filar, 2013. "Markov chains, Hamiltonian cycles and volumes of convex bodies," Journal of Global Optimization, Springer, vol. 55(3), pages 633-639, March.
- Ali Eshragh & Jerzy Filar, 2011. "Hamiltonian Cycles, Random Walks, and Discounted Occupational Measures," Mathematics of Operations Research, INFORMS, vol. 36(2), pages 258-270, May.
- Yonghui Huang & Qingda Wei & Xianping Guo, 2013. "Constrained Markov decision processes with first passage criteria," Annals of Operations Research, Springer, vol. 206(1), pages 197-219, July.
- Ali Eshragh & Jerzy A. Filar & Thomas Kalinowski & Sogol Mohammadian, 2020. "Hamiltonian Cycles and Subsets of Discounted Occupational Measures," Mathematics of Operations Research, INFORMS, vol. 45(2), pages 713-731, May.
- Vladimir Ejov & Jerzy A. Filar & Minh-Tuan Nguyen, 2004. "Hamiltonian Cycles and Singularly Perturbed Markov Chains," Mathematics of Operations Research, INFORMS, vol. 29(1), pages 114-131, February.
- Nelly Litvak & Vladimir Ejov, 2009. "Markov Chains and Optimality of the Hamiltonian Cycle," Mathematics of Operations Research, INFORMS, vol. 34(1), pages 71-82, February.
- Konstantin Avrachenkov & Ali Eshragh & Jerzy A. Filar, 2016. "On transition matrices of Markov chains corresponding to Hamiltonian cycles," Annals of Operations Research, Springer, vol. 243(1), pages 19-35, August.
- Wenzhao Zhang, 2019. "Discrete-Time Constrained Average Stochastic Games with Independent State Processes," Mathematics, MDPI, vol. 7(11), pages 1-18, November.
- G. Dorini & F. Pierro & D. Savic & A. Piunovskiy, 2007. "Neighbourhood Search for constructing Pareto sets," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 65(2), pages 315-337, April.
- Héctor Jasso-Fuentes & Tomás Prieto-Rumeau, 2024. "Constrained Markov Decision Processes with Non-constant Discount Factor," Journal of Optimization Theory and Applications, Springer, vol. 202(2), pages 897-931, August.
- Richard Chen & Eugene Feinberg, 2010. "Compactness of the space of non-randomized policies in countable-state sequential decision processes," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 71(2), pages 307-323, April.
- Christopher W. Miller, 2016. "A Duality Result for Robust Optimization with Expectation Constraints," Papers 1610.01227, arXiv.org.
More about this item
Keywords
Continuous-time Markov decision process; Unbounded reward/cost and transition rates; Average criteria; Constrained-optimal policy; 90C40; 93E20;All these keywords.
JEL classification:
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:67:y:2008:i:2:p:323-340. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.