Optimal policies for constrained average-cost Markov decision processes
Author
Abstract
Suggested Citation
DOI: 10.1007/s11750-009-0110-7
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Eugene A. Feinberg & Adam Shwartz, 1996. "Constrained Discounted Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 21(4), pages 922-945, November.
- Alan F. Karr, 1983. "Extreme Points of Certain Sets of Probability Measures, with Applications," Mathematics of Operations Research, INFORMS, vol. 8(1), pages 74-85, February.
- Alexander A. Yushkevich, 1997. "The Compactness of a Policy Space in Dynamic Programming Via an Extension Theorem for Carathéodory Functions," Mathematics of Operations Research, INFORMS, vol. 22(2), pages 458-467, May.
- Gerhard Winkler, 1988. "Extreme Points of Moment Sets," Mathematics of Operations Research, INFORMS, vol. 13(4), pages 581-587, November.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Kuang Xu, 2015. "Necessity of Future Information in Admission Control," Operations Research, INFORMS, vol. 63(5), pages 1213-1226, October.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Henry Lam & Clementine Mottet, 2017. "Tail Analysis Without Parametric Models: A Worst-Case Perspective," Operations Research, INFORMS, vol. 65(6), pages 1696-1711, December.
- Iosif Pinelis, 2016. "On the extreme points of moments sets," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(3), pages 325-349, June.
- Krishnamurthy Iyer & Nandyala Hemachandra, 2010. "Sensitivity analysis and optimal ultimately stationary deterministic policies in some constrained discounted cost models," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 71(3), pages 401-425, June.
- Riis, Morten & Andersen, Kim Allan, 2005. "Applying the minimax criterion in stochastic recourse programs," European Journal of Operational Research, Elsevier, vol. 165(3), pages 569-584, September.
- Bergemann, Dirk & Castro, Francisco & Weintraub, Gabriel Y., 2020.
"The scope of sequential screening with ex post participation constraints,"
Journal of Economic Theory, Elsevier, vol. 188(C).
- Dirk Bergemann & Francisco Castro & Gabriel Weintraub, 2017. "The Scope of Sequential Screening with Ex-Post Participation Constraints," Cowles Foundation Discussion Papers 2078R3, Cowles Foundation for Research in Economics, Yale University, revised Jul 2019.
- Bergemann, Dirk & Castro, Francisco & Weintraub, Gabriel, 2018. "The Scope of Sequential Screening with Ex-Post Participation Constraints," CEPR Discussion Papers 13018, C.E.P.R. Discussion Papers.
- Dirk Bergemann & Francisco Castro & Gabriel Weintraub, 2017. "The Scope of Sequential Screening with Ex-Post Participation Constraints," Cowles Foundation Discussion Papers 2078R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2018.
- Dirk Bergemann & Francisco Castro & Gabriel Weintraub, 2017. "The Scope of Sequential Screening with Ex-Post Participation Constraints," Cowles Foundation Discussion Papers 2078R4, Cowles Foundation for Research in Economics, Yale University, revised Feb 2020.
- Dirk Bergemann & Francisco Castro & Gabriel Weintraub, 2017. "The Scope of Sequential Screening with Ex-Post Participation Constraints," Cowles Foundation Discussion Papers 2078R, Cowles Foundation for Research in Economics, Yale University, revised Jun 2017.
- Dirk Bergemann & Francisco Castro & Gabriel Weintraub, 2017. "The Scope of Sequential Screening with Ex-Post Participation Constraints," Cowles Foundation Discussion Papers 2078, Cowles Foundation for Research in Economics, Yale University.
- Michael Kupper & Max Nendel & Alessandro Sgarabottolo, 2023. "Risk measures based on weak optimal transport," Papers 2312.05973, arXiv.org.
- Eugene A. Feinberg & Uriel G. Rothblum, 2012. "Splitting Randomized Stationary Policies in Total-Reward Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 37(1), pages 129-153, February.
- Erik J. Balder, 2001. "On ws-Convergence of Product Measures," Mathematics of Operations Research, INFORMS, vol. 26(3), pages 494-518, August.
- Anton Kolotilin & Roberto Corrao & Alexander Wolitzky, 2022.
"Persuasion with Non-Linear Preferences,"
Papers
2206.09164, arXiv.org, revised Aug 2022.
- Anton Kolotilin & Roberto Corrao & Alexander Wolitzky, 2023. "Persuasion with Non-Linear Preferences," Discussion Papers 2023-07, School of Economics, The University of New South Wales.
- Nandyala Hemachandra & Kamma Sri Naga Rajesh & Mohd. Abdul Qavi, 2016. "A model for equilibrium in some service-provider user-set interactions," Annals of Operations Research, Springer, vol. 243(1), pages 95-115, August.
- Vladimir Ejov & Jerzy A. Filar & Michael Haythorpe & Giang T. Nguyen, 2009. "Refined MDP-Based Branch-and-Fix Algorithm for the Hamiltonian Cycle Problem," Mathematics of Operations Research, INFORMS, vol. 34(3), pages 758-768, August.
- Ohlmann, Jeffrey W. & Bean, James C., 2009. "Resource-constrained management of heterogeneous assets with stochastic deterioration," European Journal of Operational Research, Elsevier, vol. 199(1), pages 198-208, November.
- Kasberger, Bernhard & Woodward, Kyle, 2021.
"Bidding in Multi-Unit Auctions under Limited Information,"
MPRA Paper
111185, University Library of Munich, Germany.
- Bernhard Kasberger & Kyle Woodward, 2021. "Bidding in Multi-Unit Auctions under Limited Information," Papers 2112.11320, arXiv.org, revised Apr 2023.
- Nikolay Andreev, 2019. "Robust Portfolio Optimization in an Illiquid Market in Discrete-Time," Mathematics, MDPI, vol. 7(12), pages 1-16, November.
- Kumar, Uday M & Bhat, Sanjay P. & Kavitha, Veeraruna & Hemachandra, Nandyala, 2023. "Approximate solutions to constrained risk-sensitive Markov decision processes," European Journal of Operational Research, Elsevier, vol. 310(1), pages 249-267.
- Pertaia, Giorgi & Prokhorov, Artem & Uryasev, Stan, 2022. "A new approach to credit ratings," Journal of Banking & Finance, Elsevier, vol. 140(C).
- Jorge Alvarez-Mena & Onésimo Hernández-Lerma, 2006. "Existence of nash equilibria for constrained stochastic games," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 63(2), pages 261-285, May.
- Andreas Kleiner & Benny Moldovanu & Philipp Strack & Mark Whitmeyer, 2024. "The Extreme Points of Fusions," Papers 2409.10779, arXiv.org.
- Roberto Corrao & Drew Fudenberg & David K Levine, 2023. "Adversarial forecasters, surprises and randomization," Levine's Working Paper Archive 11694000000000130, David K. Levine.
- Hernández-Lerma, Onésimo & Romera, Rosario, 2000. "Pareto optimality in multiobjective Markov control processes," DES - Working Papers. Statistics and Econometrics. WS 9865, Universidad Carlos III de Madrid. Departamento de EstadÃstica.
More about this item
Keywords
Markov decision processes; Constraints; Stable measures; 90C40;All these keywords.
JEL classification:
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:topjnl:v:19:y:2011:i:1:p:107-120. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.