Markovian Decision Processes with Uncertain Transition Probabilities

Citations

Cited by:

1. Abhijit Gosavi, 2009. "Reinforcement Learning: A Tutorial Survey and Recent Advances," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 178-192, May.
2. Zhu, Zhicheng & Xiang, Yisha & Zhao, Ming & Shi, Yue, 2023. "Data-driven remanufacturing planning with parameter uncertainty," European Journal of Operational Research, Elsevier, vol. 309(1), pages 102-116.
3. Zeynep Turgay & Fikri Karaesmen & Egemen Lerzan Örmeci, 2018. "Structural properties of a class of robust inventory and queueing control problems," Naval Research Logistics (NRL), John Wiley & Sons, vol. 65(8), pages 699-716, December.
4. Arnab Nilim & Laurent El Ghaoui, 2005. "Robust Control of Markov Decision Processes with Uncertain Transition Matrices," Operations Research, INFORMS, vol. 53(5), pages 780-798, October.
5. Andrew J. Keith & Darryl K. Ahner, 2021. "A survey of decision making and optimization under uncertainty," Annals of Operations Research, Springer, vol. 300(2), pages 319-353, May.
6. Susana Díaz-Vázquez & Emilio Torres-Manzanera & Irene Díaz & Susana Montes, 2021. "On the Search for a Measure to Compare Interval-Valued Fuzzy Sets," Mathematics, MDPI, vol. 9(24), pages 1-30, December.
7. Erick Delage & Shie Mannor, 2010. "Percentile Optimization for Markov Decision Processes with Parameter Uncertainty," Operations Research, INFORMS, vol. 58(1), pages 203-213, February.
8. Montes, Ignacio & Miranda, Enrique & Montes, Susana, 2014. "Stochastic dominance with imprecise information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 868-886.
9. Rasouli, Mohammad & Saghafian, Soroush, 2018. "Robust Partially Observable Markov Decision Processes," Working Paper Series rwp18-027, Harvard University, John F. Kennedy School of Government.
10. D. Škulj & R. Hable, 2013. "Coefficients of ergodicity for Markov chains with uncertain parameters," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(1), pages 107-133, January.
11. Garud N. Iyengar, 2005. "Robust Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 30(2), pages 257-280, May.
12. Zeynep Turgay & Fikri Karaesmen & E. Örmeci, 2015. "A dynamic inventory rationing problem with uncertain demand and production rates," Annals of Operations Research, Springer, vol. 231(1), pages 207-228, August.
13. Peter Buchholz & Dimitri Scheftelowitsch, 2019. "Computation of weighted sums of rewards for concurrent MDPs," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 89(1), pages 1-42, February.
14. Montes, Ignacio & Miranda, Enrique & Montes, Susana, 2014. "Decision making with imprecise probabilities and utilities by means of statistical preference and stochastic dominance," European Journal of Operational Research, Elsevier, vol. 234(1), pages 209-220.
15. Wolfram Wiesemann & Daniel Kuhn & Berç Rustem, 2010. "Robust Markov Decision Processes," Working Papers 034, COMISEF.
16. Xiaoting Ji & Yifeng Niu & Lincheng Shen, 2016. "Robust Satisficing Decision Making for Unmanned Aerial Vehicle Complex Missions under Severe Uncertainty," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-35, November.
17. Florence Lindsay W & Fellingham Gilbert W & Vehrs Pat R. & Mortensen Nina P., 2008. "Skill Evaluation in Women's Volleyball," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 4(2), pages 1-16, April.
18. Schapaugh, Adam W. & Tyre, Andrew J., 2013. "Accounting for parametric uncertainty in Markov decision processes," Ecological Modelling, Elsevier, vol. 254(C), pages 15-21.
19. David L. Kaufman & Andrew J. Schaefer, 2013. "Robust Modified Policy Iteration," INFORMS Journal on Computing, INFORMS, vol. 25(3), pages 396-410, August.
20. Nicholas J. J. Smith, 2023. "Acting on belief functions," Theory and Decision, Springer, vol. 95(4), pages 575-621, November.
21. Felipe Caro & Aparupa Das Gupta, 2022. "Robust control of the multi-armed bandit problem," Annals of Operations Research, Springer, vol. 317(2), pages 461-480, October.
22. Varagapriya, V & Singh, Vikas Vikram & Lisser, Abdel, 2024. "Rank-1 transition uncertainties in constrained Markov decision processes," European Journal of Operational Research, Elsevier, vol. 318(1), pages 167-178.
23. Craig Boutilier, 2005. "The Influence of Influence Diagrams on Artificial Intelligence," Decision Analysis, INFORMS, vol. 2(4), pages 229-231, December.
24. Wolfram Wiesemann & Daniel Kuhn & Berç Rustem, 2013. "Robust Markov Decision Processes," Mathematics of Operations Research, INFORMS, vol. 38(1), pages 153-183, February.
25. V Varagapriya & Vikas Vikram Singh & Abdel Lisser, 2023. "Joint chance-constrained Markov decision processes," Annals of Operations Research, Springer, vol. 322(2), pages 1013-1035, March.
26. Vogel, Justus & Cordier, Johannes & Filipovic, Miodrag, 2025. "Causal Effects and Optimal Policy Learning for Intensive Care Unit Discharge Decisions to Solve Hospital Process Bottlenecks: Approach, Methods, and First Results," Working Paper Series in Health Economics, Management and Policy 2025-01, University of St.Gallen, School of Medicine, Chair of Health Economics, Policy and Management.
27. Hyeong Chang, 2006. "Perfect information two-person zero-sum markov games with imprecise transition probabilities," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 64(2), pages 335-351, October.
28. Erim Kardeş & Fernando Ordóñez & Randolph W. Hall, 2011. "Discounted Robust Stochastic Games and an Application to Queueing Control," Operations Research, INFORMS, vol. 59(2), pages 365-382, April.
29. Blanc, J.P.C. & den Hertog, D., 2008. "On Markov Chains with Uncertain Data," Discussion Paper 2008-50, Tilburg University, Center for Economic Research.
    • Blanc, J.P.C. & den Hertog, D., 2008. "On Markov Chains with Uncertain Data," Other publications TiSEM b44dfb0a-1676-4ce3-8d16-f, Tilburg University, School of Economics and Management.
30. Salah eddine Semati & Abdelkader Gasmi, 2023. "Markov interval chain (MIC) for solving a decision problem," OPSEARCH, Springer;Operational Research Society of India, vol. 60(2), pages 802-811, June.
31. M. Reza Skandari & Steven M. Shechter, 2021. "Patient-Type Bayes-Adaptive Treatment Plans," Operations Research, INFORMS, vol. 69(2), pages 574-598, March.