IDEAS home Printed from https://ideas.repec.org/r/inm/ormnsc/v9y1962i1p16-24.html
   My bibliography  Save this item

On Sequential Decisions and Markov Chains

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Prasenjit Mondal, 2020. "Computing semi-stationary optimal policies for multichain semi-Markov decision processes," Annals of Operations Research, Springer, vol. 287(2), pages 843-865, April.
  2. Panagiotidou, Sofia & Tagaras, George, 2007. "Optimal preventive maintenance for equipment with two quality states and general failure time distributions," European Journal of Operational Research, Elsevier, vol. 180(1), pages 329-353, July.
  3. Michael Katehakis & Ingram Olkin & Sheldon Ross & Jian Yang, 2013. "On the life and work of Cyrus Derman," Annals of Operations Research, Springer, vol. 208(1), pages 5-26, September.
  4. David T. Abdul‐Malak & Jeffrey P. Kharoufeh & Lisa M. Maillart, 2019. "Maintaining systems with heterogeneous spare parts," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(6), pages 485-501, September.
  5. Alexander Zadorojniy & Guy Even & Adam Shwartz, 2009. "A Strongly Polynomial Algorithm for Controlled Queues," Mathematics of Operations Research, INFORMS, vol. 34(4), pages 992-1007, November.
  6. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2007. "Determining the Acceptance of Cadaveric Livers Using an Implicit Model of the Waiting List," Operations Research, INFORMS, vol. 55(1), pages 24-36, February.
  7. Matthew Sobel, 2013. "Discounting axioms imply risk neutrality," Annals of Operations Research, Springer, vol. 208(1), pages 417-432, September.
  8. Prasenjit Mondal, 2016. "On undiscounted semi-Markov decision processes with absorbing states," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(2), pages 161-177, April.
  9. Reza Ahmadi, 2014. "Optimal maintenance scheduling for a complex manufacturing system subject to deterioration," Annals of Operations Research, Springer, vol. 217(1), pages 1-29, June.
  10. Durango-Cohen, Pablo L., 2007. "A time series analysis framework for transportation infrastructure management," Transportation Research Part B: Methodological, Elsevier, vol. 41(5), pages 493-505, June.
  11. David L. Kaufman & Mark E. Lewis, 2007. "Machine maintenance with workload considerations," Naval Research Logistics (NRL), John Wiley & Sons, vol. 54(7), pages 750-766, October.
  12. Eugene A. Feinberg & Pavlo O. Kasyanov & Nina V. Zadoianchuk, 2012. "Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities," Mathematics of Operations Research, INFORMS, vol. 37(4), pages 591-607, November.
  13. K. Helmes & R. H. Stockbridge, 2000. "Numerical Comparison of Controls and Verification of Optimality for Stochastic Control Problems," Journal of Optimization Theory and Applications, Springer, vol. 106(1), pages 107-127, July.
  14. Lodewijk Kallenberg, 2013. "Derman’s book as inspiration: some results on LP for MDPs," Annals of Operations Research, Springer, vol. 208(1), pages 63-94, September.
  15. Durango-Cohen, Pablo L. & Madanat, Samer M., 2008. "Optimization of inspection and maintenance decisions for infrastructure facilities under performance model uncertainty: A quasi-Bayes approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(8), pages 1074-1085, October.
  16. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2007. "Choosing Among Living-Donor and Cadaveric Livers," Management Science, INFORMS, vol. 53(11), pages 1702-1715, November.
  17. Ali Dogramaci & Nelson M. Fraiman, 2004. "Replacement Decisions with Maintenance Under Uncertainty: An Imbedded Optimal Control Model," Operations Research, INFORMS, vol. 52(5), pages 785-794, October.
  18. Ahmadi, Reza & Newby, Martin, 2011. "Maintenance scheduling of a manufacturing system subject to deterioration," Reliability Engineering and System Safety, Elsevier, vol. 96(10), pages 1411-1420.
  19. Warren B. Powell, 2016. "Perspectives of approximate dynamic programming," Annals of Operations Research, Springer, vol. 241(1), pages 319-356, June.
  20. Panagiotidou, Sofia & Nenes, George, 2009. "An economically designed, integrated quality and maintenance model using an adaptive Shewhart chart," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 732-741.
  21. Guy Even & Alexander Zadorojniy, 2012. "Strong polynomiality of the Gass-Saaty shadow-vertex pivoting rule for controlled random walks," Annals of Operations Research, Springer, vol. 201(1), pages 159-167, December.
  22. Shanshan Guo & Lei Zhao & Xiaowei Xu, 2016. "Impact of supply risks on procurement decisions," Annals of Operations Research, Springer, vol. 241(1), pages 411-430, June.
  23. B. Curtis Eaves & Arthur F. Veinott, 2014. "Maximum-Stopping-Value Policies in Finite Markov Population Decision Chains," Mathematics of Operations Research, INFORMS, vol. 39(3), pages 597-606, August.
  24. Michael O’Sullivan & Arthur F. Veinott, Jr., 2017. "Polynomial-Time Computation of Strong and n -Present-Value Optimal Policies in Markov Decision Chains," Mathematics of Operations Research, INFORMS, vol. 42(3), pages 577-598, August.
  25. Alan P. Wood, 1988. "Optimal maintenance policies for constantly monitored systems," Naval Research Logistics (NRL), John Wiley & Sons, vol. 35(4), pages 461-471, August.
  26. Florio, Alexandre M. & Hartl, Richard F. & Minner, Stefan, 2020. "Optimal a priori tour and restocking policy for the single-vehicle routing problem with stochastic demands," European Journal of Operational Research, Elsevier, vol. 285(1), pages 172-182.
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.