First-order sensitivity of the optimal value in a Markov decision model with respect to deviations in the transition probability function
Author
Abstract
Suggested Citation
DOI: 10.1007/s00186-020-00706-w
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Alfred Müller, 1997. "How Does the Value Function of a Markov Decision Process Depend on the Transition Probabilities?," Mathematics of Operations Research, INFORMS, vol. 22(4), pages 872-885, November.
- Rüdiger Kiesel & Robin Rühlicke & Gerhard Stahl & Jinsong Zheng, 2016. "The Wasserstein Metric and Robustness in Risk Management," Risks, MDPI, vol. 4(3), pages 1-14, August.
- Krätschmer, Volker & Schied, Alexander & Zähle, Henryk, 2017. "Domains of weak continuity of statistical functionals with a view toward robust statistics," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 1-19.
- Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
- Krätschmer, Volker & Schied, Alexander & Zähle, Henryk, 2012. "Qualitative and infinitesimal robustness of tail-dependent statistical functionals," Journal of Multivariate Analysis, Elsevier, vol. 103(1), pages 35-47, January.
- K. Hinderer, 2005. "Lipschitz Continuity of Value Functions in Markovian Decision Processes," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 62(1), pages 3-22, September.
- Bellini, Fabio & Klar, Bernhard & Müller, Alfred & Rosazza Gianin, Emanuela, 2014. "Generalized quantiles as risk measures," Insurance: Mathematics and Economics, Elsevier, vol. 54(C), pages 41-48.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Henryk Zähle, 2022. "A concept of copula robustness and its applications in quantitative risk management," Finance and Stochastics, Springer, vol. 26(4), pages 825-875, October.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Jayakumar Subramanian & Amit Sinha & Aditya Mahajan, 2023. "Robustness and Sample Complexity of Model-Based MARL for General-Sum Markov Games," Dynamic Games and Applications, Springer, vol. 13(1), pages 56-88, March.
- Henryk Zähle, 2022. "A concept of copula robustness and its applications in quantitative risk management," Finance and Stochastics, Springer, vol. 26(4), pages 825-875, October.
- Jan Obloj & Johannes Wiesel, 2018. "Robust estimation of superhedging prices," Papers 1807.04211, arXiv.org, revised Apr 2020.
- Marcelo Brutti Righi, 2018. "A theory for combinations of risk measures," Papers 1807.01977, arXiv.org, revised May 2023.
- Jiang, Jie & Peng, Shen, 2024. "Mathematical programs with distributionally robust chance constraints: Statistical robustness, discretization and reformulation," European Journal of Operational Research, Elsevier, vol. 313(2), pages 616-627.
- James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
- Krätschmer Volker & Schied Alexander & Zähle Henryk, 2015. "Quasi-Hadamard differentiability of general risk functionals and its application," Statistics & Risk Modeling, De Gruyter, vol. 32(1), pages 25-47, April.
- Tobias Fissler & Hajo Holzmann, 2022. "Measurability of functionals and of ideal point forecasts," Papers 2203.08635, arXiv.org.
- Sainan Zhang & Huifu Xu, 2022. "Insurance premium-based shortfall risk measure induced by cumulative prospect theory," Computational Management Science, Springer, vol. 19(4), pages 703-738, October.
- Anne Lavigne, 2006.
"Gouvernance et investissement des fonds de pension privés aux Etats-Unis,"
Working Papers
halshs-00081401, HAL.
- Anne LAVIGNE, 2006. "Gouvernance et investissement des fonds de pension privés aux Etats-Unis," LEO Working Papers / DR LEO 690, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
- An Chen & Thai Nguyen & Thorsten Sehner, 2022. "Unit-Linked Tontine: Utility-Based Design, Pricing and Performance," Risks, MDPI, vol. 10(4), pages 1-27, April.
- Alan J. Auerbach, 1981. "Evaluating the Taxation of Risky Assets," NBER Working Papers 0806, National Bureau of Economic Research, Inc.
- Hong, Claire Yurong & Lu, Xiaomeng & Pan, Jun, 2021. "FinTech adoption and household risk-taking," BOFIT Discussion Papers 14/2021, Bank of Finland Institute for Emerging Economies (BOFIT).
- Curatola, Giuliano, 2022. "Price impact, strategic interaction and portfolio choice," The North American Journal of Economics and Finance, Elsevier, vol. 59(C).
- Auffret, Philippe, 2001. "An alternative unifying measure of welfare gains from risk-sharing," Policy Research Working Paper Series 2676, The World Bank.
- Taoufik Bouezmarni & Mohamed Doukali & Abderrahim Taamouti, 2024.
"Testing Granger non-causality in expectiles,"
Econometric Reviews, Taylor & Francis Journals, vol. 43(1), pages 30-51, January.
- Taoufik Bouezmarni & Mohamed Doukali & Abderrahim Taamouti, 2022. "Testing Granger Non-Causality in Expectiles," Working Papers 202207, University of Liverpool, Department of Economics.
- Taoufik Bouezmarni & Mohamed Doukali & Abderrahim Taamouti, 2023. "Testing Granger Non-Causality in Expectiles," University of East Anglia School of Economics Working Paper Series 2023-02, School of Economics, University of East Anglia, Norwich, UK..
- Luca De Gennaro Aquino & Sascha Desmettre & Yevhen Havrylenko & Mogens Steffensen, 2024. "Equilibrium control theory for Kihlstrom-Mirman preferences in continuous time," Papers 2407.16525, arXiv.org, revised Oct 2024.
- Chen, An & Hieber, Peter & Sureth, Caren, 2022. "Pay for tax certainty? Advance tax rulings for risky investment under multi-dimensional tax uncertainty," arqus Discussion Papers in Quantitative Tax Research 273, arqus - Arbeitskreis Quantitative Steuerlehre.
- Mayank Goel & Suresh Kumar K., 2006. "A Risk-Sensitive Portfolio Optimisation Problem with Stochastic Interest Rate," Journal of Emerging Market Finance, Institute for Financial Management and Research, vol. 5(3), pages 263-282, December.
- Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2020.
"Heterogeneity and Persistence in Returns to Wealth,"
Econometrica, Econometric Society, vol. 88(1), pages 115-170, January.
- Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2016. "Heterogeneity and Persistence in Returns to Wealth," EIEF Working Papers Series 1615, Einaudi Institute for Economics and Finance (EIEF), revised Nov 2016.
- Andreas Fagereng & Luigi Guiso & Luigi Pistaferri & Davide Malacrino, 2019. "Heterogeneity and persistence in returns to wealth," Discussion Papers 912, Statistics Norway, Research Department.
- Andreas Fagereng & Luigi Guiso & Mr. Davide Malacrino & Luigi Pistaferri, 2018. "Heterogeneity and Persistence in Returns to Wealth," IMF Working Papers 2018/171, International Monetary Fund.
- Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2018. "Heterogeneity and Persistence in Returns to Wealth," CESifo Working Paper Series 7107, CESifo.
- Guiso, Luigi & Pistaferri, Luigi & Fagereng, Andreas & Malacrino, Davide, 2016. "Heterogeneity and Persistence in Returns to Wealth," CEPR Discussion Papers 11635, C.E.P.R. Discussion Papers.
- Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2016. "Heterogeneity and Persistence in Returns to Wealth," NBER Working Papers 22822, National Bureau of Economic Research, Inc.
More about this item
Keywords
Markov decision model; Model reduction; Transition probability function; Optimal value; Functional differentiability; Financial optimization;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:92:y:2020:i:1:d:10.1007_s00186-020-00706-w. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.