IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/75fc9.html
   My bibliography  Save this paper

Robust Bellman State Prediction with Learning and Model Preferences

Author

Listed:
  • Estey, Clayton

Abstract

I contribute to stochastic modeling methodology in a theoretical framework spanning core decisions in the model's lifetime. These are predicting an out-of-sample unit's latent state even from non-series data, deciding when to start and stop learning about the state variable, and choosing models from important trade-offs. States evolve from linear dynamics with time-varying predictors and coefficients (drift) and generalized continuous noise (diffusion). Coefficients must address misprediction costs, data complexity, and distributional uncertainty (ambiguity) about the state's diffusion and stopping time. I exactly solve a stochastic dynamic program robust to worst-case costs from both uncertainties. The Bellman optimal coefficients extend generalized ridge regression by out-of-sample components impacting value changes given state changes. Performance issues trigger sequential analysis whether learning alternative models, given the effort, is better than keeping baseline. Learning is method-general and stops in fewest average attempts within decision errors. I derive preference functions for comparing models with state and cost-change constraints to decide a model, joint-time state and value distributions, and other properties beneficial to modelers.

Suggested Citation

  • Estey, Clayton, 2024. "Robust Bellman State Prediction with Learning and Model Preferences," OSF Preprints 75fc9, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:75fc9
    DOI: 10.31219/osf.io/75fc9
    as

    Download full text from publisher

    File URL: https://osf.io/download/66188e4fbba39a4371729f71/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/75fc9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yang Shen & Jianxi Su, 2019. "Life-Cycle Planning with Ambiguous Economics and Mortality Risks," North American Actuarial Journal, Taylor & Francis Journals, vol. 23(4), pages 598-625, October.
    2. Branger, Nicole & Larsen, Linda Sandris & Munk, Claus, 2013. "Robust portfolio choice with ambiguity and learning about return predictability," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1397-1411.
    3. Christoph Bühren & Fabian Meier & Marco Pleßner, 2023. "Ambiguity aversion: bibliometric analysis and literature review of the last 60 years," Management Review Quarterly, Springer, vol. 73(2), pages 495-525, June.
    4. Maenhout, Pascal J., 2006. "Robust portfolio rules and detection-error probabilities for a mean-reverting risk premium," Journal of Economic Theory, Elsevier, vol. 128(1), pages 136-163, May.
    5. Bandi, Federico M. & Phillips, Peter C.B., 2007. "A simple approach to the parametric estimation of potentially nonstationary diffusions," Journal of Econometrics, Elsevier, vol. 137(2), pages 354-395, April.
    6. Lars Peter Hansen & Thomas J Sargent, 2014. "A Quartet of Semigroups for Model Specification, Robustness, Prices of Risk, and Model Detection," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 4, pages 83-143, World Scientific Publishing Co. Pte. Ltd..
    7. Peter Klibanoff & Massimo Marinacci & Sujoy Mukerji, 2005. "A Smooth Model of Decision Making under Ambiguity," Econometrica, Econometric Society, vol. 73(6), pages 1849-1892, November.
    8. Li, Xiaoou & Chen, Yunxiao & Chen, Xi & Liu, Jingchen & Ying, Zhiliang, 2021. "Optimal stopping and worker selection in crowdsourcing: an adaptive sequential probability ratio test framework," LSE Research Online Documents on Economics 100873, London School of Economics and Political Science, LSE Library.
    9. Jie Ding & Vahid Tarokh & Yuhong Yang, 2018. "Model Selection Techniques -- An Overview," Papers 1810.09583, arXiv.org.
    10. Bowen Gang & Wenguang Sun & Weinan Wang, 2023. "Structure–Adaptive Sequential Testing for Online False Discovery Rate Control," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 732-745, January.
    11. Adam N. Elmachtoub & Paul Grigas, 2022. "Smart “Predict, then Optimize”," Management Science, INFORMS, vol. 68(1), pages 9-26, January.
    12. Aurélien Baillon & Zhenxing Huang & Asli Selim & Peter P. Wakker, 2018. "Measuring Ambiguity Attitudes for All (Natural) Events," Econometrica, Econometric Society, vol. 86(5), pages 1839-1858, September.
    13. Cosmin L. Ilut & Martin Schneider, 2022. "Modeling Uncertainty as Ambiguity: a Review," NBER Working Papers 29915, National Bureau of Economic Research, Inc.
    14. Andrew J. Keith & Darryl K. Ahner, 2021. "A survey of decision making and optimization under uncertainty," Annals of Operations Research, Springer, vol. 300(2), pages 319-353, May.
    15. Wiqvist, Samuel & Golightly, Andrew & McLean, Ashleigh T. & Picchini, Umberto, 2021. "Efficient inference for stochastic differential equation mixed-effects models using correlated particle pseudo-marginal algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    16. M. Ferreira & D. Pinheiro & S. Pinheiro, 2023. "Optimal consumption, investment and life insurance selection under robust utilities," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 10(03), pages 1-28, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meyer, Steffen & Uhr, Charline, 2024. "Ambiguity and private investors’ behavior after forced fund liquidations," Journal of Financial Economics, Elsevier, vol. 156(C).
    2. Horváth, Ferenc, 2017. "Essays on robust asset pricing," Other publications TiSEM e54d7b33-1f27-4b0e-9f84-f, Tilburg University, School of Economics and Management.
    3. Branger, Nicole & Larsen, Linda Sandris, 2013. "Robust portfolio choice with uncertainty about jump and diffusion risk," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5036-5047.
    4. Rubtsov, Alexey, 2016. "Model misspecification and pricing of illiquid claims," Finance Research Letters, Elsevier, vol. 18(C), pages 242-249.
    5. Wujun Lv & Tao Pang & Xiaobao Xia & Jingzhou Yan, 2023. "Dynamic portfolio choice with uncertain rare-events risk in stock and cryptocurrency markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-28, December.
    6. Guan, Guohui & Hu, Jiaqi & Liang, Zongxia, 2022. "Robust equilibrium strategies in a defined benefit pension plan game," Insurance: Mathematics and Economics, Elsevier, vol. 106(C), pages 193-217.
    7. Bo Yi & Frederi Viens & Baron Law & Zhongfei Li, 2015. "Dynamic portfolio selection with mispricing and model ambiguity," Annals of Finance, Springer, vol. 11(1), pages 37-75, February.
    8. Chen, Zhiping & Yang, Peng, 2020. "Robust optimal reinsurance–investment strategy with price jumps and correlated claims," Insurance: Mathematics and Economics, Elsevier, vol. 92(C), pages 27-46.
    9. Claus Munk & Alexey Rubtsov, 2014. "Portfolio management with stochastic interest rates and inflation ambiguity," Annals of Finance, Springer, vol. 10(3), pages 419-455, August.
    10. Haijun Wang & L. Steven Hou, 2015. "Robust Consumption and Portfolio Choice with Habit Formation, the Spirit of Capitalism and Recursive Utility," Annals of Economics and Finance, Society for AEF, vol. 16(2), pages 393-416, November.
    11. Yan, Jingzhou & Mu, Congming & Yan, Qianhui & Luo, Deqing, 2023. "Robust leverage choice of hedge funds with rare disasters," Finance Research Letters, Elsevier, vol. 54(C).
    12. Aït-Sahalia, Yacine & Matthys, Felix, 2019. "Robust consumption and portfolio policies when asset prices can jump," Journal of Economic Theory, Elsevier, vol. 179(C), pages 1-56.
    13. Christian Flor & Linda Larsen, 2014. "Robust portfolio choice with stochastic interest rates," Annals of Finance, Springer, vol. 10(2), pages 243-265, May.
    14. Congming Mu & Jingzhou Yan & Jinqiang Yang, 2023. "Robust risk choice under high-water mark contract," Review of Quantitative Finance and Accounting, Springer, vol. 61(1), pages 295-322, July.
    15. Wang, Haijun, 2017. "Robust asset pricing with stochastic hyperbolic discounting," Finance Research Letters, Elsevier, vol. 21(C), pages 178-185.
    16. Escobar, Marcos & Ferrando, Sebastian & Rubtsov, Alexey, 2015. "Robust portfolio choice with derivative trading under stochastic volatility," Journal of Banking & Finance, Elsevier, vol. 61(C), pages 142-157.
    17. Zhang, Jinqing & Jin, Zeyu & An, Yunbi, 2017. "Dynamic portfolio optimization with ambiguity aversion," Journal of Banking & Finance, Elsevier, vol. 79(C), pages 95-109.
    18. Xing Jin & Dan Luo & Xudong Zeng, 2021. "Tail Risk and Robust Portfolio Decisions," Management Science, INFORMS, vol. 67(5), pages 3254-3275, May.
    19. Stan Olijslagers & Sweder Wijnbergen, 2024. "Discounting the Future: On Climate Change, Ambiguity Aversion and Epstein–Zin Preferences," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 87(3), pages 683-730, March.
    20. Cosmin L. Ilut & Martin Schneider, 2022. "Modeling Uncertainty as Ambiguity: a Review," NBER Working Papers 29915, National Bureau of Economic Research, Inc.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:75fc9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.