IDEAS home Printed from https://ideas.repec.org/p/uts/rpaper/421.html
   My bibliography  Save this paper

On Approximate Solutions for Partially Observable Decision Problems

Author

Listed:
  • Juri Hinz

    (University of Technology Sydney)

Abstract

Decision problems under partial observation serve a rich framework for planning and control of operations in diverse applications. In this area, approximate point-based algorithms have emerged improving the scalability of existing numerical schemes to a key level where they can be broadly used in robotics. We elaborate on some core principles of point-based methods and present an approximate solution technique which utilizes linear state dynamics and convexity.

Suggested Citation

  • Juri Hinz, 2021. "On Approximate Solutions for Partially Observable Decision Problems," Research Paper Series 421, Quantitative Finance Research Centre, University of Technology, Sydney.
    • Handle: RePEc:uts:rpaper:421
    as

    Download full text from publisher

    File URL: https://www.uts.edu.au/sites/default/files/article/downloads/rp421.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    2. William S. Lovejoy, 1991. "Computationally Feasible Bounds for Partially Observed Markov Decision Processes," Operations Research, INFORMS, vol. 39(1), pages 162-175, February.
    3. Juri Hinz & Tanya Tarnopolskaya & Jeremy Yee, 2020. "Efficient algorithms of pathwise dynamic programming for decision optimization in mining operations," Annals of Operations Research, Springer, vol. 286(1), pages 583-615, March.
    4. Juri Hinz & Nicholas Yap, 2015. "Algorithms for Optimal Control of Stochastic Switching Systems," Research Paper Series 352, Quantitative Finance Research Centre, University of Technology, Sydney.
    5. Richard D. Smallwood & Edward J. Sondik, 1973. "The Optimal Control of Partially Observable Markov Processes over a Finite Horizon," Operations Research, INFORMS, vol. 21(5), pages 1071-1088, October.
    6. Burhaneddin Sandıkçı & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2013. "Alleviating the Patient's Price of Privacy Through a Partially Observable Waiting List," Management Science, INFORMS, vol. 59(8), pages 1836-1854, August.
    7. Brennan, Michael J & Schwartz, Eduardo S, 1985. "Evaluating Natural Resource Investments," The Journal of Business, University of Chicago Press, vol. 58(2), pages 135-157, April.
    8. George E. Monahan, 1982. "State of the Art---A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms," Management Science, INFORMS, vol. 28(1), pages 1-16, January.
    9. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juri Hinz & Tanya Tarnopolskaya & Jeremy Yee, 2020. "Efficient algorithms of pathwise dynamic programming for decision optimization in mining operations," Annals of Operations Research, Springer, vol. 286(1), pages 583-615, March.
    2. Sebastian Maier, 2021. "Re-evaluating natural resource investments under uncertainty: An alternative to limited traditional approaches," Annals of Operations Research, Springer, vol. 299(1), pages 907-937, April.
    3. Abdullah Almansour & Margaret Insley, 2016. "The Impact of Stochastic Extraction Cost on the Value of an Exhaustible Resource: An Application to the Alberta Oil Sands," The Energy Journal, , vol. 37(2), pages 61-88, April.
    4. Augusto Castillo, 2004. "Firm and Corporate Bond Valuation: A Simulation Dynamic Programming Approach," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 41(124), pages 345-360.
    5. Seiji Harikae & James S. Dyer & Tianyang Wang, 2021. "Valuing Real Options in the Volatile Real World," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 171-189, January.
    6. Schwartz, Eduardo S., 2002. "Patents and R& D as Real Options," University of California at Los Angeles, Anderson Graduate School of Management qt86b1n43k, Anderson Graduate School of Management, UCLA.
    7. Luis M. Abadie & José M. Chamorro, 2009. "Monte Carlo valuation of natural gas investments," Review of Financial Economics, John Wiley & Sons, vol. 18(1), pages 10-22, January.
    8. Lim, Terence & Lo, Andrew W. & Merton, Robert C. & Scholes, Myron S., 2006. "The Derivatives Sourcebook," Foundations and Trends(R) in Finance, now publishers, vol. 1(5–6), pages 365-572, April.
    9. Max F. Schöne & Stefan Spinler, 2017. "A four-factor stochastic volatility model of commodity prices," Review of Derivatives Research, Springer, vol. 20(2), pages 135-165, July.
    10. Chiel van Oosterom & Lisa M. Maillart & Jeffrey P. Kharoufeh, 2017. "Optimal maintenance policies for a safety‐critical system and its deteriorating sensor," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(5), pages 399-417, August.
    11. Hao Zhang, 2010. "Partially Observable Markov Decision Processes: A Geometric Technique and Analysis," Operations Research, INFORMS, vol. 58(1), pages 214-228, February.
    12. Garcia Fronti, Javier, 2015. "Modelo estocástico para la valuación de una inversión nanomédica [Nanomedical Stochastic Investment Valuation]," MPRA Paper 63948, University Library of Munich, Germany.
    13. Jain, Shashi & Roelofs, Ferry & Oosterlee, Cornelis W., 2013. "Valuing modular nuclear power plants in finite time decision horizon," Energy Economics, Elsevier, vol. 36(C), pages 625-636.
    14. Armstrong, Margaret & Langrené, Nicolas & Petter, Renato & Chen, Wen & Petter, Carlos, 2019. "Accounting for tailings dam failures in the valuation of mining projects," Resources Policy, Elsevier, vol. 63(C), pages 1-1.
    15. Gamba, Andrea & Tesser, Matteo, 2009. "Structural estimation of real options models," Journal of Economic Dynamics and Control, Elsevier, vol. 33(4), pages 798-816, April.
    16. Dimitrakopoulos, Roussos G. & Abdel Sabour, Sabry A., 2007. "Evaluating mine plans under uncertainty: Can the real options make a difference?," Resources Policy, Elsevier, vol. 32(3), pages 116-125, September.
    17. Schachter, J.A. & Mancarella, P., 2016. "A critical review of Real Options thinking for valuing investment flexibility in Smart Grids and low carbon energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 261-271.
    18. Zhu, Lei & Zhang, ZhongXiang & Fan, Ying, 2015. "Overseas oil investment projects under uncertainty: How to make informed decisions?," Journal of Policy Modeling, Elsevier, vol. 37(5), pages 742-762.
    19. Andrianos E. Tsekrekos & Mark B. Shackleton & Rafał Wojakowski, 2012. "Evaluating Natural Resource Investments under Different Model Dynamics: Managerial Insights," European Financial Management, European Financial Management Association, vol. 18(4), pages 543-575, September.
    20. Zhao, Xiaoli & Yao, Jin & Sun, Chuyu & Pan, Wengeng, 2019. "Impacts of carbon tax and tradable permits on wind power investment in China," Renewable Energy, Elsevier, vol. 135(C), pages 1386-1399.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uts:rpaper:421. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Duncan Ford (email available below). General contact details of provider: https://edirc.repec.org/data/qfutsau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.