IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1411.0849.html
   My bibliography  Save this paper

Exact and Approximate Hidden Markov Chain Filters Based on Discrete Observations

Author

Listed:
  • Nicole Bauerle
  • Igor Gilitschenski
  • Uwe D. Hanebeck

Abstract

We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain. The recursion formula for the discrete-time filter is easy to derive, however involves densities which are very hard to obtain. In this paper we derive exact formulas for the necessary densities in the case the state space of the HMM consists of two elements only. This is done by relating the underlying integrated continuous-time Markov chain to the so-called asymmetric telegraph process and by using recent results on this process. In case the state space consists of more than two elements we present three different ways to approximate the densities for the filter. The first approach is based on the continuous filter problem. The second approach is to derive a PDE for the densities and solve it numerically and the third approach is a crude discrete time approximation of the Markov chain. All three approaches are compared in a numerical study.

Suggested Citation

  • Nicole Bauerle & Igor Gilitschenski & Uwe D. Hanebeck, 2014. "Exact and Approximate Hidden Markov Chain Filters Based on Discrete Observations," Papers 1411.0849, arXiv.org, revised Dec 2014.
    • Handle: RePEc:arx:papers:1411.0849
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1411.0849
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Iacus, Stefano Maria, 2001. "Statistical analysis of the inhomogeneous telegrapher's process," Statistics & Probability Letters, Elsevier, vol. 55(1), pages 83-88, November.
    2. Stefano Iacus & Nakahiro Yoshida, 2006. "Estimation for the discretely observed telegraph process," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1045, Universitá degli Studi di Milano.
    3. Rüdiger Frey & Abdelali Gabih & Ralf Wunderlich, 2012. "Portfolio Optimization Under Partial Information With Expert Opinions," World Scientific Book Chapters, in: Matheus R Grasselli & Lane P Hughston (ed.), Finance at Fields, chapter 11, pages 265-282, World Scientific Publishing Co. Pte. Ltd..
    4. Bayraktar, Erhan & Ludkovski, Michael, 2009. "Sequential tracking of a hidden Markov chain using point process observations," Stochastic Processes and their Applications, Elsevier, vol. 119(6), pages 1792-1822, June.
    5. Robert J. Elliott & Vikram Krishnamurthy & Jörn Sass, 2008. "Moment based regression algorithms for drift and volatility estimation in continuous-time Markov switching models," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 244-270, July.
    6. Markus Hahn & Sylvia Frühwirth-Schnatter & Jörn Sass, 2010. "Markov Chain Monte Carlo Methods for Parameter Estimation in Multidimensional Continuous Time Markov Switching Models," Journal of Financial Econometrics, Oxford University Press, vol. 8(1), pages 88-121, Winter.
    7. Tobias Rydén & Timo Teräsvirta & Stefan Åsbrink, 1998. "Stylized facts of daily return series and the hidden Markov model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(3), pages 217-244.
    8. Jörn Sass & Ralf Wunderlich, 2010. "Optimal portfolio policies under bounded expected loss and partial information," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 72(1), pages 25-61, August.
    9. Jörn Sass & Ulrich Haussmann, 2004. "Optimizing the terminal wealth under partial information: The drift process as a continuous time Markov chain," Finance and Stochastics, Springer, vol. 8(4), pages 553-577, November.
    10. Rüdiger Frey & Abdelali Gabih & Ralf Wunderlich, 2012. "Portfolio Optimization Under Partial Information With Expert Opinions," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 15(01), pages 1-18.
    11. Stefano Iacus, 2001. "Statistical analysis of the inhomogeneous telegrapher's process," Departmental Working Papers 2001-02, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    12. Edoardo Otranto & Giampiero Gallo, 2002. "A Nonparametric Bayesian Approach To Detect The Number Of Regimes In Markov Switching Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 477-496.
    13. Eckhard Platen & Renata Rendek, 2009. "Quasi-exact Approximation of Hidden Markov Chain Filters," Research Paper Series 258, Quantitative Finance Research Centre, University of Technology, Sydney.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bäuerle Nicole & Gilitschenski Igor & Hanebeck Uwe, 2015. "Exact and approximate hidden Markov chain filters based on discrete observations," Statistics & Risk Modeling, De Gruyter, vol. 32(3-4), pages 159-176, December.
    2. Krishnamurthy, Vikram & Leoff, Elisabeth & Sass, Jörn, 2018. "Filterbased stochastic volatility in continuous-time hidden Markov models," Econometrics and Statistics, Elsevier, vol. 6(C), pages 1-21.
    3. Elisabeth Leoff & Leonie Ruderer & Jörn Sass, 2022. "Signal-to-noise matrix and model reduction in continuous-time hidden Markov models," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 95(2), pages 327-359, April.
    4. Rudiger Frey & Abdelali Gabih & Ralf Wunderlich, 2013. "Portfolio Optimization under Partial Information with Expert Opinions: a Dynamic Programming Approach," Papers 1303.2513, arXiv.org, revised Feb 2014.
    5. Kristoffer Lindensjö, 2016. "Optimal investment and consumption under partial information," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(1), pages 87-107, February.
    6. Vikram Krishnamurthy & Elisabeth Leoff & Jorn Sass, 2016. "Filterbased Stochastic Volatility in Continuous-Time Hidden Markov Models," Papers 1602.05323, arXiv.org.
    7. Kristoffer Lindensjö, 2016. "Optimal investment and consumption under partial information," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(1), pages 87-107, February.
    8. Abdelali Gabih & Hakam Kondakji & Jorn Sass & Ralf Wunderlich, 2014. "Expert Opinions and Logarithmic Utility Maximization in a Market with Gaussian Drift," Papers 1402.6313, arXiv.org.
    9. Christoph Knochenhauer & Alexander Merkel & Yufei Zhang, 2024. "Optimal Investment with Costly Expert Opinions," Papers 2409.11569, arXiv.org.
    10. Szölgyenyi Michaela, 2015. "Dividend maximization in a hidden Markov switching model," Statistics & Risk Modeling, De Gruyter, vol. 32(3-4), pages 143-158, December.
    11. Katia Colaneri & Stefano Herzel & Marco Nicolosi, 2021. "The value of knowing the market price of risk," Annals of Operations Research, Springer, vol. 299(1), pages 101-131, April.
    12. Jörn Sass & Dorothee Westphal & Ralf Wunderlich, 2017. "Expert Opinions And Logarithmic Utility Maximization For Multivariate Stock Returns With Gaussian Drift," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 20(04), pages 1-41, June.
    13. Abdelali Gabih & Hakam Kondakji & Ralf Wunderlich, 2018. "Asymptotic Filter Behavior for High-Frequency Expert Opinions in a Market with Gaussian Drift," Papers 1812.03453, arXiv.org, revised Mar 2020.
    14. Jorn Sass & Dorothee Westphal & Ralf Wunderlich, 2016. "Expert Opinions and Logarithmic Utility Maximization for Multivariate Stock Returns with Gaussian Drift," Papers 1601.08155, arXiv.org, revised Mar 2016.
    15. Zongxia Liang & Qi Ye, 2024. "Optimal information acquisition for eliminating estimation risk," Papers 2405.09339, arXiv.org.
    16. Ali Al-Aradi & Sebastian Jaimungal, 2019. "Active and Passive Portfolio Management with Latent Factors," Papers 1903.06928, arXiv.org.
    17. Abdelali Gabih & Hakam Kondakji & Ralf Wunderlich, 2023. "Power Utility Maximization with Expert Opinions at Fixed Arrival Times in a Market with Hidden Gaussian Drift," Papers 2301.06847, arXiv.org, revised Jun 2024.
    18. Abdelali Gabih & Hakam Kondakji & Ralf Wunderlich, 2022. "Well Posedness of Utility Maximization Problems Under Partial Information in a Market with Gaussian Drift," Papers 2205.08614, arXiv.org, revised Jul 2024.
    19. Alessandro Gregorio & Stefano Iacus, 2008. "Parametric estimation for the standard and geometric telegraph process observed at discrete times," Statistical Inference for Stochastic Processes, Springer, vol. 11(3), pages 249-263, October.
    20. Kexin Chen & Hoi Ying Wong, 2022. "Duality in optimal consumption--investment problems with alternative data," Papers 2210.08422, arXiv.org, revised Jul 2023.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1411.0849. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.