IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v195y2024ics0167947324000392.html
   My bibliography  Save this article

A new algorithm for inference in HMM's with lower span complexity

Author

Listed:
  • Pereira, Diogo
  • Nunes, Cláudia
  • Rodrigues, Rui

Abstract

The maximum likelihood problem for Hidden Markov Models is usually numerically solved by the Baum-Welch algorithm, which uses the Expectation-Maximization algorithm to find the estimates of the parameters. This algorithm has a recursion depth equal to the data sample size and cannot be computed in parallel, which limits the use of modern GPUs to speed up computation time. A new algorithm is proposed that provides the same estimates as the Baum-Welch algorithm, requiring about the same number of iterations, but is designed in such a way that it can be parallelized. As a consequence, it leads to a significant reduction in the computation time. This reduction is illustrated by means of numerical examples, where we consider simulated data as well as real datasets.

Suggested Citation

  • Pereira, Diogo & Nunes, Cláudia & Rodrigues, Rui, 2024. "A new algorithm for inference in HMM's with lower span complexity," Computational Statistics & Data Analysis, Elsevier, vol. 195(C).
    • Handle: RePEc:eee:csdana:v:195:y:2024:i:c:s0167947324000392
    DOI: 10.1016/j.csda.2024.107955
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947324000392
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2024.107955?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Turner, Rolf, 2008. "Direct maximization of the likelihood of a hidden Markov model," Computational Statistics & Data Analysis, Elsevier, vol. 52(9), pages 4147-4160, May.
    2. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    3. Stoner, Oliver & Economou, Theo, 2020. "An advanced hidden Markov model for hourly rainfall time series," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maruotti, Antonello & Punzo, Antonio, 2017. "Model-based time-varying clustering of multivariate longitudinal data with covariates and outliers," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 475-496.
    2. Shively, Gerald E., 2001. "Price thresholds, price volatility, and the private costs of investment in a developing country grain market," Economic Modelling, Elsevier, vol. 18(3), pages 399-414, August.
    3. Sarah Arndt & Zeno Enders, 2023. "The Transmission of Supply Shocks in Different Inflation Regimes," CESifo Working Paper Series 10839, CESifo.
    4. Michael Artis, 1999. "The UK and EMU," Palgrave Macmillan Books, in: David Cobham & George Zis (ed.), From EMS to EMU: 1979 to 1999 and Beyond, chapter 7, pages 161-180, Palgrave Macmillan.
    5. Xiang Lin & Martin Thomas Falk, 2022. "Nordic stock market performance of the travel and leisure industry during the first wave of Covid-19 pandemic," Tourism Economics, , vol. 28(5), pages 1240-1257, August.
    6. Moerman, G.A., 2001. "Unpredictable After All? A short note on exchange rate predictability," ERIM Report Series Research in Management ERS-2001-29-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    7. Peter McAdam, 2007. "USA, Japan and the Euro Area: Comparing Business-Cycle Features," International Review of Applied Economics, Taylor & Francis Journals, vol. 21(1), pages 135-156.
    8. Cavicchioli, Maddalena, 2024. "A matrix unified framework for deriving various impulse responses in Markov switching VAR: Evidence from oil and gas markets," The Journal of Economic Asymmetries, Elsevier, vol. 29(C).
    9. Franck Sédillot, 2001. "La pente des taux contient-elle de l'information sur l'activité économique future ?," Economie & Prévision, La Documentation Française, vol. 147(1), pages 141-157.
    10. Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
    11. Rafał Weron, 2009. "Heavy-tails and regime-switching in electricity prices," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 69(3), pages 457-473, July.
    12. Yip, Pick Schen & Brooks, Robert & Do, Hung Xuan & Nguyen, Duc Khuong, 2020. "Dynamic volatility spillover effects between oil and agricultural products," International Review of Financial Analysis, Elsevier, vol. 69(C).
    13. Vassilios Babalos & Mehmet Balcilar & Rangan Gupta, 2014. "Revisiting Herding Behavior in REITs: A Regime-Switching Approach," Working Papers 201448, University of Pretoria, Department of Economics.
    14. Theobald, Thomas, 2013. "Markov Switching with Endogenous Number of Regimes and Leading Indicators in a Real-Time Business Cycle Forecast," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79911, Verein für Socialpolitik / German Economic Association.
    15. Kal, Süleyman Hilmi & Arslaner, Ferhat & Arslaner, Nuran, 2015. "The dynamic relationship between stock, bond and foreign exchange markets," Economic Systems, Elsevier, vol. 39(4), pages 592-607.
    16. Kun-Huang Huarng & Tiffany Hui-Kuang Yu, 2017. "Using qualitative approach to forecasting regime switches," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2035-2048, September.
    17. George Kapetanios, 2001. "Model Selection in Threshold Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 22(6), pages 733-754, November.
    18. Dimitris Kirikos, 2000. "Forecasting exchange rates out of sample: random walk vs Markov switching regimes," Applied Economics Letters, Taylor & Francis Journals, vol. 7(2), pages 133-136.
    19. Osni Silva Junior & Jose Carlos Pereira Coninck & Fabiano Gustavo Silveira Magrin & Francisco Itamarati Secolo Ganacim & Anselmo Pombeiro & Leonardo Göbel Fernandes & Eduardo Félix Ribeiro Romaneli, 2023. "Impacts of Atmospheric and Load Conditions on the Power Substation Equipment Temperature Model," Energies, MDPI, vol. 16(11), pages 1-15, May.
    20. Arvesen, Ø. & Medbø, V. & Fleten, S.-E. & Tomasgard, A. & Westgaard, S., 2013. "Linepack storage valuation under price uncertainty," Energy, Elsevier, vol. 52(C), pages 155-164.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:195:y:2024:i:c:s0167947324000392. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.