IDEAS home Printed from https://ideas.repec.org/a/spr/jagbes/v27y2022i2d10.1007_s13253-021-00483-x.html
   My bibliography  Save this article

Hidden Markov and Semi-Markov Models When and Why are These Models Useful for Classifying States in Time Series Data?

Author

Listed:
  • Sofia Ruiz-Suarez

    (INIBIOMA (CONICET-Universidad Nacional del Comahue)
    Universidad de Rosario)

  • Vianey Leos-Barajas

    (University of Toronto
    University of Toronto)

  • Juan Manuel Morales

    (INIBIOMA (CONICET-Universidad Nacional del Comahue))

Abstract

Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely generated from the same state (i.e., class). When information on the classes of the observations is available in advanced, supervised methods can be applied. In this paper, we provide details for the implementation of four models for classification in a supervised learning context: HMMs, hidden semi-Markov models (HSMMs), autoregressive-HMMs, and autoregressive-HSMMs. Using simulations, we study the classification performance under various degrees of model misspecification to characterize when it would be important to extend a basic HMM to an HSMM. As an application of these techniques we use the models to classify accelerometer data from Merino sheep to distinguish between four different behaviors of interest. In particular in the field of movement ecology, collection of fine-scale animal movement data over time to identify behavioral states has become ubiquitous, necessitating models that can account for the dependence structure in the data. We demonstrate that when the aim is to conduct classification, various degrees of model misspecification of the proposed model may not impede good classification performance unless there is high overlap between the state-dependent distributions, that is, unless the observation distributions of the different states are difficult to differentiate. Supplementary materials accompanying this paper appear on-line.

Suggested Citation

  • Sofia Ruiz-Suarez & Vianey Leos-Barajas & Juan Manuel Morales, 2022. "Hidden Markov and Semi-Markov Models When and Why are These Models Useful for Classifying States in Time Series Data?," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(2), pages 339-363, June.
  • Handle: RePEc:spr:jagbes:v:27:y:2022:i:2:d:10.1007_s13253-021-00483-x
    DOI: 10.1007/s13253-021-00483-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13253-021-00483-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13253-021-00483-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    2. Bulla, Jan & Bulla, Ingo, 2006. "Stylized facts of financial time series and hidden semi-Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2192-2209, December.
    3. Francq, C. & Zakoian, J. -M., 2001. "Stationarity of multivariate Markov-switching ARMA models," Journal of Econometrics, Elsevier, vol. 102(2), pages 339-364, June.
    4. Langrock, R. & Zucchini, W., 2011. "Hidden Markov models with arbitrary state dwell-time distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 715-724, January.
    5. Yang, Minxian, 2000. "Some Properties Of Vector Autoregressive Processes With Markov-Switching Coefficients," Econometric Theory, Cambridge University Press, vol. 16(1), pages 23-43, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cavicchioli, Maddalena, 2024. "A matrix unified framework for deriving various impulse responses in Markov switching VAR: Evidence from oil and gas markets," The Journal of Economic Asymmetries, Elsevier, vol. 29(C).
    2. Fiorentini, Gabriele & Planas, Christophe & Rossi, Alessandro, 2016. "Skewness and kurtosis of multivariate Markov-switching processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 153-159.
    3. Kole, Erik & van Dijk, Dick, 2023. "Moments, shocks and spillovers in Markov-switching VAR models," Journal of Econometrics, Elsevier, vol. 236(2).
    4. Dominique Guegan & Bertrand K. Hassani, 2019. "Risk Measurement," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-02119256, HAL.
    5. Antonello Maruotti & Antonio Punzo, 2021. "Initialization of Hidden Markov and Semi‐Markov Models: A Critical Evaluation of Several Strategies," International Statistical Review, International Statistical Institute, vol. 89(3), pages 447-480, December.
    6. Cavicchioli, Maddalena, 2023. "Statistical analysis of Markov switching vector autoregression models with endogenous explanatory variables," Journal of Multivariate Analysis, Elsevier, vol. 196(C).
    7. Maddalena Cavicchioli, 2020. "Invertibility and VAR Representations of Time-Varying Dynamic Stochastic General Equilibrium Models," Computational Economics, Springer;Society for Computational Economics, vol. 55(1), pages 61-86, January.
    8. Roland Langrock & Timo Adam & Vianey Leos‐Barajas & Sina Mews & David L. Miller & Yannis P. Papastamatiou, 2018. "Spline‐based nonparametric inference in general state‐switching models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 179-200, August.
    9. Degras, David & Ting, Chee-Ming & Ombao, Hernando, 2022. "Markov-switching state-space models with applications to neuroimaging," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    10. Wang, Ting & Bebbington, Mark, 2013. "Identifying anomalous signals in GPS data using HMMs: An increased likelihood of earthquakes?," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 27-44.
    11. Pohle, Jennifer & Adam, Timo & Beumer, Larissa T., 2022. "Flexible estimation of the state dwell-time distribution in hidden semi-Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 172(C).
    12. Hamilton, J.D., 2016. "Macroeconomic Regimes and Regime Shifts," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 163-201, Elsevier.
    13. Aivazian, Sergey & Bereznyatskiy, Alexander & Brodsky, Boris & Darkhovsky, Boris, 2015. "Statistical analysis of variable-structure models," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 84-105.
    14. Maddalena Cavicchioli, 2020. "A note on the asymptotic and exact Fisher information matrices of a Markov switching VARMA process," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 29(1), pages 129-139, March.
    15. Maruotti, Antonello & Petrella, Lea & Sposito, Luca, 2021. "Hidden semi-Markov-switching quantile regression for time series," Computational Statistics & Data Analysis, Elsevier, vol. 159(C).
    16. Cavicchioli, Maddalena, 2023. "Impulse response function analysis for Markov switching var models," Economics Letters, Elsevier, vol. 232(C).
    17. Bibi, Abdelouahab & Ghezal, Ahmed, 2015. "Consistency of quasi-maximum likelihood estimator for Markov-switching bilinear time series models," Statistics & Probability Letters, Elsevier, vol. 100(C), pages 192-202.
    18. Cavicchioli, Maddalena, 2017. "Asymptotic Fisher information matrix of Markov switching VARMA models," Journal of Multivariate Analysis, Elsevier, vol. 157(C), pages 124-135.
    19. Milan Kumar Das & Anindya Goswami, 2019. "Testing of binary regime switching models using squeeze duration analysis," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 6(01), pages 1-20, March.
    20. Francis,David C. & Kubinec ,Robert, 2022. "Beyond Political Connections : A Measurement Model Approach to Estimating Firm-levelPolitical Influence in 41 Economies," Policy Research Working Paper Series 10119, The World Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jagbes:v:27:y:2022:i:2:d:10.1007_s13253-021-00483-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.