IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/122349.html
   My bibliography  Save this paper

A closed-form filter for binary time series

Author

Listed:
  • Fasano, Augusto
  • Rebaudo, Giovanni
  • Durante, Daniele
  • Petrone, Sonia

Abstract

Non-Gaussian state-space models arise in several applications, and within this framework the binary time series setting provides a relevant example. However, unlike for Gaussian state-space models — where filtering, predictive and smoothing distributions are available in closed form — binary state-space models require approximations or sequential Monte Carlo strategies for inference and prediction. This is due to the apparent absence of conjugacy between the Gaussian states and the likelihood induced by the observation equation for the binary data. In this article we prove that the filtering, predictive and smoothing distributions in dynamic probit models with Gaussian state variables are, in fact, available and belong to a class of unified skew-normals (sun) whose parameters can be updated recursively in time via analytical expressions. Also the key functionals of these distributions are, in principle, available, but their calculation requires the evaluation of multivariate Gaussian cumulative distribution functions. Leveraging sun properties, we address this issue via novel Monte Carlo methods based on independent samples from the smoothing distribution, that can easily be adapted to the filtering and predictive case, thus improving state-of-the-art approximate and sequential Monte Carlo inference in small-to-moderate dimensional studies. Novel sequential Monte Carlo procedures that exploit the sun properties are also developed to deal with online inference in high dimensions. Performance gains over competitors are outlined in a financial application.

Suggested Citation

  • Fasano, Augusto & Rebaudo, Giovanni & Durante, Daniele & Petrone, Sonia, 2021. "A closed-form filter for binary time series," MPRA Paper 122349, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:122349
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/122349/1/Final_Paper.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gupta, Arjun K. & González-Farías, Graciela & Domínguez-Molina, J. Armando, 2004. "A multivariate skew normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 89(1), pages 181-190, April.
    2. Christophe Andrieu & Arnaud Doucet, 2002. "Particle filtering for partially observed Gaussian state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 827-836, October.
    3. A. Azzalini & A. Capitanio, 1999. "Statistical applications of the multivariate skew normal distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 579-602.
    4. Z. I. Botev, 2017. "The normal law under linear restrictions: simulation and estimation via minimax tilting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 125-148, January.
    5. Horrace, William C., 2005. "Some results on the multivariate truncated normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 94(1), pages 209-221, May.
    6. Liu, Xuefeng & Daniels, Michael J. & Marcus, Bess, 2009. "Joint Models for the Association of Longitudinal Binary and Continuous Processes With Application to a Smoking Cessation Trial," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 429-438.
    7. Daniele Durante, 2019. "Conjugate Bayes for probit regression via unified skew-normal distributions," Biometrika, Biometrika Trust, vol. 106(4), pages 765-779.
    8. repec:wyi:journl:002173 is not listed on IDEAS
    9. Adelchi Azzalini & Antonella Bacchieri, 2010. "A prospective combination of phase II and phase III in drug development," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 347-369.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reinaldo B. Arellano-Valle & Adelchi Azzalini, 2022. "Some properties of the unified skew-normal distribution," Statistical Papers, Springer, vol. 63(2), pages 461-487, April.
    2. Zhongwei Zhang & Reinaldo B. Arellano‐Valle & Marc G. Genton & Raphaël Huser, 2023. "Tractable Bayes of skew‐elliptical link models for correlated binary data," Biometrics, The International Biometric Society, vol. 79(3), pages 1788-1800, September.
    3. Ye, Rendao & Wang, Tonghui & Gupta, Arjun K., 2014. "Distribution of matrix quadratic forms under skew-normal settings," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 229-239.
    4. Centorrino, Samuele & Pérez-Urdiales, María, 2023. "Maximum likelihood estimation of stochastic frontier models with endogeneity," Journal of Econometrics, Elsevier, vol. 234(1), pages 82-105.
    5. Sharon Lee & Geoffrey McLachlan, 2013. "On mixtures of skew normal and skew $$t$$ -distributions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 7(3), pages 241-266, September.
    6. Wang, Tonghui & Li, Baokun & Gupta, Arjun K., 2009. "Distribution of quadratic forms under skew normal settings," Journal of Multivariate Analysis, Elsevier, vol. 100(3), pages 533-545, March.
    7. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino & Elmar Mertens, 2021. "Forecasting with Shadow-Rate VARs," Working Papers 21-09, Federal Reserve Bank of Cleveland.
    8. Raúl Alejandro Morán-Vásquez & Edwin Zarrazola & Daya K. Nagar, 2022. "Some Statistical Aspects of the Truncated Multivariate Skew- t Distribution," Mathematics, MDPI, vol. 10(15), pages 1-14, August.
    9. Bolance, Catalina & Guillen, Montserrat & Pelican, Elena & Vernic, Raluca, 2008. "Skewed bivariate models and nonparametric estimation for the CTE risk measure," Insurance: Mathematics and Economics, Elsevier, vol. 43(3), pages 386-393, December.
    10. Huang, Wen-Jang & Chen, Yan-Hau, 2007. "Generalized skew-Cauchy distribution," Statistics & Probability Letters, Elsevier, vol. 77(11), pages 1137-1147, June.
    11. Azzalini, Adelchi, 2022. "An overview on the progeny of the skew-normal family— A personal perspective," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    12. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano & Mertens, Elmar, 2023. "Shadow-rate VARs," Discussion Papers 14/2023, Deutsche Bundesbank.
    13. Kim, Hyoung-Moon & Ryu, Duchwan & Mallick, Bani K. & Genton, Marc G., 2014. "Mixtures of skewed Kalman filters," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 228-251.
    14. Carsten Botts, 2013. "An accept-reject algorithm for the positive multivariate normal distribution," Computational Statistics, Springer, vol. 28(4), pages 1749-1773, August.
    15. Oleg Badunenko & Daniel J. Henderson, 2024. "Production analysis with asymmetric noise," Journal of Productivity Analysis, Springer, vol. 61(1), pages 1-18, February.
    16. Sharon Lee & Geoffrey McLachlan, 2013. "Model-based clustering and classification with non-normal mixture distributions," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(4), pages 427-454, November.
    17. Lin, Tsung I. & Ho, Hsiu J. & Chen, Chiang L., 2009. "Analysis of multivariate skew normal models with incomplete data," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2337-2351, November.
    18. Mauro Bernardi & Roy Cerqueti & Arsen Palestini, 2020. "The Skew Normal multivariate risk measurement framework," Computational Management Science, Springer, vol. 17(1), pages 105-119, January.
    19. Robert Paige & A. Trindade & R. Wickramasinghe, 2014. "Extensions of saddlepoint-based bootstrap inference," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(5), pages 961-981, October.
    20. Huang, Wen-Jang & Chen, Yan-Hau, 2006. "Quadratic forms of multivariate skew normal-symmetric distributions," Statistics & Probability Letters, Elsevier, vol. 76(9), pages 871-879, May.

    More about this item

    Keywords

    Dynamic probit model; Kalman filter; Particle filter; State-space model; sun;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C4 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:122349. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.