IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i2p146-d478269.html
   My bibliography  Save this article

An Information-Theoretic Approach for Multivariate Skew- t Distributions and Applications

Author

Listed:
  • Salah H. Abid

    (Department of Mathematics, Education College, Al-Mustansiriya University, Baghdad 14022, Iraq)

  • Uday J. Quaez

    (Department of Mathematics, Education College, Al-Mustansiriya University, Baghdad 14022, Iraq)

  • Javier E. Contreras-Reyes

    (Instituto de Estadística, Facultad de Ciencias, Universidad de Valparaíso, Valparaíso 2360102, Chile)

Abstract

Shannon and Rényi entropies are two important measures of uncertainty for data analysis. These entropies have been studied for multivariate Student- t and skew-normal distributions. In this paper, we extend the Rényi entropy to multivariate skew- t and finite mixture of multivariate skew- t (FMST) distributions. This class of flexible distributions allows handling asymmetry and tail weight behavior simultaneously. We find upper and lower bounds of Rényi entropy for these families. Numerical simulations illustrate the results for several scenarios: symmetry/asymmetry and light/heavy-tails. Finally, we present applications of our findings to a swordfish length-weight dataset to illustrate the behavior of entropies of the FMST distribution. Comparisons with the counterparts—the finite mixture of multivariate skew-normal and normal distributions—are also presented.

Suggested Citation

  • Salah H. Abid & Uday J. Quaez & Javier E. Contreras-Reyes, 2021. "An Information-Theoretic Approach for Multivariate Skew- t Distributions and Applications," Mathematics, MDPI, vol. 9(2), pages 1-13, January.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:2:p:146-:d:478269
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/2/146/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/2/146/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Reinaldo B. Arellano-Valle & Javier E. Contreras-Reyes & Marc G. Genton, 2013. "Shannon Entropy and Mutual Information for Multivariate Skew-Elliptical Distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(1), pages 42-62, March.
    2. Gilles Celeux & Gilda Soromenho, 1996. "An entropy criterion for assessing the number of clusters in a mixture model," Journal of Classification, Springer;The Classification Society, vol. 13(2), pages 195-212, September.
    3. Prates, Marcos Oliveira & Lachos, Victor Hugo & Barbosa Cabral, Celso Rômulo, 2013. "mixsmsn: Fitting Finite Mixture of Scale Mixture of Skew-Normal Distributions," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 54(i12).
    4. Cabral, Celso Rômulo Barbosa & Lachos, Víctor Hugo & Prates, Marcos O., 2012. "Multivariate mixture modeling using skew-normal independent distributions," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 126-142, January.
    5. Adelchi Azzalini & Giuliana Regoli, 2012. "Some properties of skew-symmetric distributions," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(4), pages 857-879, August.
    6. Contreras-Reyes, Javier E., 2015. "Rényi entropy and complexity measure for skew-gaussian distributions and related families," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 433(C), pages 84-91.
    7. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Contreras-Reyes, Javier E., 2022. "Rényi entropy and divergence for VARFIMA processes based on characteristic and impulse response functions," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonio Parisi & B. Liseo, 2018. "Objective Bayesian analysis for the multivariate skew-t model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(2), pages 277-295, June.
    2. Lee, Sharon X. & McLachlan, Geoffrey J., 2022. "An overview of skew distributions in model-based clustering," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    3. Azzalini, Adelchi, 2022. "An overview on the progeny of the skew-normal family— A personal perspective," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Zhu, Xuwen & Melnykov, Volodymyr, 2018. "Manly transformation in finite mixture modeling," Computational Statistics & Data Analysis, Elsevier, vol. 121(C), pages 190-208.
    5. C. J. Adcock, 2023. "The Linear Skew-t Distribution and Its Properties," Stats, MDPI, vol. 6(1), pages 1-30, February.
    6. Libin Jin & Sung Nok Chiu & Jianhua Zhao & Lixing Zhu, 2023. "A constrained maximum likelihood estimation for skew normal mixtures," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(4), pages 391-419, May.
    7. Julio Mulero & Miguel A. Sordo & Marilia C. de Souza & Alfonso Suárez‐LLorens, 2017. "Two stochastic dominance criteria based on tail comparisons," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 33(6), pages 575-589, November.
    8. Morris, Katherine & Punzo, Antonio & McNicholas, Paul D. & Browne, Ryan P., 2019. "Asymmetric clusters and outliers: Mixtures of multivariate contaminated shifted asymmetric Laplace distributions," Computational Statistics & Data Analysis, Elsevier, vol. 132(C), pages 145-166.
    9. Jupp, P.E. & Regoli, G. & Azzalini, A., 2016. "A general setting for symmetric distributions and their relationship to general distributions," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 107-119.
    10. Fatma Zehra Doğru & Olcay Arslan, 2021. "Finite mixtures of skew Laplace normal distributions with random skewness," Computational Statistics, Springer, vol. 36(1), pages 423-447, March.
    11. Jorge M. Arevalillo & Hilario Navarro, 2019. "A stochastic ordering based on the canonical transformation of skew-normal vectors," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 475-498, June.
    12. Naderi, Mehrdad & Hung, Wen-Liang & Lin, Tsung-I & Jamalizadeh, Ahad, 2019. "A novel mixture model using the multivariate normal mean–variance mixture of Birnbaum–Saunders distributions and its application to extrasolar planets," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 126-138.
    13. Valeriano, Katherine A.L. & Galarza, Christian E. & Matos, Larissa A. & Lachos, Victor H., 2023. "Likelihood-based inference for the multivariate skew-t regression with censored or missing responses," Journal of Multivariate Analysis, Elsevier, vol. 196(C).
    14. Sahin, Özge & Czado, Claudia, 2022. "Vine copula mixture models and clustering for non-Gaussian data," Econometrics and Statistics, Elsevier, vol. 22(C), pages 136-158.
    15. Olcay Arslan, 2015. "Variance-mean mixture of the multivariate skew normal distribution," Statistical Papers, Springer, vol. 56(2), pages 353-378, May.
    16. M. C. Jones, 2015. "On Families of Distributions with Shape Parameters," International Statistical Review, International Statistical Institute, vol. 83(2), pages 175-192, August.
    17. Christophe Ley, 2014. "Flexible Modelling in Statistics: Past, present and Future," Working Papers ECARES ECARES 2014-42, ULB -- Universite Libre de Bruxelles.
    18. Liseo, Brunero & Parisi, Antonio, 2013. "Bayesian inference for the multivariate skew-normal model: A population Monte Carlo approach," Computational Statistics & Data Analysis, Elsevier, vol. 63(C), pages 125-138.
    19. Contreras-Reyes, Javier E. & Kharazmi, Omid, 2023. "Belief Fisher–Shannon information plane: Properties, extensions, and applications to time series analysis," Chaos, Solitons & Fractals, Elsevier, vol. 177(C).
    20. Clécio S. Ferreira & Víctor H. Lachos & Heleno Bolfarine, 2016. "Likelihood-based inference for multivariate skew scale mixtures of normal distributions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 100(4), pages 421-441, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:2:p:146-:d:478269. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.