IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v99y2008i6p1217-1231.html
   My bibliography  Save this article

Multivariate maximum entropy identification, transformation, and dependence

Author

Listed:
  • Ebrahimi, Nader
  • Soofi, Ehsan S.
  • Soyer, Refik

Abstract

This paper shows that multivariate distributions can be characterized as maximum entropy (ME) models based on the well-known general representation of density function of the ME distribution subject to moment constraints. In this approach, the problem of ME characterization simplifies to the problem of representing the multivariate density in the ME form, hence there is no need for case-by-case proofs by calculus of variations or other methods. The main vehicle for this ME characterization approach is the information distinguishability relationship, which extends to the multivariate case. Results are also formulated that encapsulate implications of the multiplication rule of probability and the entropy transformation formula for ME characterization. The dependence structure of multivariate ME distribution in terms of the moments and the support of distribution is studied. The relationships of ME distributions with the exponential family and with bivariate distributions having exponential family conditionals are explored. Applications include new ME characterizations of many bivariate distributions, including some singular distributions.

Suggested Citation

  • Ebrahimi, Nader & Soofi, Ehsan S. & Soyer, Refik, 2008. "Multivariate maximum entropy identification, transformation, and dependence," Journal of Multivariate Analysis, Elsevier, vol. 99(6), pages 1217-1231, July.
    • Handle: RePEc:eee:jmvana:v:99:y:2008:i:6:p:1217-1231
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(07)00100-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. G. Aulogiaris & K. Zografos, 2004. "A maximum entropy characterization of symmetric Kotz type and Burr multivariate distributions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 13(1), pages 65-83, June.
    2. Ebrahimi, Nader & Kirmani, S.N.U.A. & Soofi, Ehsan S., 2007. "Multivariate dynamic information," Journal of Multivariate Analysis, Elsevier, vol. 98(2), pages 328-349, February.
    3. Zografos, K., 1999. "On Maximum Entropy Characterization of Pearson's Type II and VII Multivariate Distributions," Journal of Multivariate Analysis, Elsevier, vol. 71(1), pages 67-75, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Majid Asadi & Nader Ebrahimi & Ehsan S. Soofi & Somayeh Zarezadeh, 2014. "New maximum entropy methods for modeling lifetime distributions," Naval Research Logistics (NRL), John Wiley & Sons, vol. 61(6), pages 427-434, September.
    2. Iulia-Elena Hirica & Cristina-Liliana Pripoae & Gabriel-Teodor Pripoae & Vasile Preda, 2022. "Lie Symmetries of the Nonlinear Fokker-Planck Equation Based on Weighted Kaniadakis Entropy," Mathematics, MDPI, vol. 10(15), pages 1-22, August.
    3. Bajgiran, Amirsaman H. & Mardikoraem, Mahsa & Soofi, Ehsan S., 2021. "Maximum entropy distributions with quantile information," European Journal of Operational Research, Elsevier, vol. 290(1), pages 196-209.
    4. Ebrahimi, Nader & Jalali, Nima Y. & Soofi, Ehsan S., 2014. "Comparison, utility, and partition of dependence under absolutely continuous and singular distributions," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 32-50.
    5. Bera Anil K. & Galvao Antonio F. & Montes-Rojas Gabriel V. & Park Sung Y., 2016. "Asymmetric Laplace Regression: Maximum Likelihood, Maximum Entropy and Quantile Regression," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 79-101, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carol Alexander & José María Sarabia, 2012. "Quantile Uncertainty and Value‐at‐Risk Model Risk," Risk Analysis, John Wiley & Sons, vol. 32(8), pages 1293-1308, August.
    2. Bhattacharya, Bhaskar, 2006. "Maximum entropy characterizations of the multivariate Liouville distributions," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1272-1283, July.
    3. Zografos, K. & Nadarajah, S., 2005. "Expressions for Rényi and Shannon entropies for multivariate distributions," Statistics & Probability Letters, Elsevier, vol. 71(1), pages 71-84, January.
    4. Antonio Di Crescenzo & Patrizia Di Gironimo, 2018. "Stochastic Comparisons and Dynamic Information of Random Lifetimes in a Replacement Model," Mathematics, MDPI, vol. 6(10), pages 1-13, October.
    5. Ebrahimi, Nader & Kirmani, S.N.U.A. & Soofi, Ehsan S., 2007. "Multivariate dynamic information," Journal of Multivariate Analysis, Elsevier, vol. 98(2), pages 328-349, February.
    6. Athanasios Sachlas & Takis Papaioannou, 2014. "Residual and Past Entropy in Actuarial Science and Survival Models," Methodology and Computing in Applied Probability, Springer, vol. 16(1), pages 79-99, March.
    7. Navarro, J. & Sunoj, S.M. & Linu, M.N., 2011. "Characterizations of bivariate models using dynamic Kullback-Leibler discrimination measures," Statistics & Probability Letters, Elsevier, vol. 81(11), pages 1594-1598, November.
    8. Andai, Attila, 2009. "On the geometry of generalized Gaussian distributions," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 777-793, April.
    9. Villa, Cristiano & Rubio, Francisco J., 2018. "Objective priors for the number of degrees of freedom of a multivariate t distribution and the t-copula," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 197-219.
    10. Cadirci, Mehmet Siddik & Evans, Dafydd & Leonenko, Nikolai & Makogin, Vitalii, 2022. "Entropy-based test for generalised Gaussian distributions," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    11. Daya K. Nagar & Saralees Nadarajah & Idika E. Okorie, 2017. "A New Bivariate Distribution with One Marginal Defined on the Unit Interval," Annals of Data Science, Springer, vol. 4(3), pages 405-420, September.
    12. Leonenko, Nikolaj & Seleznjev, Oleg, 2010. "Statistical inference for the [epsilon]-entropy and the quadratic Rényi entropy," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 1981-1994, October.
    13. Nair Rohini S. & Abdul Sathar E. I., 2019. "Bivariate Dynamic Weighted Survival Entropy of Order 𝛼," Stochastics and Quality Control, De Gruyter, vol. 34(2), pages 67-85, December.
    14. Amit Ghosh & Chanchal Kundu, 2018. "Chernoff distance for conditionally specified models," Statistical Papers, Springer, vol. 59(3), pages 1061-1083, September.
    15. Amit Ghosh & Chanchal Kundu, 2019. "Bivariate extension of (dynamic) cumulative residual and past inaccuracy measures," Statistical Papers, Springer, vol. 60(6), pages 2225-2252, December.
    16. Nader Ebrahimi & S.N.U.A. Kirmani & Ehsan S. Soofi, 2011. "Predictability of operational processes over finite horizon," Naval Research Logistics (NRL), John Wiley & Sons, vol. 58(6), pages 531-545, September.
    17. Maryam Eskandarzadeh & Antonio Di Crescenzo & Saeid Tahmasebi, 2019. "Cumulative Measure of Inaccuracy and Mutual Information in k -th Lower Record Values," Mathematics, MDPI, vol. 7(2), pages 1-19, February.
    18. Ebrahimi, Nader & Jalali, Nima Y. & Soofi, Ehsan S., 2014. "Comparison, utility, and partition of dependence under absolutely continuous and singular distributions," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 32-50.
    19. Castilla, Elena & Zografos, Konstantinos, 2022. "On distance-type Gaussian estimation," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    20. Contreras-Reyes, Javier E., 2014. "Asymptotic form of the Kullback–Leibler divergence for multivariate asymmetric heavy-tailed distributions," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 395(C), pages 200-208.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:99:y:2008:i:6:p:1217-1231. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.