IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v71y2005i1p85-98.html
   My bibliography  Save this article

Dynamic generalized information measures

Author

Listed:
  • Asadi, Majid
  • Ebrahimi, Nader
  • Soofi, Ehsan S.

Abstract

In many reliability and survival analysis problems the current age of an item under study must be taken into account by information measures of the lifetime distribution. Kullback-Leibler information and Shannon entropy have been considered in this context, which led to information measures that depend on time, and thus are dynamic. This paper develops dynamic information divergence and entropy of order [alpha], also known as Rényi information and entropy, which for [alpha]=1 give the Kullback-Leibler information and Shannon entropy, respectively. We give characterizations of the proportional hazards model, the exponential distribution, and Generalized Pareto distributions in terms of dynamic Rényi information and entropy. It is also shown that dynamic Rényi entropy uniquely determines distributions that have monotone densities. A result that relates dynamic Rényi entropy and hazard rate orderings is given. This result leads to a Maximum Dynamic Entropy of order [alpha] formulation and characterizations of some well-known lifetime models. A dynamic entropy hazard rate inequality is developed as an analog of the well-known entropy moment inequality.

Suggested Citation

  • Asadi, Majid & Ebrahimi, Nader & Soofi, Ehsan S., 2005. "Dynamic generalized information measures," Statistics & Probability Letters, Elsevier, vol. 71(1), pages 85-98, January.
    • Handle: RePEc:eee:stapro:v:71:y:2005:i:1:p:85-98
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-7152(04)00287-1
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Di Crescenzo, Antonio & Longobardi, Maria, 2004. "A measure of discrimination between past lifetime distributions," Statistics & Probability Letters, Elsevier, vol. 67(2), pages 173-182, April.
    2. Golan, Amos & Perloff, Jeffrey M., 2002. "Comparison of maximum entropy and higher-order entropy estimators," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 195-211, March.
    3. Zografos, K. & Nadarajah, S., 2005. "Expressions for Rényi and Shannon entropies for multivariate distributions," Statistics & Probability Letters, Elsevier, vol. 71(1), pages 71-84, January.
    4. Ebrahimi, Nader & Kirmani, S. N. U. A., 1996. "Some results on ordering of survival functions through uncertainty," Statistics & Probability Letters, Elsevier, vol. 29(2), pages 167-176, August.
    5. Nader Ebrahimi & S. Kirmani, 1996. "A measure of discrimination between two residual life-time distributions and its applications," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 48(2), pages 257-265, June.
    6. Asadi, Majid & Ebrahimi, Nader, 2000. "Residual entropy and its characterizations in terms of hazard function and mean residual life function," Statistics & Probability Letters, Elsevier, vol. 49(3), pages 263-269, September.
    7. Felix Belzunce & Jorge Navarro & José M. Ruiz & Yolanda del Aguila, 2004. "Some results on residual entropy function," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 59(2), pages 147-161, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Asadi, Majid & Ebrahimi, Nader & Soofi, Ehsan S., 2018. "Optimal hazard models based on partial information," European Journal of Operational Research, Elsevier, vol. 270(2), pages 723-733.
    2. Nanda, Asok K. & Sankaran, P.G. & Sunoj, S.M., 2014. "Rényi’s residual entropy: A quantile approach," Statistics & Probability Letters, Elsevier, vol. 85(C), pages 114-121.
    3. K. Nair & P. Sankaran & S. Smitha, 2011. "Chernoff distance for truncated distributions," Statistical Papers, Springer, vol. 52(4), pages 893-909, November.
    4. Chanchal Kundu, 2015. "Generalized measures of information for truncated random variables," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(4), pages 415-435, May.
    5. Farrukh Jamal & Muhammad Ijaz & Ghulam Mustafa & Sadaf Khan & Shakaiba Shafiq, 2024. "On the theory of order statistics of the flexible Lomax distribution," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 34(2), pages 33-45.
    6. R. Maya & E. Abdul-Sathar & G. Rajesh & K. Muraleedharan Nair, 2014. "Estimation of the Renyi’s residual entropy of order $$\alpha $$ with dependent data," Statistical Papers, Springer, vol. 55(3), pages 585-602, August.
    7. Abbasnejad, M. & Arghami, N.R. & Morgenthaler, S. & Mohtashami Borzadaran, G.R., 2010. "On the dynamic survival entropy," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1962-1971, December.
    8. Kayal, Suchandan, 2015. "On generalized dynamic survival and failure entropies of order (α,β)," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 123-132.
    9. Vikas Kumar & Nirdesh Singh, 2023. "Some Results on Quantile Version of R é $\acute {e}$ nyi Entropy of Order Statistics," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(1), pages 248-273, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abbasnejad, M. & Arghami, N.R. & Morgenthaler, S. & Mohtashami Borzadaran, G.R., 2010. "On the dynamic survival entropy," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1962-1971, December.
    2. Rajesh, G. & Abdul-Sathar, E.I. & Maya, R., 2015. "Local linear estimation of residual entropy function of conditional distributions," Computational Statistics & Data Analysis, Elsevier, vol. 88(C), pages 1-14.
    3. Khorashadizadeh, M. & Rezaei Roknabadi, A.H. & Mohtashami Borzadaran, G.R., 2013. "Doubly truncated (interval) cumulative residual and past entropy," Statistics & Probability Letters, Elsevier, vol. 83(5), pages 1464-1471.
    4. K. Nair & P. Sankaran & S. Smitha, 2011. "Chernoff distance for truncated distributions," Statistical Papers, Springer, vol. 52(4), pages 893-909, November.
    5. Sunoj, S.M. & Sankaran, P.G., 2012. "Quantile based entropy function," Statistics & Probability Letters, Elsevier, vol. 82(6), pages 1049-1053.
    6. Maya, R. & Abdul-Sathar, E.I. & Rajesh, G., 2014. "Non-parametric estimation of the generalized past entropy function with censored dependent data," Statistics & Probability Letters, Elsevier, vol. 90(C), pages 129-135.
    7. Hassina Benaoudia & Amar Aissani, 2023. "Non-Parametric Test for Decreasing Uncertainty of Residual Life Distribution (DURL)," Mathematics, MDPI, vol. 11(20), pages 1-17, October.
    8. Misagh, F. & Yari, G.H., 2011. "On weighted interval entropy," Statistics & Probability Letters, Elsevier, vol. 81(2), pages 188-194, February.
    9. R. Maya & E. Abdul-Sathar & G. Rajesh & K. Muraleedharan Nair, 2014. "Estimation of the Renyi’s residual entropy of order $$\alpha $$ with dependent data," Statistical Papers, Springer, vol. 55(3), pages 585-602, August.
    10. Răzvan-Cornel Sfetcu & Sorina-Cezarina Sfetcu & Vasile Preda, 2021. "Ordering Awad–Varma Entropy and Applications to Some Stochastic Models," Mathematics, MDPI, vol. 9(3), pages 1-15, January.
    11. Antonio Di Crescenzo & Patrizia Di Gironimo, 2018. "Stochastic Comparisons and Dynamic Information of Random Lifetimes in a Replacement Model," Mathematics, MDPI, vol. 6(10), pages 1-13, October.
    12. Nanda, Asok K. & Sankaran, P.G. & Sunoj, S.M., 2014. "Rényi’s residual entropy: A quantile approach," Statistics & Probability Letters, Elsevier, vol. 85(C), pages 114-121.
    13. Henry W. Block & Thomas H. Savits & Harshinder Singh, 2002. "A Criterion for Burn-in that Balances Mean Residual Life and Residual Variance," Operations Research, INFORMS, vol. 50(2), pages 290-296, April.
    14. Belzunce, F. & Pellerey, Franco & Ruiz, J. M. & Shaked, Moshe, 1997. "The dilation order, the dispersion order, and orderings of residual lives," Statistics & Probability Letters, Elsevier, vol. 33(3), pages 263-275, May.
    15. Bhattacharya, Bhaskar, 2006. "Maximum entropy characterizations of the multivariate Liouville distributions," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1272-1283, July.
    16. Athanasios Sachlas & Takis Papaioannou, 2014. "Residual and Past Entropy in Actuarial Science and Survival Models," Methodology and Computing in Applied Probability, Springer, vol. 16(1), pages 79-99, March.
    17. Parfait Munezero, 2022. "Efficient particle smoothing for Bayesian inference in dynamic survival models," Computational Statistics, Springer, vol. 37(2), pages 975-994, April.
    18. Zellner, Arnold, 2007. "Some aspects of the history of Bayesian information processing," Journal of Econometrics, Elsevier, vol. 138(2), pages 388-404, June.
    19. Navarro, J. & Sunoj, S.M. & Linu, M.N., 2011. "Characterizations of bivariate models using dynamic Kullback-Leibler discrimination measures," Statistics & Probability Letters, Elsevier, vol. 81(11), pages 1594-1598, November.
    20. Pedro Macedo & Elvira Silva & Manuel Scotto, 2014. "Technical efficiency with state-contingent production frontiers using maximum entropy estimators," Journal of Productivity Analysis, Springer, vol. 41(1), pages 131-140, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:71:y:2005:i:1:p:85-98. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.