IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v212y2011i1p112-122.html
   My bibliography  Save this article

Maximising entropy on the nonparametric predictive inference model for multinomial data

Author

Listed:
  • Abellán, Joaquín
  • Baker, Rebecca M.
  • Coolen, Frank P.A.

Abstract

The combination of mathematical models and uncertainty measures can be applied in the area of data mining for diverse objectives with as final aim to support decision making. The maximum entropy function is an excellent measure of uncertainty when the information is represented by a mathematical model based on imprecise probabilities. In this paper, we present algorithms to obtain the maximum entropy value when the information available is represented by a new model based on imprecise probabilities: the nonparametric predictive inference model for multinomial data (NPI-M), which represents a type of entropy-linear program. To reduce the complexity of the model, we prove that the NPI-M lower and upper probabilities for any general event can be expressed as a combination of the lower and upper probabilities for the singleton events, and that this model can not be associated with a closed polyhedral set of probabilities. An algorithm to obtain the maximum entropy probability distribution on the set associated with NPI-M is presented. We also consider a model which uses the closed and convex set of probability distributions generated by the NPI-M singleton probabilities, a closed polyhedral set. We call this model A-NPI-M. A-NPI-M can be seen as an approximation of NPI-M, this approximation being simpler to use because it is not necessary to consider the set of constraints associated with the exact model.

Suggested Citation

  • Abellán, Joaquín & Baker, Rebecca M. & Coolen, Frank P.A., 2011. "Maximising entropy on the nonparametric predictive inference model for multinomial data," European Journal of Operational Research, Elsevier, vol. 212(1), pages 112-122, July.
    • Handle: RePEc:eee:ejores:v:212:y:2011:i:1:p:112-122
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(11)00048-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chateauneuf, Alain & Jaffray, Jean-Yves, 1989. "Some characterizations of lower probabilities and other monotone capacities through the use of Mobius inversion," Mathematical Social Sciences, Elsevier, vol. 17(3), pages 263-283, June.
    2. Abellán, Joaquín & Masegosa, Andrés R., 2010. "An ensemble method using credal decision trees," European Journal of Operational Research, Elsevier, vol. 205(1), pages 218-226, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Houlding, B. & Coolen, F.P.A., 2012. "Nonparametric predictive utility inference," European Journal of Operational Research, Elsevier, vol. 221(1), pages 222-230.
    2. Frank PA Coolen & Tahani Coolen-Maturi & Abdullah H Al-nefaiee, 2014. "Nonparametric predictive inference for system reliability using the survival signature," Journal of Risk and Reliability, , vol. 228(5), pages 437-448, October.
    3. Abellán, Joaquín & Baker, Rebecca M. & Coolen, Frank P.A. & Crossman, Richard J. & Masegosa, Andrés R., 2014. "Classification with decision trees from a nonparametric predictive inference perspective," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 789-802.
    4. Aboalkhair, Ahmad M. & Coolen, Frank P.A. & MacPhee, Iain M., 2013. "Nonparametric predictive reliability of series of voting systems," European Journal of Operational Research, Elsevier, vol. 226(1), pages 77-84.
    5. Fernández, Arturo J., 2012. "Minimizing the area of a Pareto confidence region," European Journal of Operational Research, Elsevier, vol. 221(1), pages 205-212.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michèle Cohen & Alain Chateauneuf & Eric Danan & Thibault Gajdos & Raphaël Giraud & Meglena Jeleva & Fabrice Philippe & Jean-Marc Tallon & Jean-Christophe Vergnaud, 2011. "Tribute to Jean-Yves Jaffray," Theory and Decision, Springer, vol. 71(1), pages 1-10, July.
    2. Gong, Zaiwu & Guo, Weiwei & Słowiński, Roman, 2021. "Transaction and interaction behavior-based consensus model and its application to optimal carbon emission reduction," Omega, Elsevier, vol. 104(C).
    3. Brice Mayag & Michel Grabisch & Christophe Labreuche, 2009. "A characterization of the 2-additive Choquet integral through cardinal information," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00445132, HAL.
    4. Pereira, Miguel Alves & Figueira, José Rui & Marques, Rui Cunha, 2020. "Using a Choquet integral-based approach for incorporating decision-maker’s preference judgments in a Data Envelopment Analysis model," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1016-1030.
    5. Takao Asano & Hiroyuki Kojima, 2022. "Choquet Integrals and Belief Functions," KIER Working Papers 1077, Kyoto University, Institute of Economic Research.
    6. Michel Grabisch, 2015. "Bases and transforms of set functions," Post-Print halshs-01169287, HAL.
    7. Takao Asano & Hiroyuki Kojima, 2013. "An Axiomatization of Choquet Expected Utility with Cominimum Independence," KIER Working Papers 878, Kyoto University, Institute of Economic Research.
    8. Grabisch, Michel & Labreuche, Christophe & Vansnick, Jean-Claude, 2003. "On the extension of pseudo-Boolean functions for the aggregation of interacting criteria," European Journal of Operational Research, Elsevier, vol. 148(1), pages 28-47, July.
    9. Cang, Shuang & Yu, Hongnian, 2014. "A combination selection algorithm on forecasting," European Journal of Operational Research, Elsevier, vol. 234(1), pages 127-139.
    10. Grabisch, Michel & Labreuche, Christophe, 2018. "Monotone decomposition of 2-additive Generalized Additive Independence models," Mathematical Social Sciences, Elsevier, vol. 92(C), pages 64-73.
    11. Miranda, Pedro & Grabisch, Michel & Gil, Pedro, 2006. "Dominance of capacities by k-additive belief functions," European Journal of Operational Research, Elsevier, vol. 175(2), pages 912-930, December.
    12. Billot, Antoine & Thisse, Jacques-Francois, 2005. "How to share when context matters: The Mobius value as a generalized solution for cooperative games," Journal of Mathematical Economics, Elsevier, vol. 41(8), pages 1007-1029, December.
    13. Angilella, Silvia & Greco, Salvatore & Matarazzo, Benedetto, 2010. "Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral," European Journal of Operational Research, Elsevier, vol. 201(1), pages 277-288, February.
    14. Rigotti, Luca & Ryan, Matthew & Vaithianathan, Rema, 2001. "Entrepreneurial Innovation," Department of Economics, Working Paper Series qt508109h4, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    15. Michel Grabisch, 2006. "Capacities and Games on Lattices: A Survey of Result," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00179830, HAL.
    16. Kojadinovic, Ivan, 2004. "Estimation of the weights of interacting criteria from the set of profiles by means of information-theoretic functionals," European Journal of Operational Research, Elsevier, vol. 155(3), pages 741-751, June.
    17. repec:hal:pseose:hal-00803233 is not listed on IDEAS
    18. Corrente, Salvatore & Greco, Salvatore & Ishizaka, Alessio, 2016. "Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression," Omega, Elsevier, vol. 61(C), pages 2-18.
    19. Alain Chateauneuf & Vassili Vergopoulos & Jianbo Zhang, 2018. "Infinite Supermodularity and Preferences," Chapters, in: Danijela Tuljak-Suban (ed.), Game Theory - Applications in Logistics and Economy, IntechOpen.
    20. Miranda, Pedro & Grabisch, Michel, 2010. "k-Balanced games and capacities," European Journal of Operational Research, Elsevier, vol. 200(2), pages 465-472, January.
    21. Chateauneuf, Alain & Rebille, Yann, 2004. "Some characterizations of non-additive multi-period models," Mathematical Social Sciences, Elsevier, vol. 48(3), pages 235-250, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:212:y:2011:i:1:p:112-122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.