IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v212y2011i1p112-122.html
   My bibliography  Save this article

Maximising entropy on the nonparametric predictive inference model for multinomial data

Author

Listed:
  • Abellán, Joaquín
  • Baker, Rebecca M.
  • Coolen, Frank P.A.

Abstract

The combination of mathematical models and uncertainty measures can be applied in the area of data mining for diverse objectives with as final aim to support decision making. The maximum entropy function is an excellent measure of uncertainty when the information is represented by a mathematical model based on imprecise probabilities. In this paper, we present algorithms to obtain the maximum entropy value when the information available is represented by a new model based on imprecise probabilities: the nonparametric predictive inference model for multinomial data (NPI-M), which represents a type of entropy-linear program. To reduce the complexity of the model, we prove that the NPI-M lower and upper probabilities for any general event can be expressed as a combination of the lower and upper probabilities for the singleton events, and that this model can not be associated with a closed polyhedral set of probabilities. An algorithm to obtain the maximum entropy probability distribution on the set associated with NPI-M is presented. We also consider a model which uses the closed and convex set of probability distributions generated by the NPI-M singleton probabilities, a closed polyhedral set. We call this model A-NPI-M. A-NPI-M can be seen as an approximation of NPI-M, this approximation being simpler to use because it is not necessary to consider the set of constraints associated with the exact model.

Suggested Citation

  • Abellán, Joaquín & Baker, Rebecca M. & Coolen, Frank P.A., 2011. "Maximising entropy on the nonparametric predictive inference model for multinomial data," European Journal of Operational Research, Elsevier, vol. 212(1), pages 112-122, July.
    • Handle: RePEc:eee:ejores:v:212:y:2011:i:1:p:112-122
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(11)00048-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chateauneuf, Alain & Jaffray, Jean-Yves, 1989. "Some characterizations of lower probabilities and other monotone capacities through the use of Mobius inversion," Mathematical Social Sciences, Elsevier, vol. 17(3), pages 263-283, June.
    2. Abellán, Joaquín & Masegosa, Andrés R., 2010. "An ensemble method using credal decision trees," European Journal of Operational Research, Elsevier, vol. 205(1), pages 218-226, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Houlding, B. & Coolen, F.P.A., 2012. "Nonparametric predictive utility inference," European Journal of Operational Research, Elsevier, vol. 221(1), pages 222-230.
    2. Frank PA Coolen & Tahani Coolen-Maturi & Abdullah H Al-nefaiee, 2014. "Nonparametric predictive inference for system reliability using the survival signature," Journal of Risk and Reliability, , vol. 228(5), pages 437-448, October.
    3. Abellán, Joaquín & Baker, Rebecca M. & Coolen, Frank P.A. & Crossman, Richard J. & Masegosa, Andrés R., 2014. "Classification with decision trees from a nonparametric predictive inference perspective," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 789-802.
    4. Aboalkhair, Ahmad M. & Coolen, Frank P.A. & MacPhee, Iain M., 2013. "Nonparametric predictive reliability of series of voting systems," European Journal of Operational Research, Elsevier, vol. 226(1), pages 77-84.
    5. Fernández, Arturo J., 2012. "Minimizing the area of a Pareto confidence region," European Journal of Operational Research, Elsevier, vol. 221(1), pages 205-212.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grabisch, Michel & Kojadinovic, Ivan & Meyer, Patrick, 2008. "A review of methods for capacity identification in Choquet integral based multi-attribute utility theory: Applications of the Kappalab R package," European Journal of Operational Research, Elsevier, vol. 186(2), pages 766-785, April.
    2. Gajdos, T. & Hayashi, T. & Tallon, J.-M. & Vergnaud, J.-C., 2008. "Attitude toward imprecise information," Journal of Economic Theory, Elsevier, vol. 140(1), pages 27-65, May.
    3. Michèle Cohen & Alain Chateauneuf & Eric Danan & Thibault Gajdos & Raphaël Giraud & Meglena Jeleva & Fabrice Philippe & Jean-Marc Tallon & Jean-Christophe Vergnaud, 2011. "Tribute to Jean-Yves Jaffray," Theory and Decision, Springer, vol. 71(1), pages 1-10, July.
    4. Fujimoto, Katsushige & Kojadinovic, Ivan & Marichal, Jean-Luc, 2006. "Axiomatic characterizations of probabilistic and cardinal-probabilistic interaction indices," Games and Economic Behavior, Elsevier, vol. 55(1), pages 72-99, April.
    5. Yehuda Izhakian, 2012. "Ambiguity Measurement," Working Papers 12-01, New York University, Leonard N. Stern School of Business, Department of Economics.
    6. Grabisch, Michel & Labreuche, Christophe & Vansnick, Jean-Claude, 2003. "On the extension of pseudo-Boolean functions for the aggregation of interacting criteria," European Journal of Operational Research, Elsevier, vol. 148(1), pages 28-47, July.
    7. Chikalov, Igor & Hussain, Shahid & Moshkov, Mikhail, 2018. "Bi-criteria optimization of decision trees with applications to data analysis," European Journal of Operational Research, Elsevier, vol. 266(2), pages 689-701.
    8. Gong, Zaiwu & Guo, Weiwei & Słowiński, Roman, 2021. "Transaction and interaction behavior-based consensus model and its application to optimal carbon emission reduction," Omega, Elsevier, vol. 104(C).
    9. Brice Mayag & Michel Grabisch & Christophe Labreuche, 2009. "A characterization of the 2-additive Choquet integral through cardinal information," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00445132, HAL.
    10. Miranda, Pedro & Grabisch, Michel, 2010. "k-Balanced games and capacities," European Journal of Operational Research, Elsevier, vol. 200(2), pages 465-472, January.
    11. Pereira, Miguel Alves & Figueira, José Rui & Marques, Rui Cunha, 2020. "Using a Choquet integral-based approach for incorporating decision-maker’s preference judgments in a Data Envelopment Analysis model," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1016-1030.
    12. Klaus Nehring, 2003. "Preference for Flexibility and Freedom of Choice in a Savage Framework," Working Papers 51, University of California, Davis, Department of Economics.
    13. Takao Asano & Hiroyuki Kojima, 2022. "Choquet Integrals and Belief Functions," KIER Working Papers 1077, Kyoto University, Institute of Economic Research.
    14. Alain Chateauneuf & Thibault Gajdos & Jean-Yves Jaffray, 2011. "Regular updating," Theory and Decision, Springer, vol. 71(1), pages 111-128, July.
    15. Michel Grabisch, 2015. "Bases and transforms of set functions," Post-Print halshs-01169287, HAL.
    16. Takao Asano & Hiroyuki Kojima, 2013. "An Axiomatization of Choquet Expected Utility with Cominimum Independence," KIER Working Papers 878, Kyoto University, Institute of Economic Research.
    17. Peter Wakker, 2011. "Jaffray’s ideas on ambiguity," Theory and Decision, Springer, vol. 71(1), pages 11-22, July.
    18. Hamed Hamze Bajgiran & Federico Echenique, 2022. "Closure operators: Complexity and applications to classification and decision-making," Papers 2202.05339, arXiv.org, revised May 2022.
    19. Kojadinovic, Ivan, 2007. "Minimum variance capacity identification," European Journal of Operational Research, Elsevier, vol. 177(1), pages 498-514, February.
    20. Cang, Shuang & Yu, Hongnian, 2014. "A combination selection algorithm on forecasting," European Journal of Operational Research, Elsevier, vol. 234(1), pages 127-139.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:212:y:2011:i:1:p:112-122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.