IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i21p3321-d1504926.html
   My bibliography  Save this article

Context-Dependent Criteria for Dirichlet Process in Sequential Decision-Making Problems

Author

Listed:
  • Ksenia Kasianova

    (Faculty of Economic Sciences, National Research University Higher School of Economics, Myasnitskaya St. 20, 101000 Moscow, Russia)

  • Mark Kelbert

    (Faculty of Economic Sciences, National Research University Higher School of Economics, Myasnitskaya St. 20, 101000 Moscow, Russia)

Abstract

In models with insufficient initial information, parameter estimation can be subject to statistical uncertainty, potentially resulting in suboptimal decision-making; however, delaying implementation to gather more information can also incur costs. This paper examines an extension of information-theoretic approaches designed to address this classical dilemma, focusing on balancing the expected profits and the information needed to be obtained about all of the possible outcomes. Initially utilized in binary outcome scenarios, these methods leverage information measures to harmonize competing objectives efficiently. Building upon the foundations laid by existing research, this methodology is expanded to encompass experiments with multiple outcome categories using Dirichlet processes. The core of our approach is centered around weighted entropy measures, particularly in scenarios dictated by Dirichlet distributions, which have not been extensively explored previously. We innovatively adapt the technique initially applied to binary case to Dirichlet distributions/processes. The primary contribution of our work is the formulation of a sequential minimization strategy for the main term of an asymptotic expansion of differential entropy, which scales with sample size, for non-binary outcomes. This paper provides a theoretical grounding, extended empirical applications, and comprehensive proofs, setting a robust framework for further interdisciplinary applications of information-theoretic paradigms in sequential decision-making.

Suggested Citation

  • Ksenia Kasianova & Mark Kelbert, 2024. "Context-Dependent Criteria for Dirichlet Process in Sequential Decision-Making Problems," Mathematics, MDPI, vol. 12(21), pages 1-21, October.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3321-:d:1504926
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/21/3321/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/21/3321/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3321-:d:1504926. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.