IDEAS home Printed from https://ideas.repec.org/a/spr/jogath/v42y2013i1p239-262.html
   My bibliography  Save this article

Cooperative Markov decision processes: time consistency, greedy players satisfaction, and cooperation maintenance

Author

Listed:
  • Konstantin Avrachenkov
  • Laura Cottatellucci
  • Lorenzo Maggi

Abstract

We deal with multi-agent Markov decision processes (MDPs) in which cooperation among players is allowed. We find a cooperative payoff distribution procedure (MDP-CPDP) that distributes in the course of the game the payoff that players would earn in the long run game. We show under which conditions such a MDP-CPDP fulfills a time consistency property, contents greedy players, and strengthen the coalition cohesiveness throughout the game. Finally we refine the concept of Core for Cooperative MDPs. Copyright Springer-Verlag 2013

Suggested Citation

  • Konstantin Avrachenkov & Laura Cottatellucci & Lorenzo Maggi, 2013. "Cooperative Markov decision processes: time consistency, greedy players satisfaction, and cooperation maintenance," International Journal of Game Theory, Springer;Game Theory Society, vol. 42(1), pages 239-262, February.
    • Handle: RePEc:spr:jogath:v:42:y:2013:i:1:p:239-262
    DOI: 10.1007/s00182-012-0343-9
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00182-012-0343-9
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00182-012-0343-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Predtetchinski, Arkadi, 2007. "The strong sequential core for stationary cooperative games," Games and Economic Behavior, Elsevier, vol. 61(1), pages 50-66, October.
    2. Oviedo, Jorge, 2000. "The core of a repeated n-person cooperative game," European Journal of Operational Research, Elsevier, vol. 127(3), pages 519-524, December.
    3. Jerzy A. Filar & Leon A. Petrosjan, 2000. "Dynamic Cooperative Games," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 2(01), pages 47-65.
    4. Laurence Kranich & Andres Perea & Hans Peters, 2000. "Dynamic Cooperative Games," Discussion Papers 00-06, University at Albany, SUNY, Department of Economics.
    5. Mazalov, V.V. & Rettieva, A.N., 2010. "Fish wars and cooperation maintenance," Ecological Modelling, Elsevier, vol. 221(12), pages 1545-1553.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chander, Parkash & Wooders, Myrna, 2020. "Subgame-perfect cooperation in an extensive game," Journal of Economic Theory, Elsevier, vol. 187(C).
    2. Gonzalez, Stéphane & Rostom, Fatma Zahra, 2022. "Sharing the global outcomes of finite natural resource exploitation: A dynamic coalitional stability perspective," Mathematical Social Sciences, Elsevier, vol. 119(C), pages 1-10.
    3. Elena Parilina & Leon Petrosyan, 2020. "On a Simplified Method of Defining Characteristic Function in Stochastic Games," Mathematics, MDPI, vol. 8(7), pages 1-14, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ziv Hellman, 2009. "Bargaining Set Solution Concepts in Repeated Cooperative Games," Discussion Paper Series dp523, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    2. Hellman, Ziv, 2008. "Bargaining Set Solution Concepts in Dynamic Cooperative Games," MPRA Paper 8798, University Library of Munich, Germany.
    3. Jean-François Caulier & Michel Grabisch & Agnieszka Rusinowska, 2015. "An allocation rule for dynamic random network formation processes," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 60(2), pages 283-313, October.
    4. Berden, C., 2007. "The role of individual intertemporal transfers in dynamic TU-Games," Research Memorandum 030, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    5. Ehud Lehrer & Marco Scarsini, 2013. "On the Core of Dynamic Cooperative Games," Dynamic Games and Applications, Springer, vol. 3(3), pages 359-373, September.
    6. Berden, Caroline & Peters, Hans & Robles, Laura & Vermeulen, Dries, 2022. "Strategic transfers between cooperative games," Games and Economic Behavior, Elsevier, vol. 133(C), pages 77-84.
    7. Konstantin Avrachenkov & Laura Cottatellucci & Lorenzo Maggi, 2014. "Confidence Intervals for the Shapley–Shubik Power Index in Markovian Games," Dynamic Games and Applications, Springer, vol. 4(1), pages 10-31, March.
    8. repec:hal:pseose:halshs-01207823 is not listed on IDEAS
    9. Németh, Tibor & Pintér, Miklós, 2017. "The non-emptiness of the weak sequential core of a transferable utility game with uncertainty," Journal of Mathematical Economics, Elsevier, vol. 69(C), pages 1-6.
    10. Casajus, André & Kramm, Michael & Wiese, Harald, 2020. "Asymptotic stability in the Lovász-Shapley replicator dynamic for cooperative games," Journal of Economic Theory, Elsevier, vol. 186(C).
    11. Habis, Helga & Herings, P. Jean-Jacques, 2011. "Transferable utility games with uncertainty," Journal of Economic Theory, Elsevier, vol. 146(5), pages 2126-2139, September.
    12. Besner, Manfred, 2022. "The grand surplus value and repeated cooperative cross-games with coalitional collaboration," Journal of Mathematical Economics, Elsevier, vol. 102(C).
    13. Predtetchinski, Arkadi & Herings, P. Jean-Jacques & Peters, Hans, 2002. "The strong sequential core for two-period economies," Journal of Mathematical Economics, Elsevier, vol. 38(4), pages 465-482, December.
    14. D. Bauso & J. Timmer, 2009. "Robust dynamic cooperative games," International Journal of Game Theory, Springer;Game Theory Society, vol. 38(1), pages 23-36, March.
    15. Casas, Omar J. & Romera, Rosario, 2009. "Controlling the international stock pollutant with policies depending on target values," DES - Working Papers. Statistics and Econometrics. WS ws096019, Universidad Carlos III de Madrid. Departamento de Estadística.
    16. Beard, Rodney & McDonald, Stuart, 2005. "Dynamic Recontracting of Water Rights," 2005 Conference (49th), February 9-11, 2005, Coff's Harbour, Australia 137781, Australian Agricultural and Resource Economics Society.
    17. Anna N. Rettieva, 2022. "Dynamic multicriteria games with asymmetric players," Journal of Global Optimization, Springer, vol. 83(3), pages 521-537, July.
    18. Predtetchinski, Arkadi, 2007. "The strong sequential core for stationary cooperative games," Games and Economic Behavior, Elsevier, vol. 61(1), pages 50-66, October.
    19. Laszlo A. Koczy, 2019. "The risk-based core for cooperative games with uncertainty," CERS-IE WORKING PAPERS 1906, Institute of Economics, Centre for Economic and Regional Studies.
    20. Routledge R. R., 2012. "On Communication and the Weak Sequential Core," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-22, September.
    21. Marc Germain & Philippe Toint & Henry Tulkens & Aart Zeeuw, 2006. "Transfers to Sustain Dynamic Core-Theoretic Cooperation in International Stock Pollutant Control," Springer Books, in: Parkash Chander & Jacques Drèze & C. Knox Lovell & Jack Mintz (ed.), Public goods, environmental externalities and fiscal competition, chapter 0, pages 251-274, Springer.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jogath:v:42:y:2013:i:1:p:239-262. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.