IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v473y2024ics0096300324001103.html
   My bibliography  Save this article

Matrix norm based hybrid Shapley and iterative methods for the solution of stochastic matrix games

Author

Listed:
  • İzgi, Burhaneddin
  • Özkaya, Murat
  • Üre, Nazım Kemal
  • Perc, Matjaž

Abstract

In this paper, we present four alternative solution methods to Shapley iteration for the solution of stochastic matrix games. We first combine the extended matrix norm method for stochastic matrix games with Shapley iteration and then state and prove the weak and strong hybrid versions of Shapley iterations. Then, we present the semi-extended matrix norm and iterative semi-extended matrix norm methods, which are analytic-solution-free methods, for finding the approximate solution of stochastic matrix games without determining the strategy sets. We illustrate comparisons between the Shapley iteration, weak and strong hybrid Shapley iterations, semi-extended matrix norm method, and iterative semi-extended matrix norm method with several examples. The results reveal that the strong and weak hybrid Shapley iterations improve the Shapley iteration and decrease the number of iterations, and the strong hybrid Shapley iteration outperforms all the other proposed methods. Finally, we compare these methods and present their performance analyses for large-scale stochastic matrix games as well.

Suggested Citation

  • İzgi, Burhaneddin & Özkaya, Murat & Üre, Nazım Kemal & Perc, Matjaž, 2024. "Matrix norm based hybrid Shapley and iterative methods for the solution of stochastic matrix games," Applied Mathematics and Computation, Elsevier, vol. 473(C).
    • Handle: RePEc:eee:apmaco:v:473:y:2024:i:c:s0096300324001103
    DOI: 10.1016/j.amc.2024.128638
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300324001103
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.amc.2024.128638?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. O. G. Haywood, 1954. "Military Decision and Game Theory," Operations Research, INFORMS, vol. 2(4), pages 365-385, November.
    2. Neyman, Abraham, 2017. "Continuous-time stochastic games," Games and Economic Behavior, Elsevier, vol. 104(C), pages 92-130.
    3. Ishii, Masahiro & Lee, Paul Tae-Woo & Tezuka, Koichiro & Chang, Young-Tae, 2013. "A game theoretical analysis of port competition," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 49(1), pages 92-106.
    4. Chen, Fang & Guo, Xianping, 2023. "Two-person zero-sum risk-sensitive stochastic games with incomplete reward information on one side," Stochastic Processes and their Applications, Elsevier, vol. 165(C), pages 218-245.
    5. Andrés Perea & Arkadi Predtetchinski, 2019. "An epistemic approach to stochastic games," International Journal of Game Theory, Springer;Game Theory Society, vol. 48(1), pages 181-203, March.
    6. AMIR, Rabah, 2001. "Stochastic games in economics and related fields: an overview," LIDAM Discussion Papers CORE 2001060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. İzgi, Burhaneddin & Özkaya, Murat & Üre, Nazım Kemal & Perc, Matjaž, 2023. "Extended matrix norm method: Applications to bimatrix games and convergence results," Applied Mathematics and Computation, Elsevier, vol. 438(C).
    8. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    9. Jerzy A. Filar & T. E. S. Raghavan, 1984. "A Matrix Game Solution of the Single-Controller Stochastic Game," Mathematics of Operations Research, INFORMS, vol. 9(3), pages 356-362, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. İzgi, Burhaneddin & Kocken, Hale Gonce & Özkaya, Murat, 2024. "Matrix norm methods for zero-sum fuzzy matrix games with payoffs of triangular fuzzy numbers," Applied Mathematics and Computation, Elsevier, vol. 479(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    2. İzgi, Burhaneddin & Kocken, Hale Gonce & Özkaya, Murat, 2024. "Matrix norm methods for zero-sum fuzzy matrix games with payoffs of triangular fuzzy numbers," Applied Mathematics and Computation, Elsevier, vol. 479(C).
    3. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    4. Mongin, Philippe, 2007. "Une étude d'histoire militaire instruite par la Théorie des jeux et quelques amplifications Méthodologiques," HEC Research Papers Series 866, HEC Paris.
    5. Wang, Xinchang & Meng, Qiang & Miao, Lixin, 2016. "Delimiting port hinterlands based on intermodal network flows: Model and algorithm," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 88(C), pages 32-51.
    6. Yehuda Levy, 2013. "Continuous-Time Stochastic Games of Fixed Duration," Dynamic Games and Applications, Springer, vol. 3(2), pages 279-312, June.
    7. Yeo, Gi-Tae & Pak, Ji-Yeong & Yang, Zaili, 2013. "Analysis of dynamic effects on seaports adopting port security policy," Transportation Research Part A: Policy and Practice, Elsevier, vol. 49(C), pages 285-301.
    8. Yevgeny Tsodikovich & Xavier Venel & Anna Zseleva, 2021. "Repeated Games with Switching Costs: Stationary vs History-Independent Strategies," Working Papers halshs-03223279, HAL.
    9. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    10. Arkajyoti De & Surya Prakash Singh, 2022. "Analysis of Competitiveness in Agri-Supply Chain Logistics Outsourcing: A B2B Contractual Framework," Sustainability, MDPI, vol. 14(11), pages 1-33, June.
    11. Yevgeny Tsodikovich & Xavier Venel & Anna Zseleva, 2021. "Repeated Games with Switching Costs: Stationary vs History Independent Strategies," Papers 2103.00045, arXiv.org, revised Oct 2021.
    12. Piotr Szajowski, 2006. "Constructions of Nash Equilibria in Stochastic Games of Resource Extraction with Additive Transition Structure," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 63(2), pages 239-260, May.
    13. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    14. Nowak, Andrzej S., 2008. "Equilibrium in a dynamic game of capital accumulation with the overtaking criterion," Economics Letters, Elsevier, vol. 99(2), pages 233-237, May.
    15. Frank H. Page & Myrna H. Wooders, 2009. "Endogenous Network Dynamics," Working Papers 2009.28, Fondazione Eni Enrico Mattei.
    16. Yurii Averboukh, 2017. "Extremal Shift Rule for Continuous-Time Zero-Sum Markov Games," Dynamic Games and Applications, Springer, vol. 7(1), pages 1-20, March.
    17. Gang Dong & Dandan Zhong, 2019. "Tacit Collusion of Pricing Strategy Game between Regional Ports: The Case of Yangtze River Economic Belt," Sustainability, MDPI, vol. 11(2), pages 1-17, January.
    18. Chen, Hsiao-Chi & Liu, Shi-Miin, 2024. "Optimal investments of port authorities facing ambiguity on uncertain market demands," Transportation Research Part B: Methodological, Elsevier, vol. 179(C).
    19. Vernasca, Gianluigi, 2003. "Dynamic Price Competition With Price Adjustment Costs And Product Differentiation," The Warwick Economics Research Paper Series (TWERPS) 681, University of Warwick, Department of Economics.
    20. Boucekkine, Raouf & Fabbri, Giorgio & Federico, Salvatore & Gozzi, Fausto, 2022. "A dynamic theory of spatial externalities," Games and Economic Behavior, Elsevier, vol. 132(C), pages 133-165.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:473:y:2024:i:c:s0096300324001103. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.