IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v315y2024i2p764-776.html
   My bibliography  Save this article

An incentive compatible ZD strategy-based data sharing model for federated learning: A perspective of iterated prisoner's dilemma

Author

Listed:
  • Jie, Yingmo
  • Liu, Charles Zhechao
  • Choo, Kim-Kwang Raymond
  • Guo, Cheng

Abstract

Federated learning has been increasingly adopted as an effective means to cope with the significant increase in the volume of training data needed for machine learning and address the privacy concerns in using these data. However, moral hazard may occur when individual data providers (IDPs) use smaller amounts or low-quality data to train their local models and submit these low-quality results (gradients) to free-ride on the benefits of the federated learning. Therefore, federated learning operators often face the dilemma of encouraging more IDPs to participate in data sharing and ensuring truthful contributions from IDPs to obtain high-quality global training results. This article proposes a spontaneous cooperative data-sharing model to address this dilemma. Through an iterated prisoner's dilemma model solved by the zero-determinant (ZD) strategy, we show that the optimal ZD strategies of all IDPs are to maximize their training efforts when participating in federated learning. According to the comparisons with other approaches through simulations, we demonstrate that either the two-IDP with binary strategies case or the multi-IDP with continuous strategies case could result in the optimal individual utility and social welfare. Therefore, the proposed spontaneous cooperative model effectively avoids the existing moral hazard problem in federated learning and provides a viable instrument for the federated learning operator to maximize the performance of the global model without the need to evaluate the quality of local gradients.

Suggested Citation

  • Jie, Yingmo & Liu, Charles Zhechao & Choo, Kim-Kwang Raymond & Guo, Cheng, 2024. "An incentive compatible ZD strategy-based data sharing model for federated learning: A perspective of iterated prisoner's dilemma," European Journal of Operational Research, Elsevier, vol. 315(2), pages 764-776.
  • Handle: RePEc:eee:ejores:v:315:y:2024:i:2:p:764-776
    DOI: 10.1016/j.ejor.2023.12.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221723009463
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2023.12.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Yung-Ming & Jhang-Li, Jhih-Hua, 2010. "Knowledge sharing in communities of practice: A game theoretic analysis," European Journal of Operational Research, Elsevier, vol. 207(2), pages 1052-1064, December.
    2. Christoph Adami & Arend Hintze, 2013. "Evolutionary instability of zero-determinant strategies demonstrates that winning is not everything," Nature Communications, Nature, vol. 4(1), pages 1-8, October.
    3. repec:cla:levarc:786969000000001297 is not listed on IDEAS
    4. Liang, Yong & Sun, Peng & Tang, Runyu & Zhang, Chong, 2023. "Efficient resource allocation contracts to reduce adverse events," Other publications TiSEM 0bcf44d9-d0ac-4231-beaf-8, Tilburg University, School of Economics and Management.
    5. Yoshihara, Rikuo & Matsubayashi, Nobuo, 2021. "Channel coordination between manufacturers and competing retailers with fairness concerns," European Journal of Operational Research, Elsevier, vol. 290(2), pages 546-555.
    6. Anil Aswani & Zuo-Jun Max Shen & Auyon Siddiq, 2019. "Data-Driven Incentive Design in the Medicare Shared Savings Program," Operations Research, INFORMS, vol. 67(4), pages 1002-1026, July.
    7. Yang, Rui & Tang, Wansheng & Zhang, Jianxiong, 2021. "Technology improvement strategy for green products under competition: The role of government subsidy," European Journal of Operational Research, Elsevier, vol. 289(2), pages 553-568.
    8. Zhijian Wang & Yanran Zhou & Jaimie W. Lien & Jie Zheng & Bin Xu, 2016. "Extortion Can Outperform Generosity in the Iterated Prisoners' Dilemma," Levine's Bibliography 786969000000001297, UCLA Department of Economics.
    9. Zhang, Shuguang & Dan, Bin & Zhou, Maosen, 2019. "After-sale service deployment and information sharing in a supply chain under demand uncertainty," European Journal of Operational Research, Elsevier, vol. 279(2), pages 351-363.
    10. Zhijian Wang & Yanran Zhou & Jaimie W. Lien & Jie Zheng & Bin Xu, 2016. "Extortion can outperform generosity in the iterated prisoner’s dilemma," Nature Communications, Nature, vol. 7(1), pages 1-7, September.
    11. J. Augustine & Ning Chen & Edith Elkind & Angelo Fanelli & Nick Gravin & Dmitry Shiryaev, 2015. "Dynamics of profit- sharing games," Post-Print hal-01103929, HAL.
    12. Mishra, Debasis & Veeramani, Dharmaraj, 2007. "Vickrey-Dutch procurement auction for multiple items," European Journal of Operational Research, Elsevier, vol. 180(2), pages 617-629, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xu, Wei & Li, Dandan & Han, Dun & Sun, Mei, 2024. "The impact of relationship stickiness and memory on the evolution of individual behavior," Chaos, Solitons & Fractals, Elsevier, vol. 183(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kang, Kai & Tian, Jinyan & Zhang, Boyu, 2024. "Cooperation and control in asymmetric repeated games," Applied Mathematics and Computation, Elsevier, vol. 470(C).
    2. Masahiko Ueda & Toshiyuki Tanaka, 2020. "Linear algebraic structure of zero-determinant strategies in repeated games," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-13, April.
    3. Ding, Shasha & Sun, Hao & Sun, Panfei & Han, Weibin, 2022. "Dynamic outcome of coopetition duopoly with implicit collusion," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    4. Masahiko Ueda, 2022. "Controlling Conditional Expectations by Zero-Determinant Strategies," SN Operations Research Forum, Springer, vol. 3(3), pages 1-22, September.
    5. Taha, Mohammad A. & Ghoneim, Ayman, 2021. "Zero-determinant strategies in infinitely repeated three-player prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    6. Taha, Mohammad A. & Ghoneim, Ayman, 2020. "Zero-determinant strategies in repeated asymmetric games," Applied Mathematics and Computation, Elsevier, vol. 369(C).
    7. McAvoy, Alex & Hauert, Christoph, 2017. "Autocratic strategies for alternating games," Theoretical Population Biology, Elsevier, vol. 113(C), pages 13-22.
    8. Xiaofeng Xu & Xiangyu Chen & Yi Xu & Tao Wang & Yifan Zhang, 2022. "Improving the Innovative Performance of Renewable Energy Enterprises in China: Effects of Subsidy Policy and Intellectual Property Legislation," Sustainability, MDPI, vol. 14(13), pages 1-24, July.
    9. Li, Lin & Li, Guo, 2023. "Integrating logistics service or not? The role of platform entry strategy in an online marketplace," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 170(C).
    10. Marc Harper & Vincent Knight & Martin Jones & Georgios Koutsovoulos & Nikoleta E Glynatsi & Owen Campbell, 2017. "Reinforcement learning produces dominant strategies for the Iterated Prisoner’s Dilemma," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-33, December.
    11. Qin, Xuelian & Liu, Zhixue & Tian, Lin, 2021. "The optimal combination between selling mode and logistics service strategy in an e-commerce market," European Journal of Operational Research, Elsevier, vol. 289(2), pages 639-651.
    12. Christopher Lee & Marc Harper & Dashiell Fryer, 2015. "The Art of War: Beyond Memory-one Strategies in Population Games," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-16, March.
    13. Fang, Lei & Zhao, Sai, 2023. "On the green subsidies in a differentiated market," International Journal of Production Economics, Elsevier, vol. 257(C).
    14. Rami S. Al-Gharaibeh & Mostafa Z. Ali, 2022. "Knowledge Sharing Framework: a Game-Theoretic Approach," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(1), pages 332-366, March.
    15. Wang, Jian & Zhu, Wenbo, 2023. "Analyzing the development of competition and cooperation among ocean carriers considering the impact of carbon tax policy," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 175(C).
    16. Wang, Kai & Zeng, Hao & Yuan, Yue & Zhang, Chong & Liu, Lu, 2022. "Green or non-green: A game to introduce decision making under fairness concerns," Technological Forecasting and Social Change, Elsevier, vol. 185(C).
    17. Liang Ma & Weiqiang Hu & Ru Liang, 2024. "The Impact of the Industrial Internet on the Innovation and Development Level of China’s Manufacturing Industry: Under the Perspective of Government Incentives," Sustainability, MDPI, vol. 16(10), pages 1-25, May.
    18. Yan Ma & Susu Cheng, 2023. "Channel coordination in a closed‐loop supply chain with fairness concerns under further extended producer responsibility," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(2), pages 876-891, March.
    19. Xia, Lulu & Li, Kai & Fu, Hong, 2024. "Bargaining in mobile app supply chain considering members’ fairness concern attitudes," International Journal of Production Economics, Elsevier, vol. 270(C).
    20. Amnon Rapoport & Darryl A Seale & Andrew M Colman, 2015. "Is Tit-for-Tat the Answer? On the Conclusions Drawn from Axelrod's Tournaments," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-11, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:315:y:2024:i:2:p:764-776. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.