IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v317y2024i3p1003-1014.html
   My bibliography  Save this article

Reward function design method to achieve system-level objectives in ambulance diversion problem

Author

Listed:
  • Lee, Hyun-Rok
  • Lee, Taesik

Abstract

This study addresses a reward function design problem in multi-agent systems, using ambulance diversion (AD) problem in emergency medical services (EMS) as an application. While Emergency Departments (EDs) may declare AD to alleviate overcrowding, excessive use of this strategy by individual EDs can have negative consequences, such as limited access and delayed care for emergency patients. To eliminate negative consequences caused by individual decisions, we propose a reward function design method to align individual agents’ decisions with socially optimal strategies. This method ensures that an equilibrium status is achieved under socially optimal operation by removing incentives for deviations from socially optimal behavior while maximizing system welfare without extra investment. The proposed method offers an exact solution for designing reward function of a stochastic game model with finite state and action spaces. We conduct numerical experiments for a 2-ED system and demonstrate that the designed reward function properly guides the EDs toward a socially optimal AD strategy.

Suggested Citation

  • Lee, Hyun-Rok & Lee, Taesik, 2024. "Reward function design method to achieve system-level objectives in ambulance diversion problem," European Journal of Operational Research, Elsevier, vol. 317(3), pages 1003-1014.
    • Handle: RePEc:eee:ejores:v:317:y:2024:i:3:p:1003-1014
    DOI: 10.1016/j.ejor.2024.04.033
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724003321
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2024.04.033?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sarang Deo & Itai Gurvich, 2011. "Centralized vs. Decentralized Ambulance Diversion: A Network Perspective," Management Science, INFORMS, vol. 57(7), pages 1300-1319, July.
    2. Ramirez-Nafarrate, Adrian & Baykal Hafizoglu, A. & Gel, Esma S. & Fowler, John W., 2014. "Optimal control policies for ambulance diversion," European Journal of Operational Research, Elsevier, vol. 236(1), pages 298-312.
    3. Yimin Yu & Saif Benjaafar & Yigal Gerchak, 2015. "Capacity Sharing and Cost Allocation among Independent Firms with Congestion," Production and Operations Management, Production and Operations Management Society, vol. 24(8), pages 1285-1310, August.
    4. Kuang Xu & Carri W. Chan, 2016. "Using Future Information to Reduce Waiting Times in the Emergency Department via Diversion," Manufacturing & Service Operations Management, INFORMS, vol. 18(3), pages 314-331, July.
    5. Paula González & Carmen Herrero, 2004. "Optimal sharing of surgical costs in the presence of queues," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 59(3), pages 435-446, July.
    6. Frank Karsten & Marco Slikker & Geert-Jan van Houtum, 2015. "Resource Pooling and Cost Allocation Among Independent Service Providers," Operations Research, INFORMS, vol. 63(2), pages 476-488, April.
    7. Pradeep Dubey, 1986. "Inefficiency of Nash Equilibria," Mathematics of Operations Research, INFORMS, vol. 11(1), pages 1-8, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hyun-Rok Lee & Taesik Lee, 2018. "Markov decision process model for patient admission decision at an emergency department under a surge demand," Flexible Services and Manufacturing Journal, Springer, vol. 30(1), pages 98-122, June.
    2. Siddharth Prakash Singh & Mohammad Delasay & Alan Scheller‐Wolf, 2023. "Real‐time delay announcement under competition," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 863-881, March.
    3. Hung T. Do & Masha Shunko, 2020. "Constrained Load-Balancing Policies for Parallel Single-Server Queue Systems," Management Science, INFORMS, vol. 66(8), pages 3501-3527, August.
    4. Frank Karsten & Marco Slikker & Geert-Jan van Houtum, 2015. "Resource Pooling and Cost Allocation Among Independent Service Providers," Operations Research, INFORMS, vol. 63(2), pages 476-488, April.
    5. Mengyu Li & Peter Vanberkel & Alix J. E. Carter, 2019. "A review on ambulance offload delay literature," Health Care Management Science, Springer, vol. 22(4), pages 658-675, December.
    6. Bendel, Dan & Haviv, Moshe, 2018. "Cooperation and sharing costs in a tandem queueing network," European Journal of Operational Research, Elsevier, vol. 271(3), pages 926-933.
    7. Shuo Zeng & Moshe Dror, 2019. "Serving many masters: an agent and his principals," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 90(1), pages 23-59, August.
    8. Luo, Chunlin & Zhou, Xiaoyang & Lev, Benjamin, 2022. "Core, shapley value, nucleolus and nash bargaining solution: A Survey of recent developments and applications in operations management," Omega, Elsevier, vol. 110(C).
    9. Martin Shubik, 1980. "Perfect or Robust Noncooperative Equilibrium: A Search for the Philosophers Stone?," Cowles Foundation Discussion Papers 559, Cowles Foundation for Research in Economics, Yale University.
    10. Pak, Anton & Gannon, Brenda & Staib, Andrew, 2020. "Forecasting Waiting Time to Treatment for Emergency Department Patients," OSF Preprints d25se, Center for Open Science.
    11. Judith Timmer & Werner Scheinhardt, 2018. "Customer and Cost Sharing in a Jackson Network," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 20(03), pages 1-10, September.
    12. Di Feng & Bettina Klaus, 2022. "Preference revelation games and strict cores of multiple‐type housing market problems," International Journal of Economic Theory, The International Society for Economic Theory, vol. 18(1), pages 61-76, March.
    13. Goyal, Sanjeev & Heidari, Hoda & Kearns, Michael, 2019. "Competitive contagion in networks," Games and Economic Behavior, Elsevier, vol. 113(C), pages 58-79.
    14. Daozhi Zhao & Jiaqin Hao & Cejun Cao & Hongshuai Han, 2019. "Evolutionary Game Analysis of Three-Player for Low-Carbon Production Capacity Sharing," Sustainability, MDPI, vol. 11(11), pages 1-20, May.
    15. Parlakturk, Ali & Kumar, Sunil, 2004. "Self-Interested Routing in Queueing Networks," Research Papers 1782r, Stanford University, Graduate School of Business.
    16. Niyirora, Jerome & Zhuang, Jun, 2017. "Fluid approximations and control of queues in emergency departments," European Journal of Operational Research, Elsevier, vol. 261(3), pages 1110-1124.
    17. Raimondo, Roberto, 2020. "Pathwise smooth splittable congestion games and inefficiency," Journal of Mathematical Economics, Elsevier, vol. 86(C), pages 15-23.
    18. Palsule-Desai, Omkar D., 2015. "Cooperatives for fruits and vegetables in emerging countries: Rationalization and impact of decentralization," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 81(C), pages 114-140.
    19. Haizhen Mou, 2012. "The political economy of public health expenditure and wait times in a public‐private mixed health care system," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 45(4), pages 1640-1666, November.
    20. Panayides, Michalis & Knight, Vince & Harper, Paul, 2023. "A game theoretic model of the behavioural gaming that takes place at the EMS - ED interface," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1236-1258.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:317:y:2024:i:3:p:1003-1014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.