IDEAS home Printed from https://ideas.repec.org/a/kap/hcarem/v27y2024i3d10.1007_s10729-024-09676-5.html
   My bibliography  Save this article

Dissatisfaction-considered waiting time prediction for outpatients with interpretable machine learning

Author

Listed:
  • Jongkyung Shin

    (Ulsan National Institute of Science and Technology)

  • Donggi Augustine Lee

    (Microsoft Korea)

  • Juram Kim

    (Korea Institute of Science and Technology Information)

  • Chiehyeon Lim

    (Ulsan National Institute of Science and Technology)

  • Byung-Kwan Choi

    (Pusan National University Hospital)

Abstract

Long waiting time in outpatient departments is a crucial factor in patient dissatisfaction. We aim to analytically interpret the waiting times predicted by machine learning models and provide patients with an explanation of the expected waiting time. Here, underestimating waiting times can cause patient dissatisfaction, so preventing this in predictive models is necessary. To address this issue, we propose a framework considering dissatisfaction for estimating the waiting time in an outpatient department. In our framework, we leverage asymmetric loss functions to ensure robustness against underestimation. We also propose a dissatisfaction-aware asymmetric error score (DAES) to determine an appropriate model by considering the trade-off between underestimation and accuracy. Finally, Shapley additive explanation (SHAP) is applied to interpret the relationship trained by the model, enabling decision makers to use this information for improving outpatient service operations. We apply our framework in the endocrinology metabolism department and neurosurgery department in one of the largest hospitals in South Korea. The use of asymmetric functions prevents underestimation in the model, and with the proposed DAES, we can strike a balance in selecting the best model. By using SHAP, we can analytically interpret the waiting time in outpatient service (e.g., the length of the queue affects the waiting time the most) and provide explanations about the expected waiting time to patients. The proposed framework aids in improving operations, considering practical application in hospitals for real-time patient notification and minimizing patient dissatisfaction. Given the significance of managing hospital operations from the perspective of patients, this work is expected to contribute to operations improvement in health service practices.

Suggested Citation

  • Jongkyung Shin & Donggi Augustine Lee & Juram Kim & Chiehyeon Lim & Byung-Kwan Choi, 2024. "Dissatisfaction-considered waiting time prediction for outpatients with interpretable machine learning," Health Care Management Science, Springer, vol. 27(3), pages 370-390, September.
  • Handle: RePEc:kap:hcarem:v:27:y:2024:i:3:d:10.1007_s10729-024-09676-5
    DOI: 10.1007/s10729-024-09676-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10729-024-09676-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10729-024-09676-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael Fairley & David Scheinker & Margaret L. Brandeau, 2019. "Improving the efficiency of the operating room environment with an optimization and machine learning model," Health Care Management Science, Springer, vol. 22(4), pages 756-767, December.
    2. Mani Suleiman & Haydar Demirhan & Leanne Boyd & Federico Girosi & Vural Aksakalli, 2022. "Bayesian prediction of emergency department wait time," Health Care Management Science, Springer, vol. 25(2), pages 275-290, June.
    3. Enis Kayış & Taghi Khaniyev & Jaap Suermondt & Karl Sylvester, 2015. "A robust estimation model for surgery durations with temporal, operational, and surgery team effects," Health Care Management Science, Springer, vol. 18(3), pages 222-233, September.
    4. Erjie Ang & Sara Kwasnick & Mohsen Bayati & Erica L. Plambeck & Michael Aratow, 2016. "Accurate Emergency Department Wait Time Prediction," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 141-156, February.
    5. Dina Bentayeb & Nadia Lahrichi & Louis-Martin Rousseau, 2019. "Patient scheduling based on a service-time prediction model: a data-driven study for a radiotherapy center," Health Care Management Science, Springer, vol. 22(4), pages 768-782, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haolin Feng & Yiwu Jia & Siyi Zhou & Hongyi Chen & Teng Huang, 2023. "A Dataset of Service Time and Related Patient Characteristics from an Outpatient Clinic," Data, MDPI, vol. 8(3), pages 1-15, February.
    2. Azar, Macarena & Carrasco, Rodrigo A. & Mondschein, Susana, 2022. "Dealing with uncertain surgery times in operating room scheduling," European Journal of Operational Research, Elsevier, vol. 299(1), pages 377-394.
    3. Debjit Roy & Eirini Spiliotopoulou & Jelle de Vries, 2022. "Restaurant analytics: Emerging practice and research opportunities," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3687-3709, October.
    4. Marco Caserta & Antonio García Romero, 2024. "A novel approach to forecast surgery durations using machine learning techniques," Health Care Management Science, Springer, vol. 27(3), pages 313-327, September.
    5. Jerry Anunrojwong & Krishnamurthy Iyer & David Lingenbrink, 2024. "Persuading Risk-Conscious Agents: A Geometric Approach," Operations Research, INFORMS, vol. 72(1), pages 151-166, January.
    6. Jung, Seung Hwan & Yang, Yunsi, 2023. "On the value of operational flexibility in the trailer shipment and assignment problem: Data-driven approaches and reinforcement learning," International Journal of Production Economics, Elsevier, vol. 264(C).
    7. Nan Liu & Stacey R. Finkelstein & Margaret E. Kruk & David Rosenthal, 2018. "When Waiting to See a Doctor Is Less Irritating: Understanding Patient Preferences and Choice Behavior in Appointment Scheduling," Management Science, INFORMS, vol. 64(5), pages 1975-1996, May.
    8. Bottmer, Lea & Croux, Christophe & Wilms, Ines, 2022. "Sparse regression for large data sets with outliers," European Journal of Operational Research, Elsevier, vol. 297(2), pages 782-794.
    9. Mani Suleiman & Haydar Demirhan & Leanne Boyd & Federico Girosi & Vural Aksakalli, 2022. "Bayesian prediction of emergency department wait time," Health Care Management Science, Springer, vol. 25(2), pages 275-290, June.
    10. Aleida Braaksma & Martin S. Copenhaver & Ana C. Zenteno & Elizabeth Ugarph & Retsef Levi & Bethany J. Daily & Benjamin Orcutt & Kathryn M. Turcotte & Peter F. Dunn, 2023. "Evaluation and implementation of a Just-In-Time bed-assignment strategy to reduce wait times for surgical inpatients," Health Care Management Science, Springer, vol. 26(3), pages 501-515, September.
    11. Rouba Ibrahim & Mor Armony & Achal Bassamboo, 2017. "Does the Past Predict the Future? The Case of Delay Announcements in Service Systems," Management Science, INFORMS, vol. 63(6), pages 1762-1780, June.
    12. Jun Li & Serguei Netessine & Sergei Koulayev, 2018. "Price to Compete … with Many: How to Identify Price Competition in High-Dimensional Space," Management Science, INFORMS, vol. 64(9), pages 4118-4136, September.
    13. Yuan Shi & Saied Mahdian & Jose Blanchet & Peter Glynn & Andrew Y. Shin & David Scheinker, 2023. "Surgical scheduling via optimization and machine learning with long-tailed data," Health Care Management Science, Springer, vol. 26(4), pages 692-718, December.
    14. Batur, Demet & Bekki, Jennifer M. & Chen, Xi, 2018. "Quantile regression metamodeling: Toward improved responsiveness in the high-tech electronics manufacturing industry," European Journal of Operational Research, Elsevier, vol. 264(1), pages 212-224.
    15. Benevento, Elisabetta & Aloini, Davide & Squicciarini, Nunzia, 2023. "Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques," International Journal of Forecasting, Elsevier, vol. 39(1), pages 192-208.
    16. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    17. Jing Dong & Elad Yom-Tov & Galit B. Yom-Tov, 2019. "The Impact of Delay Announcements on Hospital Network Coordination and Waiting Times," Management Science, INFORMS, vol. 67(5), pages 1969-1994, May.
    18. Tinglong Dai & Sridhar Tayur, 2020. "OM Forum—Healthcare Operations Management: A Snapshot of Emerging Research," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 869-887, September.
    19. van den Broek d’Obrenan, Anne & Ridder, Ad & Roubos, Dennis & Stougie, Leen, 2020. "Minimizing bed occupancy variance by scheduling patients under uncertainty," European Journal of Operational Research, Elsevier, vol. 286(1), pages 336-349.
    20. Golmohammadi, Davood & Zhao, Lingyu & Dreyfus, David, 2023. "Using machine learning techniques to reduce uncertainty for outpatient appointment scheduling practices in outpatient clinics," Omega, Elsevier, vol. 120(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:hcarem:v:27:y:2024:i:3:d:10.1007_s10729-024-09676-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.