IDEAS home Printed from https://ideas.repec.org/a/kap/hcarem/v26y2023i2d10.1007_s10729-022-09626-z.html
   My bibliography  Save this article

Predicting no-show appointments in a pediatric hospital in Chile using machine learning

Author

Listed:
  • J. Dunstan

    (University of Chile
    Pontificia Universidad Católica de Chile)

  • F. Villena

    (University of Chile)

  • J.P. Hoyos

    (Universidad Nacional de Colombia Sede De La Paz)

  • V. Riquelme

    (University of Chile)

  • M. Royer

    (Dr. Luis Calvo Mackenna Hospital)

  • H. Ramírez

    (University of Chile
    University of Chile)

  • J. Peypouquet

    (Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, Faculty of Science and EngineeringUniversity of Groningen)

Abstract

The Chilean public health system serves 74% of the country’s population, and 19% of medical appointments are missed on average because of no-shows. The national goal is 15%, which coincides with the average no-show rate reported in the private healthcare system. Our case study, Doctor Luis Calvo Mackenna Hospital, is a public high-complexity pediatric hospital and teaching center in Santiago, Chile. Historically, it has had high no-show rates, up to 29% in certain medical specialties. Using machine learning algorithms to predict no-shows of pediatric patients in terms of demographic, social, and historical variables. To propose and evaluate metrics to assess these models, accounting for the cost-effective impact of possible intervention strategies to reduce no-shows. We analyze the relationship between a no-show and demographic, social, and historical variables, between 2015 and 2018, through the following traditional machine learning algorithms: Random Forest, Logistic Regression, Support Vector Machines, AdaBoost and algorithms to alleviate the problem of class imbalance, such as RUS Boost, Balanced Random Forest, Balanced Bagging and Easy Ensemble. These class imbalances arise from the relatively low number of no-shows to the total number of appointments. Instead of the default thresholds used by each method, we computed alternative ones via the minimization of a weighted average of type I and II errors based on cost-effectiveness criteria. 20.4% of the 395,963 appointments considered presented no-shows, with ophthalmology showing the highest rate among specialties at 29.1%. Patients in the most deprived socioeconomic group according to their insurance type and commune of residence and those in their second infancy had the highest no-show rate. The history of non-attendance is strongly related to future no-shows. An 8-week experimental design measured a decrease in no-shows of 10.3 percentage points when using our reminder strategy compared to a control group. Among the variables analyzed, those related to patients’ historical behavior, the reservation delay from the creation of the appointment, and variables that can be associated with the most disadvantaged socioeconomic group, are the most relevant to predict a no-show. Moreover, the introduction of new cost-effective metrics significantly impacts the validity of our prediction models. Using a prototype to call patients with the highest risk of no-shows resulted in a noticeable decrease in the overall no-show rate.

Suggested Citation

  • J. Dunstan & F. Villena & J.P. Hoyos & V. Riquelme & M. Royer & H. Ramírez & J. Peypouquet, 2023. "Predicting no-show appointments in a pediatric hospital in Chile using machine learning," Health Care Management Science, Springer, vol. 26(2), pages 313-329, June.
    • Handle: RePEc:kap:hcarem:v:26:y:2023:i:2:d:10.1007_s10729-022-09626-z
    DOI: 10.1007/s10729-022-09626-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10729-022-09626-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10729-022-09626-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Qingxia Kong & Shan Li & Nan Liu & Chung-Piaw Teo & Zhenzhen Yan, 2020. "Appointment Scheduling Under Time-Dependent Patient No-Show Behavior," Management Science, INFORMS, vol. 66(8), pages 3480-3500, August.
    2. Kazim Topuz & Hasmet Uner & Asil Oztekin & Mehmet Bayram Yildirim, 2018. "Predicting pediatric clinic no-shows: a decision analytic framework using elastic net and Bayesian belief network," Annals of Operations Research, Springer, vol. 263(1), pages 479-499, April.
    3. Yong-Hong Kuo & Hari Balasubramanian & Yan Chen, 2020. "Medical appointment overbooking and optimal scheduling: tradeoffs between schedule efficiency and accessibility to service," Flexible Services and Manufacturing Journal, Springer, vol. 32(1), pages 72-101, March.
    4. Adel Alaeddini & Kai Yang & Chandan Reddy & Susan Yu, 2011. "A probabilistic model for predicting the probability of no-show in hospital appointments," Health Care Management Science, Springer, vol. 14(2), pages 146-157, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Savchenko, Elizaveta & Rosenfeld, Ariel & Bunimovich-Mendrazitsky, Svetlana, 2024. "A mathematical framework of SMS reminder campaigns for pre- and post-diagnosis check-ups using socio-demographics: An in-silco investigation into breast cancer," Socio-Economic Planning Sciences, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kazim Topuz & Timothy L. Urban & Robert A. Russell & Mehmet B. Yildirim, 2024. "Decision support system for appointment scheduling and overbooking under patient no-show behavior," Annals of Operations Research, Springer, vol. 342(1), pages 845-873, November.
    2. Mi Young Suk & Bomgyeol Kim & Sang Gyu Lee & Chang Hoon You & Tae Hyun Kim, 2021. "Evaluation of Patient No-Shows in a Tertiary Hospital: Focusing on Modes of Appointment-Making and Type of Appointment," IJERPH, MDPI, vol. 18(6), pages 1-14, March.
    3. Simsek, Serhat & Dag, Ali & Tiahrt, Thomas & Oztekin, Asil, 2021. "A Bayesian Belief Network-based probabilistic mechanism to determine patient no-show risk categories," Omega, Elsevier, vol. 100(C).
    4. Ben Li & Xiaolong Guo & Liang Liang, 2024. "Optimal pricing decision and capacity allocation of opaque selling in airline revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 23(4), pages 356-368, August.
    5. Aditya Shetty & Harry Groenevelt & Vera Tilson, 2023. "Intraday dynamic rescheduling under patient no-shows," Health Care Management Science, Springer, vol. 26(3), pages 583-598, September.
    6. Isabel Kaluza & Guido Voigt & Knut Haase & Antonia Dietze, 2024. "Control of Online-Appointment Systems When the Booking Status Signals Quality of Service," Schmalenbach Journal of Business Research, Springer, vol. 76(3), pages 397-432, September.
    7. Kazim Topuz & Behrooz Davazdahemami & Dursun Delen, 2024. "A Bayesian belief network-based analytics methodology for early-stage risk detection of novel diseases," Annals of Operations Research, Springer, vol. 341(1), pages 673-697, October.
    8. Ulla Vaeggemose & Emely Ek Blæhr & Anne Marie L. Thomsen & Viola Burau & Pia Vedel Ankersen & Stina Lou, 2020. "Fine for non‐attendance in public hospitals in Denmark: A survey of non‐attenders' reasons and attitudes," International Journal of Health Planning and Management, Wiley Blackwell, vol. 35(5), pages 1055-1064, September.
    9. Tito Homem-de-Mello & Qingxia Kong & Rodrigo Godoy-Barba, 2022. "A Simulation Optimization Approach for the Appointment Scheduling Problem with Decision-Dependent Uncertainties," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2845-2865, September.
    10. Ni, Ji & Chen, Bowei & Allinson, Nigel M. & Ye, Xujiong, 2020. "A hybrid model for predicting human physical activity status from lifelogging data," European Journal of Operational Research, Elsevier, vol. 281(3), pages 532-542.
    11. van Eekelen, Wouter, 2023. "Distributionally robust views on queues and related stochastic models," Other publications TiSEM 9b99fc05-9d68-48eb-ae8c-9, Tilburg University, School of Economics and Management.
    12. F. Benedetto & L. Mastroeni & P. Vellucci, 2021. "Modeling the flow of information between financial time-series by an entropy-based approach," Annals of Operations Research, Springer, vol. 299(1), pages 1235-1252, April.
    13. Yuan Gao & Qian Zhang & Chun Kit Lau & Bhagwat Ram, 2022. "Robust Appointment Scheduling in Healthcare," Mathematics, MDPI, vol. 10(22), pages 1-15, November.
    14. Namakshenas, Mohammad & Mazdeh, Mohammad Mahdavi & Braaksma, Aleida & Heydari, Mehdi, 2023. "Appointment scheduling for medical diagnostic centers considering time-sensitive pharmaceuticals: A dynamic robust optimization approach," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1018-1031.
    15. Mahes, Roshan & Mandjes, Michel & Boon, Marko & Taylor, Peter, 2024. "Adaptive scheduling in service systems: A Dynamic programming approach," European Journal of Operational Research, Elsevier, vol. 312(2), pages 605-626.
    16. Ariel Neufeld & Matthew Ng Cheng En & Ying Zhang, 2024. "Robust SGLD algorithm for solving non-convex distributionally robust optimisation problems," Papers 2403.09532, arXiv.org, revised Mar 2025.
    17. Wang, Qiang & Zhang, Wen & Li, Jian & Ma, Zhenzhong, 2023. "Complements or confounders? A study of effects of target and non-target features on online fraudulent reviewer detection," Journal of Business Research, Elsevier, vol. 167(C).
    18. Kazim Topuz & Hasmet Uner & Asil Oztekin & Mehmet Bayram Yildirim, 2018. "Predicting pediatric clinic no-shows: a decision analytic framework using elastic net and Bayesian belief network," Annals of Operations Research, Springer, vol. 263(1), pages 479-499, April.
    19. Cankaya, Burak & Topuz, Kazim & Delen, Dursun & Glassman, Aaron, 2023. "Evidence-based managerial decision-making with machine learning: The case of Bayesian inference in aviation incidents," Omega, Elsevier, vol. 120(C).
    20. Shuming Wang & Jun Li & Marcus Ang & Tsan Sheng Ng, 2024. "Appointment Scheduling with Delay Tolerance Heterogeneity," INFORMS Journal on Computing, INFORMS, vol. 36(5), pages 1201-1224, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:hcarem:v:26:y:2023:i:2:d:10.1007_s10729-022-09626-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.