IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v22y2002i2p163-172.html
   My bibliography  Save this article

A Comparison of Bayesian Methods for Profiling Hospital Performance

Author

Listed:
  • Peter C. Austin

    (Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada and the Department of Public Health Sciences, University of Toronto, Toronto, Ontario, Canada)

Abstract

There is a growing interest in the use of Bayesian methods for profiling institutional performance. In the literature, several studies have compared different frequentist methods for classifying hospitals as performance outliers. The purpose of this study was to compare 4 different Bayesian methods for classifying hospitals as outcomes outliers, using 30-day hospital-level mortality rates for a cohort of acute myocardial infarction patients as a test case. The 1st Bayesian method involved determining the probability that a hospital’s mortality rate for an average patient exceeded a specified threshold. The 2nd method involved ranking hospitals according to their mortality rate for an average patient. The 3rd method involved determining the probability that a hospital’s standardized mortality ratio exceeded a specified threshold. The 4th method involved ranking hospitals according to their standardized mortality ratio. In most of the scenarios examined, there was only marginal agreement between the different methods. In only 4 of 19 comparisons, was there good agreement between the different methods (0.40 kappa 0.75). Methods based on ranking institutions were relatively insensitive to differences between hospitals. These inconsistencies raise questions about the choice of methods for classifying hospital performance, and they suggest a need for urgent research into which methods are best able to discriminate between institutions and which are most meaningful to decision makers.

Suggested Citation

  • Peter C. Austin, 2002. "A Comparison of Bayesian Methods for Profiling Hospital Performance," Medical Decision Making, , vol. 22(2), pages 163-172, April.
    • Handle: RePEc:sae:medema:v:22:y:2002:i:2:p:163-172
    DOI: 10.1177/0272989X0202200213
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X0202200213
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X0202200213?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lisa I. Iezzoni & Michael Shwartz & Arlene S. Ash & Yevgenia D. Mackiernan, 1996. "Predicting In-hospital Mortality for Stroke Patients," Medical Decision Making, , vol. 16(4), pages 348-356, October.
    2. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Duen-Yian Yeh & Ching-Hsue Cheng, 2016. "Performance Management of Taiwan’s National Hospitals," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(01), pages 187-213, January.
    2. Johannes Hengelbrock & Johannes Rauh & Jona Cederbaum & Maximilian Kähler & Michael Höhle, 2023. "Hospital profiling using Bayesian decision theory," Biometrics, The International Biometric Society, vol. 79(3), pages 2757-2769, September.
    3. David I. Ohlssen & Linda D. Sharples & David J. Spiegelhalter, 2007. "A hierarchical modelling framework for identifying unusual performance in health care providers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 865-890, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    2. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    3. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    4. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    5. Nils Gutacker & Andrew Street, 2015. "Multidimensional performance assessment using dominance criteria," Working Papers 115cherp, Centre for Health Economics, University of York.
    6. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    7. Frank Eijkenaar & René C. J. A. van Vliet, 2014. "Performance Profiling in Primary Care," Medical Decision Making, , vol. 34(2), pages 192-205, February.
    8. John Robinson & Scott Zeger & Christopher Forrest, 2004. "A Hierarchical Multivariate Two-Part Model for Profiling Providers' Effects on Healthcare Charges," Johns Hopkins University Dept. of Biostatistics Working Paper Series 1052, Berkeley Electronic Press.
    9. Martini, Gianmaria & Berta, Paolo & Mullahy, John & Vittadini, Giorgio, 2014. "The effectiveness–efficiency trade-off in health care: The case of hospitals in Lombardy, Italy," Regional Science and Urban Economics, Elsevier, vol. 49(C), pages 217-231.
    10. Adnett, Nick & Bougheas, Spiros & Davies, Peter, 2002. "Market-based reforms of public schooling: some unpleasant dynamics," Economics of Education Review, Elsevier, vol. 21(4), pages 323-330, August.
    11. Francesca Giambona & Mariano Porcu & Isabella Sulis, 2017. "Students Mobility: Assessing the Determinants of Attractiveness Across Competing Territorial Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(3), pages 1105-1132, September.
    12. Li Mingliang & Tobias Justin, 2005. "Bayesian Modeling of School Effects Using Hierarchical Models with Smoothing Priors," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(3), pages 1-33, September.
    13. Pier Ferrari & Laura Pagani & Carlo Fiorio, 2011. "A Two-Step Approach to Analyze Satisfaction Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(3), pages 545-554, December.
    14. Park, Minjung & Hunter, Jennifer & Kwon, Soonman, 2018. "Evaluating integrative medicine acute stroke inpatient care in South Korea," Health Policy, Elsevier, vol. 122(4), pages 373-379.
    15. Mathieu Goudard & Michel Lubrano, 2013. "Human Capital, Social Capital And Scientific Research In Europe: An Application Of Linear Hierarchical Models," Manchester School, University of Manchester, vol. 81(6), pages 876-903, December.
    16. J Taylor, 2007. "The impact of the specialist schools programme on exam results," Working Papers 582526, Lancaster University Management School, Economics Department.
    17. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    18. Sergei Bazylik & Magne Mogstad & Joseph P. Romano & Azeem Shaikh & Daniel Wilhelm, 2021. "Finite- and Large-Sample Inference for Ranks using Multinomial Data with an Application to Ranking Political Parties," NBER Working Papers 29519, National Bureau of Economic Research, Inc.
    19. Paddock, Susan M. & Ridgeway, Greg & Lin, Rongheng & Louis, Thomas A., 2006. "Flexible distributions for triple-goal estimates in two-stage hierarchical models," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 3243-3262, July.
    20. Tom Brijs & Dimitris Karlis & Filip Van den Bossche & Geert Wets, 2007. "A Bayesian model for ranking hazardous road sites," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 1001-1017, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:22:y:2002:i:2:p:163-172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.