IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v165y2002i2p191-221.html
   My bibliography  Save this article

Commissioned analysis of surgical performance using routine data: lessons from the Bristol inquiry

Author

Listed:
  • David J. Spiegelhalter
  • Paul Aylin
  • Nicola G. Best
  • Stephen J. W. Evans
  • Gordon D. Murray

Abstract

The public inquiry into paediatric cardiac surgery at the Bristol Royal Infirmary commissioned the authors to design and conduct analyses of routine data sources to compare surgical outcomes between centres. Such analyses are necessarily complex in this context but were further hampered by the inherent inconsistencies and mediocre quality of the various sources of data. Three levels of analysis of increasing sophistication were carried out. The reasonable consistency of the results arising from different sources of data, together with a number of sensitivity analyses, led us to conclude that there had been excess mortality in Bristol in open heart operations on children under 1 year of age. We consider criticisms of our analysis and discuss the role of statisticians in this inquiry and their contribution to the final report of the inquiry. The potential statistical role in future programmes for monitoring clinical performance is highlighted.

Suggested Citation

  • David J. Spiegelhalter & Paul Aylin & Nicola G. Best & Stephen J. W. Evans & Gordon D. Murray, 2002. "Commissioned analysis of surgical performance using routine data: lessons from the Bristol inquiry," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(2), pages 191-221, June.
    • Handle: RePEc:bla:jorssa:v:165:y:2002:i:2:p:191-221
    DOI: 10.1111/1467-985X.02021
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1467-985X.02021
    Download Restriction: no
    File URL: https://libkey.io/10.1111/1467-985X.02021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John F. Y. Brookfield, 2001. "Predicting the future," Nature, Nature, vol. 411(6841), pages 999-999, June.
    2. Burgess Jr., James F. & Christiansen, Cindy L. & Michalak, Sarah E. & Morris, Carl N., 2000. "Medical profiling: improving standards and risk adjustments using hierarchical models," Journal of Health Economics, Elsevier, vol. 19(3), pages 291-309, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Coolen, F.P.A. & Coolen-Schrijner, P., 2006. "Nonparametric predictive subset selection for proportions," Statistics & Probability Letters, Elsevier, vol. 76(15), pages 1675-1684, September.
    2. Clare Marshall & Nicky Best & Alex Bottle & Paul Aylin, 2004. "Statistical issues in the prospective monitoring of health outcomes across multiple units," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(3), pages 541-559, August.
    3. Irene Papanicolas & Alistair McGuire, 2017. "Measuring and forecasting quality in English hospitals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 409-432, February.
    4. Sheila M. Bird & Cox Sir David & Vern T. Farewell & Goldstein Harvey & Holt Tim & Smith Peter C., 2005. "Performance indicators: good, bad, and ugly," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 1-27, January.
    5. Sylvia Richardson, 2022. "Statistics in times of increasing uncertainty," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1471-1496, October.
    6. David I. Ohlssen & Linda D. Sharples & David J. Spiegelhalter, 2007. "A hierarchical modelling framework for identifying unusual performance in health care providers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 865-890, October.
    7. Trevor C. Bailey & Paul J. Hewson, 2004. "Simultaneous modelling of multiple traffic safety performance indicators by using a multivariate generalized linear mixed model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(3), pages 501-517, August.
    8. Nicholas Longford & D. B. Rubin, 2006. "Performance assessment and league tables. Comparing like with like," Economics Working Papers 994, Department of Economics and Business, Universitat Pompeu Fabra.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriele B. Durrant & Sylke V. Schnepf, 2018. "Which schools and pupils respond to educational achievement surveys?: a focus on the English Programme for International Student Assessment sample," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1057-1075, October.
    2. Adams, Leen & Faseur, Tineke & Geuens, Maggie, 2010. "The Influence of the Self-Regulatory Focus on the Effectiveness of Stop-Smoking Campaigns for Young Smokers," Working Papers 2010/38, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    3. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    4. Sheila M. Bird & Cox Sir David & Vern T. Farewell & Goldstein Harvey & Holt Tim & Smith Peter C., 2005. "Performance indicators: good, bad, and ugly," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 1-27, January.
    5. Vedrenne, Michel & Pérez, Javier & Lumbreras, Julio & Rodríguez, María Encarnación, 2014. "Life cycle assessment as a policy-support tool: The case of taxis in the city of Madrid," Energy Policy, Elsevier, vol. 66(C), pages 185-197.
    6. Trnka, M. & Muška, F. & Semerádová, D. & Dubrovský, M. & Kocmánková, E. & Žalud, Z., 2007. "European Corn Borer life stage model: Regional estimates of pest development and spatial distribution under present and future climate," Ecological Modelling, Elsevier, vol. 207(2), pages 61-84.
    7. Thompson, Simon G. & Nixon, Richard M. & Grieve, Richard, 2006. "Addressing the issues that arise in analysing multicentre cost data, with application to a multinational study," Journal of Health Economics, Elsevier, vol. 25(6), pages 1015-1028, November.
    8. Paolo Angelini, 2008. "Liquidity And Announcement Effects In The Euro Area," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 67(1), pages 1-20, March.
    9. Lu, Fangfang & Xu, Daolin & Wen, Guilin, 2005. "Tracing initial conditions, historical evolutionary path and parameters of chaotic processes from a short segment of scalar time series," Chaos, Solitons & Fractals, Elsevier, vol. 24(1), pages 265-271.
    10. Nick Adnett & Peter Davies, 2005. "Competition between or within schools? Re-assessing school choice," Education Economics, Taylor & Francis Journals, vol. 13(1), pages 109-121.
    11. D. A. Elston & M. J. Brewer & B. Martay & A. Johnston & P. A. Henrys & J. R. Bell & R. Harrington & D. Monteith & T. M. Brereton & K. L. Boughey & J. W. Pearce-Higgins, 2017. "A New Approach to Modelling the Relationship Between Annual Population Abundance Indices and Weather Data," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 22(4), pages 427-445, December.
    12. Nitschke, Craig R. & Innes, John L., 2008. "A tree and climate assessment tool for modelling ecosystem response to climate change," Ecological Modelling, Elsevier, vol. 210(3), pages 263-277.
    13. Kathleen Carey, 2000. "A multilevel modelling approach to analysis of patient costs under managed care," Health Economics, John Wiley & Sons, Ltd., vol. 9(5), pages 435-446, July.
    14. S. V. Ilkevich, 2018. "Senior Tourism Persp Ectives In The Context Of The Pension Reform In Russia," Strategic decisions and risk management, Real Economy Publishing House, issue 4.
    15. Van Boven, Leaf & Loewenstein, George & Dunning, David, 2003. "Mispredicting the endowment effect:: Underestimation of owners' selling prices by buyer's agents," Journal of Economic Behavior & Organization, Elsevier, vol. 51(3), pages 351-365, July.
    16. Kenneth White & Kimberly Watkins & Megan McCoy & Bertranna Muruthi & Jamie Lynn Byram, 2021. "How Financial Socialization Messages Relate to Financial Management, Optimism and Stress: Variations by Race," Journal of Family and Economic Issues, Springer, vol. 42(2), pages 237-250, June.
    17. Or, Zeynep & Wang, Jia & Jamison, Dean, 2005. "International differences in the impact of doctors on health: a multilevel analysis of OECD countries," Journal of Health Economics, Elsevier, vol. 24(3), pages 531-560, May.
    18. Vishnevskiy, Konstantin & Karasev, Oleg & Meissner, Dirk, 2015. "Integrated roadmaps and corporate foresight as tools of innovation management: The case of Russian companies," Technological Forecasting and Social Change, Elsevier, vol. 90(PB), pages 433-443.
    19. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    20. Vanderfaeillie, Johan & Van Holen, Frank & Vanschoonlandt, Femke & Robberechts, Marijke & Stroobants, Tim, 2013. "Children placed in long-term family foster care: A longitudinal study into the development of problem behavior and associated factors," Children and Youth Services Review, Elsevier, vol. 35(4), pages 587-593.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:165:y:2002:i:2:p:191-221. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.