IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v20y2011i1p85-100.html
   My bibliography  Save this article

Costs and quality of hospitals in different health care systems: a multi‐level approach with propensity score matching

Author

Listed:
  • Jonas Schreyögg
  • Tom Stargardt
  • Oliver Tiemann

Abstract

Cross‐country comparisons of costs and quality between hospitals are often made at the macro level. The goal of this study was to explore methods to compare micro‐level data from hospitals in different health care systems. To do so, we developed a multi‐level framework in combination with a propensity score matching technique using similarly structured data for patients receiving treatment for acute myocardial infarction in German and US Veterans Health Administration hospitals. Our case study shows important differences in results between multi‐level regressions based on matched and unmatched samples. We conclude that propensity score matching techniques are an appropriate way to deal with the usual baseline imbalances across the samples from different countries. Multi‐level models are recommendable to consider the clustered structure of the data when patient‐level data from different hospitals and health care systems are compared. The results provide an important justification for exploring new ways in performing health system comparisons. Copyright © 2010 John Wiley & Sons, Ltd.

Suggested Citation

  • Jonas Schreyögg & Tom Stargardt & Oliver Tiemann, 2011. "Costs and quality of hospitals in different health care systems: a multi‐level approach with propensity score matching," Health Economics, John Wiley & Sons, Ltd., vol. 20(1), pages 85-100, January.
  • Handle: RePEc:wly:hlthec:v:20:y:2011:i:1:p:85-100
    DOI: 10.1002/hec.1568
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1568
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1568?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Suthathip Yaisawarng & James F. Burgess, 2006. "Performance‐based budgeting in the public sector: an illustration from the VA health care system," Health Economics, John Wiley & Sons, Ltd., vol. 15(3), pages 295-310, March.
    2. Shen, Yu-Chu, 2002. "The effect of hospital ownership choice on patient outcomes after treatment for acute myocardial infarction," Journal of Health Economics, Elsevier, vol. 21(5), pages 901-922, September.
    3. Nandita Mitra & Alka Indurkhya, 2005. "A propensity score approach to estimating the cost–effectiveness of medical therapies from observational data," Health Economics, John Wiley & Sons, Ltd., vol. 14(8), pages 805-815, August.
    4. Richard Grieve & Richard Nixon & Simon G. Thompson & Charles Normand, 2005. "Using multilevel models for assessing the variability of multinational resource use and cost data," Health Economics, John Wiley & Sons, Ltd., vol. 14(2), pages 185-196, February.
    5. Dennis D. Boos & Leonard A. Stefanski & Yujun Wu, 2009. "Fast FSR Variable Selection with Applications to Clinical Trials," Biometrics, The International Biometric Society, vol. 65(3), pages 692-700, September.
    6. Nigel Rice & Andrew Jones, 1997. "Multilevel models and health economics," Health Economics, John Wiley & Sons, Ltd., vol. 6(6), pages 561-575, November.
    7. Edward Evans & Yuichi Imanaka & Miho Sekimoto & Tatsuro Ishizaki & Kenshi Hayashida & Haruhisa Fukuda & Eun‐Hwan Oh, 2007. "Risk adjusted resource utilization for AMI patients treated in Japanese hospitals," Health Economics, John Wiley & Sons, Ltd., vol. 16(4), pages 347-359, April.
    8. Donald W. K. Andrews & Moshe Buchinsky, 2000. "A Three-Step Method for Choosing the Number of Bootstrap Repetitions," Econometrica, Econometric Society, vol. 68(1), pages 23-52, January.
    9. Hauck, Katharina & Street, Andrew, 2006. "Performance assessment in the context of multiple objectives: A multivariate multilevel analysis," Journal of Health Economics, Elsevier, vol. 25(6), pages 1029-1048, November.
    10. Martin, Stephen & Smith, Peter, 1996. "Explaining variations in inpatient length of stay in the National Health Service," Journal of Health Economics, Elsevier, vol. 15(3), pages 279-304, June.
    11. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    12. Kathleen Carey, 2000. "A multilevel modelling approach to analysis of patient costs under managed care," Health Economics, John Wiley & Sons, Ltd., vol. 9(5), pages 435-446, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stefan Voigt, 2016. "Determinants of judicial efficiency: a survey," European Journal of Law and Economics, Springer, vol. 42(2), pages 183-208, October.
    2. Li, Sung Ko & He, Xinju, 2019. "The impacts of marketization and subsidies on the treatment quality performance of the Chinese hospitals sector," China Economic Review, Elsevier, vol. 54(C), pages 41-50.
    3. Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
    4. Tom Stargardt & Jonas Schreyögg & Ivan Kondofersky, 2014. "Measuring The Relationship Between Costs And Outcomes: The Example Of Acute Myocardial Infarction In German Hospitals," Health Economics, John Wiley & Sons, Ltd., vol. 23(6), pages 653-669, June.
    5. Cinaroglu, Songul, 2021. "Changes in hospital efficiency and size: An integrated propensity score matching with data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 76(C).
    6. Häkkinen, Unto & Iversen, Tor & Peltola, Mikko & Seppälä, Timo T. & Malmivaara, Antti & Belicza, Éva & Fattore, Giovanni & Numerato, Dino & Heijink, Richard & Medin, Emma & Rehnberg, Clas, 2013. "Health care performance comparison using a disease-based approach: The EuroHOPE project," Health Policy, Elsevier, vol. 112(1), pages 100-109.
    7. Stargardt, Tom & Schreyögg, Jonas, 2012. "A framework to evaluate the effects of small area variations in healthcare infrastructure on diagnostics and patient outcomes of rare diseases based on administrative data," Health Policy, Elsevier, vol. 105(2), pages 110-118.
    8. Tor Iversen & Eline Aas & Gunnar Rosenqvist & Unto Häkkinen & on behalf of the EuroHOPE study group, 2015. "Comparative Analysis of Treatment Costs in EUROHOPE," Health Economics, John Wiley & Sons, Ltd., vol. 24(S2), pages 5-22, December.
    9. Liliana Proskuryakova & Dirk Meissner & Pavel Rudnik, 2014. "A Policy Perspective On The Russian Technology Platforms," HSE Working papers WP BRP 26/STI/2014, National Research University Higher School of Economics.
    10. Helmut Herwartz & Christoph Strumann, 2012. "On the effect of prospective payment on local hospital competition in Germany," Health Care Management Science, Springer, vol. 15(1), pages 48-62, March.
    11. Songul Cinaroglu, 2024. "Efficiency effects of public hospital closures in the context of public hospital reform: a multistep efficiency analysis," Health Care Management Science, Springer, vol. 27(1), pages 88-113, March.
    12. Xiaohui Zhang & Katharina Hauck & Xueyan Zhao, 2013. "Patient Safety In Hospitals – A Bayesian Analysis Of Unobservable Hospital And Specialty Level Risk Factors," Health Economics, John Wiley & Sons, Ltd., vol. 22(9), pages 1158-1174, September.
    13. Laura Haas & Tom Stargardt & Jonas Schreyoegg, 2012. "Cost-effectiveness of open versus laparoscopic appendectomy: a multilevel approach with propensity score matching," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(5), pages 549-560, October.
    14. Seghieri, Chiara & Berta, Paolo & Nuti, Sabina, 2019. "Geographic variation in inpatient costs for Acute Myocardial Infarction care: Insights from Italy," Health Policy, Elsevier, vol. 123(5), pages 449-456.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tom Stargardt & Jonas Schreyögg & Ivan Kondofersky, 2014. "Measuring The Relationship Between Costs And Outcomes: The Example Of Acute Myocardial Infarction In German Hospitals," Health Economics, John Wiley & Sons, Ltd., vol. 23(6), pages 653-669, June.
    2. Laura Haas & Tom Stargardt & Jonas Schreyoegg, 2012. "Cost-effectiveness of open versus laparoscopic appendectomy: a multilevel approach with propensity score matching," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(5), pages 549-560, October.
    3. Ileana Baldi & Eva Pagano & Paola Berchialla & Alessandro Desideri & Alberto Ferrando & Franco Merletti & Dario Gregori, 2013. "Modeling healthcare costs in simultaneous presence of asymmetry, heteroscedasticity and correlation," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(2), pages 298-310, February.
    4. Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
    5. Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
    6. Julia Bonastre & Marc le Vaillant & Gerard de Pouvourville, 2011. "The impact of research on hospital costs of care: an empirical study," Health Economics, John Wiley & Sons, Ltd., vol. 20(1), pages 73-84, January.
    7. Oliveira, Monica D. & Bevan, Gwyn, 2008. "Modelling hospital costs to produce evidence for policies that promote equity and efficiency," European Journal of Operational Research, Elsevier, vol. 185(3), pages 933-947, March.
    8. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    9. Castelli, Adriana & Jacobs, Rowena & Goddard, Maria & Smith, Peter C., 2013. "Health, policy and geography: Insights from a multi-level modelling approach," Social Science & Medicine, Elsevier, vol. 92(C), pages 61-73.
    10. Bache, Stefan Holst Milton & Kristensen, Troels, 2013. "A simple but efficient approach to the analysis of multilevel data," DaCHE discussion papers 2013:6, University of Southern Denmark, Dache - Danish Centre for Health Economics.
    11. Antonio Clavero Barranquero & Mª. Luz González Alvarez, 2005. "A survey of econometric models to analyze the demand and utilisation of health care," Hacienda Pública Española / Review of Public Economics, IEF, vol. 173(2), pages 129-162, June.
    12. Park, Sungchul & Lee, Jason & Ikai, Hiroshi & Otsubo, Tetsuya & Imanaka, Yuichi, 2013. "Decentralization and centralization of healthcare resources: Investigating the associations of hospital competition and number of cardiologists per hospital with mortality and resource utilization in ," Health Policy, Elsevier, vol. 113(1), pages 100-109.
    13. Christian E. H. Boehler & Joanne Lord, 2016. "Mind the Gap! A Multilevel Analysis of Factors Related to Variation in Published Cost-Effectiveness Estimates within and between Countries," Medical Decision Making, , vol. 36(1), pages 31-47, January.
    14. Oliver Tiemann & Jonas Schreyögg, 2012. "Changes in hospital efficiency after privatization," Health Care Management Science, Springer, vol. 15(4), pages 310-326, December.
    15. Or, Zeynep & Wang, Jia & Jamison, Dean, 2005. "International differences in the impact of doctors on health: a multilevel analysis of OECD countries," Journal of Health Economics, Elsevier, vol. 24(3), pages 531-560, May.
    16. Andrew Street & Conrad Kobel & Thomas Renaud & Josselin Thuilliez & ON BEHALF OF THE EURODRG GROUP, 2012. "How Well Do Diagnosis‐Related Groups Explain Variations In Costs Or Length Of Stay Among Patients And Across Hospitals? Methods For Analysing Routine Patient Data," Health Economics, John Wiley & Sons, Ltd., vol. 21(S2), pages 6-18, August.
    17. Jonas Schreyögg, 2008. "A micro‐costing approach to estimating hospital costs for appendectomy in a Cross‐European context," Health Economics, John Wiley & Sons, Ltd., vol. 17(S1), pages 59-69, January.
    18. Oliver Tiemann, 2008. "Variations in hospitalisation costs for acute myocardial infarction – a comparison across Europe," Health Economics, John Wiley & Sons, Ltd., vol. 17(S1), pages 33-45, January.
    19. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    20. Zichen Deng & Maarten Lindeboom, 2021. "Early-life Famine Exposure, Hunger Recall and Later-life Health," Tinbergen Institute Discussion Papers 21-054/V, Tinbergen Institute.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:20:y:2011:i:1:p:85-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.