IDEAS home Printed from https://ideas.repec.org/p/chy/respap/101cherp.html
   My bibliography  Save this paper

Addressing missing data in patient-reported outcome measures (PROMs): implications for comparing provider performance

Author

Listed:
  • Manuel Gomes

    (Department of Health Services Research & Policy, London School of Hygiene and Tropical Medicine, UK)

  • Nils Gutacker

    (Centre for Health Economics, University of York, UK)

  • Chris Bojke

    (Centre for Health Economics, University of York, UK)

  • Andrew Street

    (Centre for Health Economics, University of York, UK)

Abstract

Patient-reported outcome measures (PROMs) are now routinely collected in the English National Health Service (NHS) and used to compare and reward hospital performance within a high-powered pay-for-performance scheme. However, PROMs are prone to missing data. For example, hospitals often fail to administer the pre-operative questionnaire at hospital admission, or patients may refuse to participate or fail to return their post-operative questionnaire. A key concern with missing PROMs is that the individuals with complete information tend to be an unrepresentative sample of patients within each provider, and inferences based on the complete cases will be misleading. This study proposes a strategy for addressing missing data in the English PROMs survey using multiple imputation techniques, and investigates its impact on assessing provider performance. We find that inferences about relative provider performance are sensitive to the assumptions made about the reasons for the missing data.

Suggested Citation

  • Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2014. "Addressing missing data in patient-reported outcome measures (PROMs): implications for comparing provider performance," Working Papers 101cherp, Centre for Health Economics, University of York.
    • Handle: RePEc:chy:respap:101cherp
    as

    Download full text from publisher

    File URL: http://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP101_PROMs_missing_data_provider_performance.pdf
    File Function: First version, 2014
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Schenker, Nathaniel & Raghunathan, Trivellore E. & Chiu, Pei-Lu & Makuc, Diane M. & Zhang, Guangyu & Cohen, Alan J., 2006. "Multiple Imputation of Missing Income Data in the National Health Interview Survey," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 924-933, September.
    2. James R. Carpenter & Michael G. Kenward & Stijn Vansteelandt, 2006. "A comparison of multiple imputation and doubly robust estimation for analyses with missing data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 571-584, July.
    3. Daniel, Rhian M. & Kenward, Michael G., 2012. "A method for increasing the robustness of multiple imputation," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1624-1643.
    4. Carpenter, James R. & Goldstein, Harvey & Kenward, Michael G., 2011. "REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i05).
    5. Manuel Gomes & Karla Díaz-Ordaz & Richard Grieve & Michael G. Kenward, 2013. "Multiple Imputation Methods for Handling Missing Data in Cost-effectiveness Analyses That Use Data from Hierarchical Studies," Medical Decision Making, , vol. 33(8), pages 1051-1063, November.
    6. David Nuttall & David Parkin & Nancy Devlin, 2015. "Inter‐Provider Comparison Of Patient‐Reported Outcomes: Developing An Adjustment To Account For Differences In Patient Case Mix," Health Economics, John Wiley & Sons, Ltd., vol. 24(1), pages 41-54, January.
    7. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    8. Browne, William J., 2006. "MCMC algorithms for constrained variance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1655-1677, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gutacker, Nils & Siciliani, Luigi & Moscelli, Giuseppe & Gravelle, Hugh, 2016. "Choice of hospital: Which type of quality matters?," Journal of Health Economics, Elsevier, vol. 50(C), pages 230-246.
    2. Turner, Alex J. & Nikolova, Silviya & Sutton, Matt, 2016. "The effect of living alone on the costs and benefits of surgery amongst older people," Social Science & Medicine, Elsevier, vol. 150(C), pages 95-103.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2016. "Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance," Health Economics, John Wiley & Sons, Ltd., vol. 25(5), pages 515-528, May.
    2. Speidel, Matthias & Drechsler, Jörg & Jolani, Shahab, 2018. "R package hmi: a convenient tool for hierarchical multiple imputation and beyond," IAB-Discussion Paper 201816, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    3. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    4. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    5. Yongwei Chen & Dahai Fu, 2015. "Measuring income inequality using survey data: the case of China," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 13(2), pages 299-307, June.
    6. Gopalakrishnan, Raja & Guevara, C. Angelo & Ben-Akiva, Moshe, 2020. "Combining multiple imputation and control function methods to deal with missing data and endogeneity in discrete-choice models," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 45-57.
    7. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    8. Hai Zhong, 2010. "The impact of missing data in the estimation of concentration index: a potential source of bias," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(3), pages 255-266, June.
    9. Creemers, An & Aerts, Marc & Hens, Niel & Molenberghs, Geert, 2012. "A nonparametric approach to weighted estimating equations for regression analysis with missing covariates," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 100-113, January.
    10. Marquez, Jose & Qualter, Pamela & Petersen, Kimberly & Humphrey, Neil & Black, Louise, 2022. "In a lonely place: Neighbourhood effects on loneliness among adolescents," SocArXiv hzer5, Center for Open Science.
    11. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    12. Tatjana Miljkovic & Ying-Ju Chen, 2021. "A new computational approach for estimation of the Gini index based on grouped data," Computational Statistics, Springer, vol. 36(3), pages 2289-2311, September.
    13. Nils Gutacker & Andrew Street, 2015. "Multidimensional performance assessment using dominance criteria," Working Papers 115cherp, Centre for Health Economics, University of York.
    14. Fujishiro, Kaori & Xu, Jun & Gong, Fang, 2010. "What does "occupation" represent as an indicator of socioeconomic status?: Exploring occupational prestige and health," Social Science & Medicine, Elsevier, vol. 71(12), pages 2100-2107, December.
    15. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    16. Zhong, Hua & Hu, Wuyang, 2015. "Farmers’ Willingness to Engage in Best Management Practices: an Application of Multiple Imputation," 2015 Annual Meeting, January 31-February 3, 2015, Atlanta, Georgia 196962, Southern Agricultural Economics Association.
    17. Frank Eijkenaar & René C. J. A. van Vliet, 2014. "Performance Profiling in Primary Care," Medical Decision Making, , vol. 34(2), pages 192-205, February.
    18. John Robinson & Scott Zeger & Christopher Forrest, 2004. "A Hierarchical Multivariate Two-Part Model for Profiling Providers' Effects on Healthcare Charges," Johns Hopkins University Dept. of Biostatistics Working Paper Series 1052, Berkeley Electronic Press.
    19. He Yulei & Shimizu Iris & Schappert Susan & Xu Jianmin & Beresovsky Vladislav & Khan Diba & Valverde Roberto & Schenker Nathaniel, 2016. "A Note on the Effect of Data Clustering on the Multiple-Imputation Variance Estimator: A Theoretical Addendum to the Lewis et al. article in JOS 2014," Journal of Official Statistics, Sciendo, vol. 32(1), pages 147-164, March.
    20. Ferrari, Pier Alda & Annoni, Paola & Barbiero, Alessandro & Manzi, Giancarlo, 2011. "An imputation method for categorical variables with application to nonlinear principal component analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2410-2420, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chy:respap:101cherp. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gill Forder (email available below). General contact details of provider: https://edirc.repec.org/data/chyoruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.