IDEAS home Printed from https://ideas.repec.org/p/chy/respap/101cherp.html
   My bibliography  Save this paper

Addressing missing data in patient-reported outcome measures (PROMs): implications for comparing provider performance

Author

Listed:
  • Manuel Gomes

    (Department of Health Services Research & Policy, London School of Hygiene and Tropical Medicine, UK)

  • Nils Gutacker

    (Centre for Health Economics, University of York, UK)

  • Chris Bojke

    (Centre for Health Economics, University of York, UK)

  • Andrew Street

    (Centre for Health Economics, University of York, UK)

Abstract

Patient-reported outcome measures (PROMs) are now routinely collected in the English National Health Service (NHS) and used to compare and reward hospital performance within a high-powered pay-for-performance scheme. However, PROMs are prone to missing data. For example, hospitals often fail to administer the pre-operative questionnaire at hospital admission, or patients may refuse to participate or fail to return their post-operative questionnaire. A key concern with missing PROMs is that the individuals with complete information tend to be an unrepresentative sample of patients within each provider, and inferences based on the complete cases will be misleading. This study proposes a strategy for addressing missing data in the English PROMs survey using multiple imputation techniques, and investigates its impact on assessing provider performance. We find that inferences about relative provider performance are sensitive to the assumptions made about the reasons for the missing data.

Suggested Citation

  • Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2014. "Addressing missing data in patient-reported outcome measures (PROMs): implications for comparing provider performance," Working Papers 101cherp, Centre for Health Economics, University of York.
    • Handle: RePEc:chy:respap:101cherp
    as

    Download full text from publisher

    File URL: http://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP101_PROMs_missing_data_provider_performance.pdf
    File Function: First version, 2014
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Nuttall & David Parkin & Nancy Devlin, 2015. "Inter‐Provider Comparison Of Patient‐Reported Outcomes: Developing An Adjustment To Account For Differences In Patient Case Mix," Health Economics, John Wiley & Sons, Ltd., vol. 24(1), pages 41-54, January.
    2. James R. Carpenter & Michael G. Kenward & Stijn Vansteelandt, 2006. "A comparison of multiple imputation and doubly robust estimation for analyses with missing data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 571-584, July.
    3. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    4. Schenker, Nathaniel & Raghunathan, Trivellore E. & Chiu, Pei-Lu & Makuc, Diane M. & Zhang, Guangyu & Cohen, Alan J., 2006. "Multiple Imputation of Missing Income Data in the National Health Interview Survey," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 924-933, September.
    5. Manuel Gomes & Karla Díaz-Ordaz & Richard Grieve & Michael G. Kenward, 2013. "Multiple Imputation Methods for Handling Missing Data in Cost-effectiveness Analyses That Use Data from Hierarchical Studies," Medical Decision Making, , vol. 33(8), pages 1051-1063, November.
    6. Browne, William J., 2006. "MCMC algorithms for constrained variance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1655-1677, April.
    7. Daniel, Rhian M. & Kenward, Michael G., 2012. "A method for increasing the robustness of multiple imputation," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1624-1643.
    8. Carpenter, James R. & Goldstein, Harvey & Kenward, Michael G., 2011. "REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i05).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gutacker, Nils & Siciliani, Luigi & Moscelli, Giuseppe & Gravelle, Hugh, 2016. "Choice of hospital: Which type of quality matters?," Journal of Health Economics, Elsevier, vol. 50(C), pages 230-246.
    2. Turner, Alex J. & Nikolova, Silviya & Sutton, Matt, 2016. "The effect of living alone on the costs and benefits of surgery amongst older people," Social Science & Medicine, Elsevier, vol. 150(C), pages 95-103.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2016. "Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance," Health Economics, John Wiley & Sons, Ltd., vol. 25(5), pages 515-528, May.
    2. Speidel, Matthias & Drechsler, Jörg & Jolani, Shahab, 2018. "R package hmi: a convenient tool for hierarchical multiple imputation and beyond," IAB-Discussion Paper 201816, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    3. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    4. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    5. Robert D. J. Anderson, 2008. "US Consumer Inflation Expectations: Evidence Regarding Learning, Accuracy and Demographics," Centre for Growth and Business Cycle Research Discussion Paper Series 99, Economics, The University of Manchester.
    6. Yongwei Chen & Dahai Fu, 2015. "Measuring income inequality using survey data: the case of China," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 13(2), pages 299-307, June.
    7. Gopalakrishnan, Raja & Guevara, C. Angelo & Ben-Akiva, Moshe, 2020. "Combining multiple imputation and control function methods to deal with missing data and endogeneity in discrete-choice models," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 45-57.
    8. Arpino, Bruno & Varriale, Roberta, 2009. "Assessing the quality of institutions’ rankings obtained through multilevel linear regression models," MPRA Paper 19873, University Library of Munich, Germany.
    9. Hai Zhong, 2010. "The impact of missing data in the estimation of concentration index: a potential source of bias," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(3), pages 255-266, June.
    10. Creemers, An & Aerts, Marc & Hens, Niel & Molenberghs, Geert, 2012. "A nonparametric approach to weighted estimating equations for regression analysis with missing covariates," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 100-113, January.
    11. Mutz, Rüdiger & Daniel, Hans-Dieter, 2018. "The bibliometric quotient (BQ), or how to measure a researcher’s performance capacity: A Bayesian Poisson Rasch model," Journal of Informetrics, Elsevier, vol. 12(4), pages 1282-1295.
    12. Marquez, Jose & Qualter, Pamela & Petersen, Kimberly & Humphrey, Neil & Black, Louise, 2022. "In a lonely place: Neighbourhood effects on loneliness among adolescents," SocArXiv hzer5, Center for Open Science.
    13. Magne Mogstad & Joseph P Romano & Azeem M Shaikh & Daniel Wilhelm, 2024. "Inference for Ranks with Applications to Mobility across Neighbourhoods and Academic Achievement across Countries," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(1), pages 476-518.
    14. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    15. Martin, Eisele & Zhu, Junyi, 2013. "Multiple imputation in a complex household survey - the German Panel on Household Finances (PHF): challenges and solutions," MPRA Paper 57666, University Library of Munich, Germany.
    16. Cheng, Hao, 2021. "Importance sampling imputation algorithms in quantile regression with their application in CGSS data," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 188(C), pages 498-508.
    17. repec:lan:wpaper:991 is not listed on IDEAS
    18. Tatjana Miljkovic & Ying-Ju Chen, 2021. "A new computational approach for estimation of the Gini index based on grouped data," Computational Statistics, Springer, vol. 36(3), pages 2289-2311, September.
    19. Nils Gutacker & Andrew Street, 2015. "Multidimensional performance assessment using dominance criteria," Working Papers 115cherp, Centre for Health Economics, University of York.
    20. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    21. Sulis, Isabella & Giambona, Francesca & Porcu, Mariano, 2020. "Adjusted indicators of quality and equity for monitoring the education systems over time. Insights on EU15 countries from PISA surveys," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chy:respap:101cherp. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gill Forder (email available below). General contact details of provider: https://edirc.repec.org/data/chyoruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.