IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v15y2018i9p2015-d170007.html
   My bibliography  Save this article

Detecting and Visualizing Outliers in Provider Profiling Using Funnel Plots and Mixed Effects Models—An Example from Prescription Claims Data

Author

Listed:
  • Oliver Hirsch

    (Department of General Practice/Family Medicine, Philipps University Marburg, Karl-von-Frisch-Str.4, 35043 Marburg, Germany)

  • Norbert Donner-Banzhoff

    (Department of General Practice/Family Medicine, Philipps University Marburg, Karl-von-Frisch-Str.4, 35043 Marburg, Germany)

  • Maike Schulz

    (Central Research Institute of Ambulatory Health Care in Germany (ZI), Salzufer 8, 10587 Berlin, Germany)

  • Michael Erhart

    (Central Research Institute of Ambulatory Health Care in Germany (ZI), Salzufer 8, 10587 Berlin, Germany)

Abstract

When prescribing a drug for a patient, a physician also has to consider economic aspects. We were interested in the feasibility and validity of profiling based on funnel plots and mixed effect models for the surveillance of German ambulatory care physicians’ prescribing. We analyzed prescriptions issued to patients with a health insurance card attending neurologists’ and psychiatrists’ ambulatory practices in the German federal state of Saarland. The German National Association of Statutory Health Insurance Physicians developed a prescribing assessment scheme (PAS) which contains a systematic appraisal of the benefit of drugs for so far 12 different indications. The drugs have been classified on the basis of their clinical evidence as “standard”, “reserve” or “third level” medication. We had 152.583 prescriptions in 56 practices available for analysis. A total of 38.796 patients received these prescriptions. The funnel plot approach with additive correction for overdispersion was almost equivalent to a mixed effects model which directly took the multilevel structure of the data into account. In the first case three practices were labeled as outliers, the mixed effects model resulted in two outliers. We suggest that both techniques should be routinely applied within a surveillance system of prescription claims data.

Suggested Citation

  • Oliver Hirsch & Norbert Donner-Banzhoff & Maike Schulz & Michael Erhart, 2018. "Detecting and Visualizing Outliers in Provider Profiling Using Funnel Plots and Mixed Effects Models—An Example from Prescription Claims Data," IJERPH, MDPI, vol. 15(9), pages 1-11, September.
    • Handle: RePEc:gam:jijerp:v:15:y:2018:i:9:p:2015-:d:170007
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/15/9/2015/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/15/9/2015/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Norbert Berthold & Nadya Kosturkova & Andreas Müller, 2010. "Die Bundesländer im Standortwettbewerb - gestern, heute und morgen," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 63(02), pages 15-20, January.
    2. David I. Ohlssen & Linda D. Sharples & David J. Spiegelhalter, 2007. "A hierarchical modelling framework for identifying unusual performance in health care providers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 865-890, October.
    3. Orzella, Letizia & Chini, Francesco & Giorgi Rossi, Paolo & Borgia, Piero, 2010. "Physician and patient characteristics associated with prescriptions and costs of drugs in the Lazio region of Italy," Health Policy, Elsevier, vol. 95(2-3), pages 236-244, May.
    4. Francesca Ieva & Anna Paganoni, 2015. "Detecting and visualizing outliers in provider profiling via funnel plots and mixed effect models," Health Care Management Science, Springer, vol. 18(2), pages 166-172, June.
    5. Manuel Gomes & Nils Gutacker & Chris Bojke & Andrew Street, 2016. "Addressing Missing Data in Patient‐Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance," Health Economics, John Wiley & Sons, Ltd., vol. 25(5), pages 515-528, May.
    6. Burgess Jr., James F. & Christiansen, Cindy L. & Michalak, Sarah E. & Morris, Carl N., 2000. "Medical profiling: improving standards and risk adjustments using hierarchical models," Journal of Health Economics, Elsevier, vol. 19(3), pages 291-309, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nils Gutacker & Andrew Street, 2018. "Multidimensional performance assessment of public sector organisations using dominance criteria," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 13-27, February.
    2. Thompson, Simon G. & Nixon, Richard M. & Grieve, Richard, 2006. "Addressing the issues that arise in analysing multicentre cost data, with application to a multinational study," Journal of Health Economics, Elsevier, vol. 25(6), pages 1015-1028, November.
    3. Silviya Nikolova & Mark Harrison & Matt Sutton, 2016. "The Impact of Waiting Time on Health Gains from Surgery: Evidence from a National Patient‐reported Outcome Dataset," Health Economics, John Wiley & Sons, Ltd., vol. 25(8), pages 955-968, August.
    4. Francesco Longo & Luigi Siciliani & Andrew Street, 2019. "Are cost differences between specialist and general hospitals compensated by the prospective payment system?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 7-26, February.
    5. Kathleen Carey, 2000. "A multilevel modelling approach to analysis of patient costs under managed care," Health Economics, John Wiley & Sons, Ltd., vol. 9(5), pages 435-446, July.
    6. Giuseppe Moscelli & Hugh Gravelle & Luigi Siciliani, 2018. "Effects of Market Structure and Patient Choice on Hospital Quality for Planned Patients," School of Economics Discussion Papers 1118, School of Economics, University of Surrey.
    7. Or, Zeynep & Wang, Jia & Jamison, Dean, 2005. "International differences in the impact of doctors on health: a multilevel analysis of OECD countries," Journal of Health Economics, Elsevier, vol. 24(3), pages 531-560, May.
    8. Nicodemo, Catia & Orso, Cristina E. & Tealdi, Cristina, 2023. "Overseas GPs and Prescription Behaviour in England," IZA Discussion Papers 15884, Institute of Labor Economics (IZA).
    9. Karen Eggleston & Randall P. Ellis & Mingshan Lu, 2007. "Prevention and Dynamic Risk Adjustment," Boston University - Department of Economics - Working Papers Series WP2007-023, Boston University - Department of Economics.
    10. Darren Grant, 2005. "Information and sorting in the market for obstetrical services," Health Economics, John Wiley & Sons, Ltd., vol. 14(7), pages 703-719, July.
    11. D. Fouskakis & I. Ntzoufras & D. Draper, 2009. "Population‐based reversible jump Markov chain Monte Carlo methods for Bayesian variable selection and evaluation under cost limit restrictions," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 58(3), pages 383-403, July.
    12. David I. Ohlssen & Linda D. Sharples & David J. Spiegelhalter, 2007. "A hierarchical modelling framework for identifying unusual performance in health care providers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(4), pages 865-890, October.
    13. Tommaso Agasisti & Francesca Ieva & Anna Maria Paganoni, 2017. "Heterogeneity, school-effects and the North/South achievement gap in Italian secondary education: evidence from a three-level mixed model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(1), pages 157-180, March.
    14. Abramo, Giovanni & D’Angelo, Andrea Ciriaco & Grilli, Leonardo, 2016. "From rankings to funnel plots: The question of accounting for uncertainty when assessing university research performance," Journal of Informetrics, Elsevier, vol. 10(3), pages 854-862.
    15. Milstein, Ricarda & Schreyoegg, Jonas, 2016. "Pay for performance in the inpatient sector: A review of 34 P4P programs in 14 OECD countries," Health Policy, Elsevier, vol. 120(10), pages 1125-1140.
    16. Liang Long & Jie Lin & Kimon Proussaloglou, 2010. "Investigating Contextual Variability in Mode Choice in Chicago Using a Hierarchical Mixed Logit Model," Urban Studies, Urban Studies Journal Limited, vol. 47(11), pages 2445-2459, October.
    17. Karri Seppä & Timo Hakulinen & Esa Läärä, 2014. "Regional variation in relative survival—quantifying the effects of the competing risks of death by using a cure fraction model with random effects," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(1), pages 175-190, January.
    18. John Robinson & Scott Zeger & Christopher Forrest, 2004. "Studying Effects of Primary Care Physicians and Patients on the Trade-Off Between Charges for Primary Care and Specialty Care Using a Hierarchical Multivariate Two-Part Model," Johns Hopkins University Dept. of Biostatistics Working Paper Series 1051, Berkeley Electronic Press.
    19. Jie Lin & Liang Long, 2008. "What neighborhood are you in? Empirical findings of relationships between household travel and neighborhood characteristics," Transportation, Springer, vol. 35(6), pages 739-758, November.
    20. David J. Spiegelhalter & Paul Aylin & Nicola G. Best & Stephen J. W. Evans & Gordon D. Murray, 2002. "Commissioned analysis of surgical performance using routine data: lessons from the Bristol inquiry," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(2), pages 191-221, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:15:y:2018:i:9:p:2015-:d:170007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.