IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0028071.html
   My bibliography  Save this article

A Systematic Review of Re-Identification Attacks on Health Data

Author

Listed:
  • Khaled El Emam
  • Elizabeth Jonker
  • Luk Arbuckle
  • Bradley Malin

Abstract

Background: Privacy legislation in most jurisdictions allows the disclosure of health data for secondary purposes without patient consent if it is de-identified. Some recent articles in the medical, legal, and computer science literature have argued that de-identification methods do not provide sufficient protection because they are easy to reverse. Should this be the case, it would have significant and important implications on how health information is disclosed, including: (a) potentially limiting its availability for secondary purposes such as research, and (b) resulting in more identifiable health information being disclosed. Our objectives in this systematic review were to: (a) characterize known re-identification attacks on health data and contrast that to re-identification attacks on other kinds of data, (b) compute the overall proportion of records that have been correctly re-identified in these attacks, and (c) assess whether these demonstrate weaknesses in current de-identification methods. Methods and Findings: Searches were conducted in IEEE Xplore, ACM Digital Library, and PubMed. After screening, fourteen eligible articles representing distinct attacks were identified. On average, approximately a quarter of the records were re-identified across all studies (0.26 with 95% CI 0.046–0.478) and 0.34 for attacks on health data (95% CI 0–0.744). There was considerable uncertainty around the proportions as evidenced by the wide confidence intervals, and the mean proportion of records re-identified was sensitive to unpublished studies. Two of fourteen attacks were performed with data that was de-identified using existing standards. Only one of these attacks was on health data, which resulted in a success rate of 0.00013. Conclusions: The current evidence shows a high re-identification rate but is dominated by small-scale studies on data that was not de-identified according to existing standards. This evidence is insufficient to draw conclusions about the efficacy of de-identification methods.

Suggested Citation

  • Khaled El Emam & Elizabeth Jonker & Luk Arbuckle & Bradley Malin, 2011. "A Systematic Review of Re-Identification Attacks on Health Data," PLOS ONE, Public Library of Science, vol. 6(12), pages 1-12, December.
  • Handle: RePEc:plo:pone00:0028071
    DOI: 10.1371/journal.pone.0028071
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0028071
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0028071&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0028071?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. V. Flack & A. Afifi & P. Lachenbruch & H. Schouten, 1988. "Sample size determinations for the two rater kappa statistic," Psychometrika, Springer;The Psychometric Society, vol. 53(3), pages 321-325, September.
    2. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    3. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    4. Catherine Marsh & Chris Skinner & Sara Arber & Bruce Penhale & Stan Openshaw & John Hobcraft & Denise Lievesley & Nigel Walford, 1991. "The Case for Samples of Anonymized Records from the 1991 Census," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 154(2), pages 305-340, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    2. Su Keng Tan & Wai Keung Leung & Alexander Tin Hong Tang & Roger A Zwahlen, 2017. "Effects of mandibular setback with or without maxillary advancement osteotomies on pharyngeal airways: An overview of systematic reviews," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-20, October.
    3. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    4. Jacob Elnaggar & Fern Tsien & Lucio Miele & Chindo Hicks & Clayton Yates & Melisa Davis, 2019. "An Integrative Genomics Approach for Associating Genetic Susceptibility with the Tumor Immune Microenvironment in Triple Negative Breast Cancer," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 15(1), pages 1-12, February.
    5. Hyun Kim & Navneet Kaur Baidwan & David Kriebel & Manuel Cifuentes & Sherry Baron, 2018. "Asthma among World Trade Center First Responders: A Qualitative Synthesis and Bias Assessment," IJERPH, MDPI, vol. 15(6), pages 1-14, May.
    6. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    7. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    8. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    9. Wei-Wei Chen & Feng Wang & Rui-Hua Xu, 2013. "Platinum-Based Versus Non-Platinum-Based Chemotherapy as First Line Treatment of Inoperable, Advanced Gastric Adenocarcinoma: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    10. Giovanni Vinti & Valerie Bauza & Thomas Clasen & Kate Medlicott & Terry Tudor & Christian Zurbrügg & Mentore Vaccari, 2021. "Municipal Solid Waste Management and Adverse Health Outcomes: A Systematic Review," IJERPH, MDPI, vol. 18(8), pages 1-26, April.
    11. Ferrán Catalá-López & Adolfo Alonso-Arroyo & Matthew J Page & Brian Hutton & Rafael Tabarés-Seisdedos & Rafael Aleixandre-Benavent, 2018. "Mapping of global scientific research in comorbidity and multimorbidity: A cross-sectional analysis," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-24, January.
    12. Hanna Górska-Warsewicz, 2022. "Consumer or Patient Determinants of Hospital Brand Equity—A Systematic Literature Review," IJERPH, MDPI, vol. 19(15), pages 1-36, July.
    13. André Ramalho & João Serrano & Rui Paulo & Pedro Duarte-Mendes & António Rosado & João Petrica, 2021. "Emerging Qualitative Research Trends (2010–2021) on Sedentary Behaviour among Older Adults: A Systematic Literature Review Protocol," IJERPH, MDPI, vol. 18(21), pages 1-8, November.
    14. Tobias Elze, 2010. "Misspecifications of Stimulus Presentation Durations in Experimental Psychology: A Systematic Review of the Psychophysics Literature," PLOS ONE, Public Library of Science, vol. 5(9), pages 1-7, September.
    15. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.
    16. Sibonokuhle Ndlovu, 2023. "Preparedness and Response to COVID-19 Disruptions and Learning Challenges for Students with Disabilities in South Africa: A Systematic Review," Sustainability, MDPI, vol. 15(2), pages 1-17, January.
    17. João Carlos Belloti & Aldo Okamura & Jordana Scheeren & Flávio Faloppa & Vinícius Ynoe de Moraes, 2019. "A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-12, January.
    18. Abbas Mardani & Dalia Streimikiene & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Mehrbakhsh Nilashi & Ahmad Jusoh & Habib Zare, 2017. "Application of Structural Equation Modeling (SEM) to Solve Environmental Sustainability Problems: A Comprehensive Review and Meta-Analysis," Sustainability, MDPI, vol. 9(10), pages 1-65, October.
    19. Luísa Bandeira Lopes & João Albernaz Neves & João Botelho & Vanessa Machado & José João Mendes, 2021. "Regenerative Endodontic Procedures: An Umbrella Review," IJERPH, MDPI, vol. 18(2), pages 1-17, January.
    20. Gaspar, Rui & Yan, Zheng & Domingos, Samuel, 2019. "Extreme natural and man-made events and human adaptive responses mediated by information and communication technologies' use: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 145(C), pages 125-135.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0028071. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.