Author
Listed:
- Faaizah Arshad
(University of California, Los Angeles
Observational Health Data Sciences and Informatics)
- Martijn J. Schuemie
(University of California, Los Angeles
Observational Health Data Sciences and Informatics
Observational Health Data Analytics, Janssen R&D)
- Fan Bu
(University of California, Los Angeles
Observational Health Data Sciences and Informatics)
- Evan P. Minty
(University of Calgary)
- Thamir M. Alshammari
(King Saud University)
- Lana Y. H. Lai
(University of Manchester)
- Talita Duarte-Salles
(Fundació Institut Universitari per a la recerca a l’Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol))
- Stephen Fortin
(Observational Health Data Analytics, Janssen R&D)
- Fredrik Nyberg
(University of Gothenburg)
- Patrick B. Ryan
(Observational Health Data Sciences and Informatics
Observational Health Data Analytics, Janssen R&D)
- George Hripcsak
(Observational Health Data Sciences and Informatics
Columbia University
New York-Presbyterian Hospital)
- Daniel Prieto-Alhambra
(University of Oxford
Erasmus Medical Center University)
- Marc A. Suchard
(University of California, Los Angeles
Observational Health Data Sciences and Informatics
University of California, Los Angeles
US Department of Veterans Affairs)
Abstract
Introduction Vaccine safety surveillance commonly includes a serial testing approach with a sensitive method for ‘signal generation’ and specific method for ‘signal validation.’ The extent to which serial testing in real-world studies improves or hinders overall performance in terms of sensitivity and specificity remains unknown. Methods We assessed the overall performance of serial testing using three administrative claims and one electronic health record database. We compared type I and II errors before and after empirical calibration for historical comparator, self-controlled case series (SCCS), and the serial combination of those designs against six vaccine exposure groups with 93 negative control and 279 imputed positive control outcomes. Results The historical comparator design mostly had fewer type II errors than SCCS. SCCS had fewer type I errors than the historical comparator. Before empirical calibration, the serial combination increased specificity and decreased sensitivity. Type II errors mostly exceeded 50%. After empirical calibration, type I errors returned to nominal; sensitivity was lowest when the methods were combined. Conclusion While serial combination produced fewer false-positive signals compared with the most specific method, it generated more false-negative signals compared with the most sensitive method. Using a historical comparator design followed by an SCCS analysis yielded decreased sensitivity in evaluating safety signals relative to a one-stage SCCS approach. While the current use of serial testing in vaccine surveillance may provide a practical paradigm for signal identification and triage, single epidemiological designs should be explored as valuable approaches to detecting signals.
Suggested Citation
Faaizah Arshad & Martijn J. Schuemie & Fan Bu & Evan P. Minty & Thamir M. Alshammari & Lana Y. H. Lai & Talita Duarte-Salles & Stephen Fortin & Fredrik Nyberg & Patrick B. Ryan & George Hripcsak & Dan, 2023.
"Serially Combining Epidemiological Designs Does Not Improve Overall Signal Detection in Vaccine Safety Surveillance,"
Drug Safety, Springer, vol. 46(8), pages 797-807, August.
Handle:
RePEc:spr:drugsa:v:46:y:2023:i:8:d:10.1007_s40264-023-01324-1
DOI: 10.1007/s40264-023-01324-1
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:drugsa:v:46:y:2023:i:8:d:10.1007_s40264-023-01324-1. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com/economics/journal/40264 .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.