IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i3p2649-2663.html
   My bibliography  Save this article

Multiwave validation sampling for error‐prone electronic health records

Author

Listed:
  • Bryan E. Shepherd
  • Kyunghee Han
  • Tong Chen
  • Aihua Bian
  • Shannon Pugh
  • Stephany N. Duda
  • Thomas Lumley
  • William J. Heerman
  • Pamela A. Shaw

Abstract

Electronic health record (EHR) data are increasingly used for biomedical research, but these data have recognized data quality challenges. Data validation is necessary to use EHR data with confidence, but limited resources typically make complete data validation impossible. Using EHR data, we illustrate prospective, multiwave, two‐phase validation sampling to estimate the association between maternal weight gain during pregnancy and the risks of her child developing obesity or asthma. The optimal validation sampling design depends on the unknown efficient influence functions of regression coefficients of interest. In the first wave of our multiwave validation design, we estimate the influence function using the unvalidated (phase 1) data to determine our validation sample; then in subsequent waves, we re‐estimate the influence function using validated (phase 2) data and update our sampling. For efficiency, estimation combines obesity and asthma sampling frames while calibrating sampling weights using generalized raking. We validated 996 of 10,335 mother‐child EHR dyads in six sampling waves. Estimated associations between childhood obesity/asthma and maternal weight gain, as well as other covariates, are compared to naïve estimates that only use unvalidated data. In some cases, estimates markedly differ, underscoring the importance of efficient validation sampling to obtain accurate estimates incorporating validated data.

Suggested Citation

  • Bryan E. Shepherd & Kyunghee Han & Tong Chen & Aihua Bian & Shannon Pugh & Stephany N. Duda & Thomas Lumley & William J. Heerman & Pamela A. Shaw, 2023. "Multiwave validation sampling for error‐prone electronic health records," Biometrics, The International Biometric Society, vol. 79(3), pages 2649-2663, September.
    • Handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2649-2663
    DOI: 10.1111/biom.13713
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13713
    Download Restriction: no
    File URL: https://libkey.io/10.1111/biom.13713?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wright, Tommy, 2017. "Exact optimal sample allocation: More efficient than Neyman," Statistics & Probability Letters, Elsevier, vol. 129(C), pages 50-57.
    2. J. F. Lawless, 2018. "Two-phase outcome-dependent studies for failure times and testing for effects of expensive covariates," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 24(1), pages 28-44, January.
    3. N. E. Breslow & N. Chatterjee, 1999. "Design and analysis of two‐phase studies with binary outcome applied to Wilms tumour prognosis," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 48(4), pages 457-468.
    4. Nicola Heslehurst & Rute Vieira & Zainab Akhter & Hayley Bailey & Emma Slack & Lem Ngongalah & Augustina Pemu & Judith Rankin, 2019. "The association between maternal body mass index and child obesity: A systematic review and meta-analysis," PLOS Medicine, Public Library of Science, vol. 16(6), pages 1-20, June.
    5. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    6. Thomas Lumley & Pamela A. Shaw & James Y. Dai, 2011. "Connections between Survey Calibration Estimators and Semiparametric Models for Incomplete Data," International Statistical Review, International Statistical Institute, vol. 79(2), pages 200-220, August.
    7. Peisong Han, 2016. "Combining Inverse Probability Weighting and Multiple Imputation to Improve Robustness of Estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 246-260, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brady Ryan & Ananthika Nirmalkanna & Candemir Cigsar & Yildiz E. Yilmaz, 2023. "Evaluation of Designs and Estimation Methods Under Response-Dependent Two-Phase Sampling for Genetic Association Studies," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 510-539, July.
    2. Shixiao Zhang & Peisong Han & Changbao Wu, 2023. "Calibration Techniques Encompassing Survey Sampling, Missing Data Analysis and Causal Inference," International Statistical Review, International Statistical Institute, vol. 91(2), pages 165-192, August.
    3. Park, Juhyun & Gasser, Theo & Rousson, Valentin, 2009. "Structural components in functional data," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3452-3465, July.
    4. Zhang, Xin & Wang, Chong & Wu, Yichao, 2018. "Functional envelope for model-free sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 163(C), pages 37-50.
    5. Ana-Maria Staicu & Yingxing Li & Ciprian M. Crainiceanu & David Ruppert, 2014. "Likelihood Ratio Tests for Dependent Data with Applications to Longitudinal and Functional Data Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 932-949, December.
    6. Lu Chen & Li Hsu & Kathleen Malone, 2009. "A Frailty-Model-Based Approach to Estimating the Age-Dependent Penetrance Function of Candidate Genes Using Population-Based Case-Control Study Designs: An Application to Data on the BRCA1 Gene," Biometrics, The International Biometric Society, vol. 65(4), pages 1105-1114, December.
    7. Benchimol, Jonathan & El-Shagi, Makram & Saadon, Yossi, 2022. "Do expert experience and characteristics affect inflation forecasts?," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 205-226.
    8. Sven Otto & Nazarii Salish, 2022. "Approximate Factor Models for Functional Time Series," Papers 2201.02532, arXiv.org, revised May 2024.
    9. Cao, Guanqun & Wang, Li, 2018. "Simultaneous inference for the mean of repeated functional data," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 279-295.
    10. Şentürk, Damla & Ghosh, Samiran & Nguyen, Danh V., 2014. "Exploratory time varying lagged regression: Modeling association of cognitive and functional trajectories with expected clinic visits in older adults," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 1-15.
    11. Amos Mulu & Subas Neupane, 2023. "The Association of Maternal BMI with Overweight among Children Aged 0–59 Months in Kenya: A Nationwide Cross-Sectional Study," IJERPH, MDPI, vol. 20(2), pages 1-13, January.
    12. Wang, Jingxing & Chung, Seokhyun & AlShelahi, Abdullah & Kontar, Raed & Byon, Eunshin & Saigal, Romesh, 2021. "Look-ahead decision making for renewable energy: A dynamic “predict and store” approach," Applied Energy, Elsevier, vol. 296(C).
    13. Heredia, María Belén & Prieur, Clémentine & Eckert, Nicolas, 2022. "Global sensitivity analysis with aggregated Shapley effects, application to avalanche hazard assessment," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    14. Li, Meng & Wang, Kehui & Maity, Arnab & Staicu, Ana-Maria, 2022. "Inference in functional linear quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    15. van der Linde, Angelika, 2008. "Variational Bayesian functional PCA," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 517-533, December.
    16. Linjuan Zheng & Beiting Liang & Guochang Wang, 2024. "Adaptive slicing for functional slice inverse regression," Statistical Papers, Springer, vol. 65(5), pages 3261-3284, July.
    17. Peisong Han & Linglong Kong & Jiwei Zhao & Xingcai Zhou, 2019. "A general framework for quantile estimation with incomplete data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 305-333, April.
    18. Koltchinskii, V. & Lounici, K. & Tsybakov, A.B., 2016. "Estimation of low-rank covariance function," Stochastic Processes and their Applications, Elsevier, vol. 126(12), pages 3952-3967.
    19. Cederbaum, Jona & Scheipl, Fabian & Greven, Sonja, 2018. "Fast symmetric additive covariance smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 25-41.
    20. Cai Li & Luo Xiao & Sheng Luo, 2022. "Joint model for survival and multivariate sparse functional data with application to a study of Alzheimer's Disease," Biometrics, The International Biometric Society, vol. 78(2), pages 435-447, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2649-2663. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.