IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v83y2015icp82-90.html
   My bibliography  Save this article

Performance measures of the bivariate random effects model for meta-analyses of diagnostic accuracy

Author

Listed:
  • Diaz, Mireya

Abstract

The bivariate random effects model has been advocated for the meta-analysis of diagnostic accuracy despite scarce information regarding its statistical performance for non-comparative categorical outcomes. Four staggered simulation experiments using a full-factorial design were conducted to assess such performance over a wide range of scenarios. The number of studies, the number of individuals per study, diagnostic accuracy values, heterogeneity, correlation, and disease prevalence were evaluated as factors. Univariate and bivariate random effects were estimated using NLMIXED with trust region optimization. Bias, accuracy, and coverage probability were evaluated as performance metrics among 1000 replicates in 272 different scenarios. Number of studies, individuals per study, and heterogeneity were the most influential meta-analytic factors affecting most metrics in all parameters for both random effects models. More studies improved all metrics while low heterogeneity benefited fixed and random effects but not the correlation. About twenty studies are required to obtain random effects estimates with good statistical properties in the presence of moderate heterogeneity, while only the univariate model should be used when few studies are summarized. In general, the bivariate model is advantageous for meta-analyses of diagnostic accuracy with complete data only when the correlation is of interest.

Suggested Citation

  • Diaz, Mireya, 2015. "Performance measures of the bivariate random effects model for meta-analyses of diagnostic accuracy," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 82-90.
    • Handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:82-90
    DOI: 10.1016/j.csda.2014.09.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947314002825
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2014.09.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Austin Peter C, 2010. "Estimating Multilevel Logistic Regression Models When the Number of Clusters is Low: A Comparison of Different Statistical Software Procedures," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-20, April.
    2. Haitao Chu & Hongfei Guo & Yijie Zhou, 2010. "Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models," Medical Decision Making, , vol. 30(4), pages 499-508, July.
    3. Chu, Haitao & Chen, Sining & Louis, Thomas A., 2009. "Random Effects Models in a Meta-Analysis of the Accuracy of Two Diagnostic Tests Without a Gold Standard," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 512-523.
    4. Emmanuel Lesaffre & Bart Spiessens, 2001. "On the effect of the number of quadrature points in a logistic random effects model: an example," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(3), pages 325-335.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alejandra Tapia & Victor Leiva & Maria del Pilar Diaz & Viviana Giampaoli, 2019. "Influence diagnostics in mixed effects logistic regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 920-942, September.
    2. Altaf H Khan, 2019. "An Application of Sinc Function based Quadrature Method in Statistical Models," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 9(4), pages 91-96, May.
    3. Nandini Dendukuri & Ian Schiller & Lawrence Joseph & Madhukar Pai, 2012. "Bayesian Meta-Analysis of the Accuracy of a Test for Tuberculous Pleuritis in the Absence of a Gold Standard Reference," Biometrics, The International Biometric Society, vol. 68(4), pages 1285-1293, December.
    4. Sandra Alvear-Vega & Héctor Vargas-Garrido, 2022. "Social Determinants of the Non-Utilization of the Supplementary Feeding Program (PACAM) Aimed at Older Adults’ Nutritional Support," IJERPH, MDPI, vol. 19(21), pages 1-10, November.
    5. Steffen Andreas Schüle & Gabriele Bolte, 2015. "Interactive and Independent Associations between the Socioeconomic and Objective Built Environment on the Neighbourhood Level and Individual Health: A Systematic Review of Multilevel Studies," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-31, April.
    6. Hammon, Angelina & Zinn, Sabine, 2020. "Multiple imputation of binary multilevel missing not at random data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 69(3), pages 547-564.
    7. Kamphuis, Pascal & Glebbeek, Arie C., 2020. "Job (in)security and workers' training decisions: A framing approach," International Journal for Research in Vocational Education and Training (IJRVET), European Research Network in Vocational Education and Training (VETNET), European Educational Research Association, vol. 7(3), pages 361-387.
    8. Aristidis K. Nikoloulopoulos, 2022. "An one‐factor copula mixed model for joint meta‐analysis of multiple diagnostic tests," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1398-1423, July.
    9. Stephen Schilling & R. Bock, 2005. "High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature," Psychometrika, Springer;The Psychometric Society, vol. 70(3), pages 533-555, September.
    10. Daniel McNeish & Jeffrey R. Harring & Denis Dumas, 2023. "A multilevel structured latent curve model for disaggregating student and school contributions to learning," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(2), pages 545-575, June.
    11. Nathalie Greenan & Ekaterina Kalugina & Mouhamadou Moustapha Niang, 2017. "Work Organisation and Workforce Vunerability to Non-Employment: Evidence from OECD’s Survey on Adult Skills (PIAAC) [Organisation du travail et vulnérabilité au non-emploi : une étude empirique à p," Working Papers hal-02162457, HAL.
    12. Gonzalez, Jorge & Tuerlinckx, Francis & De Boeck, Paul & Cools, Ronald, 2006. "Numerical integration in logistic-normal models," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1535-1548, December.
    13. Broström, Göran & Holmberg, Henrik, 2011. "Generalized linear models with clustered data: Fixed and random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3123-3134, December.
    14. Clara Drew & Moses Badio & Dehkontee Dennis & Lisa Hensley & Elizabeth Higgs & Michael Sneller & Mosoka Fallah & Cavan Reilly, 2023. "Simplifying the estimation of diagnostic testing accuracy over time for high specificity tests in the absence of a gold standard," Biometrics, The International Biometric Society, vol. 79(2), pages 1546-1558, June.
    15. Baghishani, Hossein & Mohammadzadeh, Mohsen, 2011. "A data cloning algorithm for computing maximum likelihood estimates in spatial generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1748-1759, April.
    16. Harold Doran, 2023. "A Collection of Numerical Recipes Useful for Building Scalable Psychometric Applications," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 37-69, February.
    17. Nasim Vahabi & Anoshirvan Kazemnejad & Somnath Datta, 2018. "A Marginalized Overdispersed Location Scale Model for Clustered Ordinal Data," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 103-134, December.
    18. D. Betsy McCoach & Graham G. Rifenbark & Sarah D. Newton & Xiaoran Li & Janice Kooken & Dani Yomtov & Anthony J. Gambino & Aarti Bellara, 2018. "Does the Package Matter? A Comparison of Five Common Multilevel Modeling Software Packages," Journal of Educational and Behavioral Statistics, , vol. 43(5), pages 594-627, October.
    19. Yun, Sungcheol & Lee, Youngjo, 2004. "Comparison of hierarchical and marginal likelihood estimators for binary outcomes," Computational Statistics & Data Analysis, Elsevier, vol. 45(3), pages 639-650, April.
    20. Kim, Tae Jun & Vonneilich, Nico & Lüdecke, Daniel & von dem Knesebeck, Olaf, 2017. "Income, financial barriers to health care and public health expenditure: A multilevel analysis of 28 countries," Social Science & Medicine, Elsevier, vol. 176(C), pages 158-165.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:82-90. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.