IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v83y2015icp82-90.html
   My bibliography  Save this article

Performance measures of the bivariate random effects model for meta-analyses of diagnostic accuracy

Author

Listed:
  • Diaz, Mireya

Abstract

The bivariate random effects model has been advocated for the meta-analysis of diagnostic accuracy despite scarce information regarding its statistical performance for non-comparative categorical outcomes. Four staggered simulation experiments using a full-factorial design were conducted to assess such performance over a wide range of scenarios. The number of studies, the number of individuals per study, diagnostic accuracy values, heterogeneity, correlation, and disease prevalence were evaluated as factors. Univariate and bivariate random effects were estimated using NLMIXED with trust region optimization. Bias, accuracy, and coverage probability were evaluated as performance metrics among 1000 replicates in 272 different scenarios. Number of studies, individuals per study, and heterogeneity were the most influential meta-analytic factors affecting most metrics in all parameters for both random effects models. More studies improved all metrics while low heterogeneity benefited fixed and random effects but not the correlation. About twenty studies are required to obtain random effects estimates with good statistical properties in the presence of moderate heterogeneity, while only the univariate model should be used when few studies are summarized. In general, the bivariate model is advantageous for meta-analyses of diagnostic accuracy with complete data only when the correlation is of interest.

Suggested Citation

  • Diaz, Mireya, 2015. "Performance measures of the bivariate random effects model for meta-analyses of diagnostic accuracy," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 82-90.
    • Handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:82-90
    DOI: 10.1016/j.csda.2014.09.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947314002825
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2014.09.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Austin Peter C, 2010. "Estimating Multilevel Logistic Regression Models When the Number of Clusters is Low: A Comparison of Different Statistical Software Procedures," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-20, April.
    2. Chu, Haitao & Chen, Sining & Louis, Thomas A., 2009. "Random Effects Models in a Meta-Analysis of the Accuracy of Two Diagnostic Tests Without a Gold Standard," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 512-523.
    3. Emmanuel Lesaffre & Bart Spiessens, 2001. "On the effect of the number of quadrature points in a logistic random effects model: an example," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(3), pages 325-335.
    4. Haitao Chu & Hongfei Guo & Yijie Zhou, 2010. "Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models," Medical Decision Making, , vol. 30(4), pages 499-508, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alejandra Tapia & Victor Leiva & Maria del Pilar Diaz & Viviana Giampaoli, 2019. "Influence diagnostics in mixed effects logistic regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 920-942, September.
    2. Altaf H Khan, 2019. "An Application of Sinc Function based Quadrature Method in Statistical Models," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 9(4), pages 91-96, May.
    3. Steffen Andreas Schüle & Gabriele Bolte, 2015. "Interactive and Independent Associations between the Socioeconomic and Objective Built Environment on the Neighbourhood Level and Individual Health: A Systematic Review of Multilevel Studies," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-31, April.
    4. Stephen Schilling & R. Bock, 2005. "High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature," Psychometrika, Springer;The Psychometric Society, vol. 70(3), pages 533-555, September.
    5. Daniel McNeish & Jeffrey R. Harring & Denis Dumas, 2023. "A multilevel structured latent curve model for disaggregating student and school contributions to learning," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(2), pages 545-575, June.
    6. Broström, Göran & Holmberg, Henrik, 2011. "Generalized linear models with clustered data: Fixed and random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3123-3134, December.
    7. Clara Drew & Moses Badio & Dehkontee Dennis & Lisa Hensley & Elizabeth Higgs & Michael Sneller & Mosoka Fallah & Cavan Reilly, 2023. "Simplifying the estimation of diagnostic testing accuracy over time for high specificity tests in the absence of a gold standard," Biometrics, The International Biometric Society, vol. 79(2), pages 1546-1558, June.
    8. Harold Doran, 2023. "A Collection of Numerical Recipes Useful for Building Scalable Psychometric Applications," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 37-69, February.
    9. Nasim Vahabi & Anoshirvan Kazemnejad & Somnath Datta, 2018. "A Marginalized Overdispersed Location Scale Model for Clustered Ordinal Data," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 103-134, December.
    10. Kim, Tae Jun & Vonneilich, Nico & Lüdecke, Daniel & von dem Knesebeck, Olaf, 2017. "Income, financial barriers to health care and public health expenditure: A multilevel analysis of 28 countries," Social Science & Medicine, Elsevier, vol. 176(C), pages 158-165.
    11. Giorgio Di Gessa & Karen Glaser & Debora Price & Eloi Ribe & Anthea Tinker, 2016. "What Drives National Differences in Intensive Grandparental Childcare in Europe?," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 71(1), pages 141-153.
    12. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    13. Varin, Cristiano & Host, Gudmund & Skare, Oivind, 2005. "Pairwise likelihood inference in spatial generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 49(4), pages 1173-1191, June.
    14. Song, Fei (Sophie) & Montabon, Frank & Xu, Yuhang, 2018. "The impact of national culture on corporate adoption of environmental management practices and their effectiveness," International Journal of Production Economics, Elsevier, vol. 205(C), pages 313-328.
    15. Özgür Asar & Ozlem Ilk, 2016. "First-order marginalised transition random effects models with probit link function," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(5), pages 925-942, April.
    16. Yulun Liu & Yong Chen & Haitao Chu, 2015. "A unification of models for meta-analysis of diagnostic accuracy studies without a gold standard," Biometrics, The International Biometric Society, vol. 71(2), pages 538-547, June.
    17. L. Bryan, Mark & P. Jenkins, Stephen, 2013. "Regression analysis of country effects using multilevel data: a cautionary tale," ISER Working Paper Series 2013-14, Institute for Social and Economic Research.
    18. Vock, David & Davidian, Marie & Tsiatis, Anastasios, 2014. "SNP_NLMM: A SAS Macro to Implement a Flexible Random Effects Density for Generalized Linear and Nonlinear Mixed Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 56(c02).
    19. Erwin Stolz & Hannes Mayerl & Éva Rásky & Wolfgang Freidl, 2019. "Individual and country-level determinants of nursing home admission in the last year of life in Europe," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-10, March.
    20. Cho, S.-J. & Rabe-Hesketh, S., 2011. "Alternating imputation posterior estimation of models with crossed random effects," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 12-25, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:82-90. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.