IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v8y2020i8p1258-d393091.html
   My bibliography  Save this article

Common Medical and Statistical Problems: The Dilemma of the Sample Size Calculation for Sensitivity and Specificity Estimation

Author

Listed:
  • M. Rosário Oliveira

    (Department of Mathematics and CEMAT, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisbon, Portugal
    These authors contributed equally to this work.)

  • Ana Subtil

    (Department of Mathematics and CEMAT, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisbon, Portugal
    These authors contributed equally to this work.)

  • Luzia Gonçalves

    (Unidade de Saúde Pública Internacional e Bioestatística, Global Health and Tropical Medicine, Instituto de Higiene e Medicina Tropical, Universidade Nova de Lisboa and Centro de Estatística e Aplicações da Universidade de Lisboa, Rua da Junqueira, 100, 1349-008 Lisbon, Portugal)

Abstract

Sample size calculation in biomedical practice is typically based on the problematic Wald method for a binomial proportion, with potentially dangerous consequences. This work highlights the need of incorporating the concept of conditional probability in sample size determination to avoid reduced sample sizes that lead to inadequate confidence intervals. Therefore, new definitions are proposed for coverage probability and expected length of confidence intervals for conditional probabilities, like sensitivity and specificity. The new definitions were used to assess seven confidence interval estimation methods. In order to determine the sample size, two procedures—an optimal one, based on the new definitions, and an approximation—were developed for each estimation method. Our findings confirm the similarity of the approximated sample sizes to the optimal ones. R code is provided to disseminate these methodological advances and translate them into biomedical practice.

Suggested Citation

  • M. Rosário Oliveira & Ana Subtil & Luzia Gonçalves, 2020. "Common Medical and Statistical Problems: The Dilemma of the Sample Size Calculation for Sensitivity and Specificity Estimation," Mathematics, MDPI, vol. 8(8), pages 1-17, August.
  • Handle: RePEc:gam:jmathe:v:8:y:2020:i:8:p:1258-:d:393091
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/8/8/1258/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/8/8/1258/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vos, Paul W. & Hudson, Suzanne, 2005. "Evaluation Criteria for Discrete Confidence Intervals: Beyond Coverage and Length," The American Statistician, American Statistical Association, vol. 59, pages 137-142, May.
    2. Nandini Dendukuri & Elham Rahme & Patrick Bélisle & Lawrence Joseph, 2004. "Bayesian Sample Size Determination for Prevalence and Diagnostic Test Studies in the Absence of a Gold Standard Test," Biometrics, The International Biometric Society, vol. 60(2), pages 388-397, June.
    3. Luzia Gonçalves & M. Rosário de Oliveira & Cláudia Pascoal & Ana Pires, 2012. "Sample size for estimating a binomial proportion: comparison of different methods," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(11), pages 2453-2473, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luzia Gonçalves & M. Rosário de Oliveira & Cláudia Pascoal & Ana Pires, 2012. "Sample size for estimating a binomial proportion: comparison of different methods," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(11), pages 2453-2473, July.
    2. Sander Greenland, 2005. "Multiple‐bias modelling for analysis of observational data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 267-306, March.
    3. Geoffrey Jones & Wesley O. Johnson & Timothy E. Hanson & Ronald Christensen, 2010. "Identifiability of Models for Multiple Diagnostic Testing in the Absence of a Gold Standard," Biometrics, The International Biometric Society, vol. 66(3), pages 855-863, September.
    4. Chinyereugo M Umemneku Chikere & Kevin Wilson & Sara Graziadio & Luke Vale & A Joy Allen, 2019. "Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard – An update," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-25, October.
    5. Hanson, Samuel & Schuermann, Til, 2006. "Confidence intervals for probabilities of default," Journal of Banking & Finance, Elsevier, vol. 30(8), pages 2281-2301, August.
    6. Beavers, Daniel P. & Stamey, James D., 2012. "Bayesian sample size determination for binary regression with a misclassified covariate and no gold standard," Computational Statistics & Data Analysis, Elsevier, vol. 56(8), pages 2574-2582.
    7. Stamey, James D. & Boese, Doyle H. & Young, Dean M., 2008. "Confidence intervals for parameters of two diagnostic tests in the absence of a gold standard," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1335-1346, January.
    8. Paul Gustafson & Sander Greenland, 2006. "The Performance of Random Coefficient Regression in Accounting for Residual Confounding," Biometrics, The International Biometric Society, vol. 62(3), pages 760-768, September.
    9. Paul Vos & Qiang Wu, 2012. "Estimators for the binomial distribution that dominate the MLE in terms of Kullback–Leibler risk," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(2), pages 359-371, April.
    10. Paul Gustafson, 2006. "Sample size implications when biases are modelled rather than ignored," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(4), pages 865-881, October.
    11. Zhuoyu Wang & Nandini Dendukuri & Madhukar Pai & Lawrence Joseph, 2017. "Taking Costs and Diagnostic Test Accuracy into Account When Designing Prevalence Studies: An Application to Childhood Tuberculosis Prevalence," Medical Decision Making, , vol. 37(8), pages 922-929, November.
    12. Paul Gustafson, 2007. "Measurement error modelling with an approximate instrumental variable," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 797-815, November.
    13. Roldán Nofuentes, J.A. & Luna del Castillo, J.D. & Montero Alonso, M.A., 2009. "Determining sample size to evaluate and compare the accuracy of binary diagnostic tests in the presence of partial disease verification," Computational Statistics & Data Analysis, Elsevier, vol. 53(3), pages 742-755, January.
    14. Stamey, James & Gerlach, Richard, 2007. "Bayesian sample size determination for case-control studies with misclassification," Computational Statistics & Data Analysis, Elsevier, vol. 51(6), pages 2982-2992, March.
    15. Luzia Gonçalves & Zélia Santos & Miguel Amado & Daniela Alves & Rui Simões & António Pedro Delgado & Artur Correia & Jorge Cabral & Luís Velez Lapão & Isabel Craveiro, 2015. "Urban Planning and Health Inequities: Looking in a Small-Scale in a City of Cape Verde," PLOS ONE, Public Library of Science, vol. 10(11), pages 1-27, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:8:y:2020:i:8:p:1258-:d:393091. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.