IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v133y2019icp40-52.html
   My bibliography  Save this article

Bayesian Semiparametric ROC surface estimation under verification bias

Author

Listed:
  • Zhu, Rui
  • Ghosal, Subhashis

Abstract

The Receiver Operating Characteristic (ROC) surface is a generalization of the ROC curve and is widely used for assessment of the accuracy of diagnostic tests on three categories. Verification bias occurs when not all subjects have their labels observed. This is a common problem in disease diagnosis since the gold standard test to get labels, i.e., the true disease status, can be invasive and expensive. The same situation happens in the evaluation of semi-supervised learning, where the unlabeled data are incorporated. A Bayesian approach for estimating the ROC surface is proposed based on continuous data under a semi-parametric trinormality assumption. The proposed method is then extended to situations in the presence of verification bias. The posterior distribution is computed under the trinormality assumption using a rank-based likelihood. The consistency of the posterior under a mild condition is also established. The proposed method is compared with existing methods for estimating an ROC surface. Simulation results show that it performs well in terms of accuracy. The method is applied to evaluate the performance of CA125 and HE4 in the diagnosis of epithelial ovarian cancer (EOC) as a demonstration.

Suggested Citation

  • Zhu, Rui & Ghosal, Subhashis, 2019. "Bayesian Semiparametric ROC surface estimation under verification bias," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 40-52.
    • Handle: RePEc:eee:csdana:v:133:y:2019:i:c:p:40-52
    DOI: 10.1016/j.csda.2018.09.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947318302317
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2018.09.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:bla:jorssc:v:57:y:2008:i:1:p:1-23 is not listed on IDEAS
    2. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265, October.
    3. Kang, Le & Tian, Lili, 2013. "Estimation of the volume under the ROC surface with three ordinal diagnostic categories," Computational Statistics & Data Analysis, Elsevier, vol. 62(C), pages 39-51.
    4. Todd A. Alonzo & Margaret Sullivan Pepe, 2005. "Assessing accuracy of a continuous screening test in the presence of verification bias," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(1), pages 173-190, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chinyereugo M Umemneku Chikere & Kevin Wilson & Sara Graziadio & Luke Vale & A Joy Allen, 2019. "Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard – An update," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-25, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adimari Gianfranco & Chiogna Monica, 2015. "Nearest-Neighbor Estimation for ROC Analysis under Verification Bias," The International Journal of Biostatistics, De Gruyter, vol. 11(1), pages 109-124, May.
    2. Qianwen Tan & Subhashis Ghosal, 2021. "Bayesian Analysis of Mixed-effect Regression Models Driven by Ordinary Differential Equations," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 3-29, May.
    3. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    4. Danping Liu & Xiao-Hua Zhou, 2013. "Covariate Adjustment in Estimating the Area Under ROC Curve with Partially Missing Gold Standard," Biometrics, The International Biometric Society, vol. 69(1), pages 91-100, March.
    5. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    6. Coolen-Maturi, Tahani & Elkhafifi, Faiza F. & Coolen, Frank P.A., 2014. "Three-group ROC analysis: A nonparametric predictive approach," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 69-81.
    7. A Stefano Caria & Grant Gordon & Maximilian Kasy & Simon Quinn & Soha Osman Shami & Alexander Teytelboym, 2024. "An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in Jordan," Journal of the European Economic Association, European Economic Association, vol. 22(2), pages 781-836.
    8. Reiß, Markus & Schmidt-Hieber, Johannes, 2020. "Posterior contraction rates for support boundary recovery," Stochastic Processes and their Applications, Elsevier, vol. 130(11), pages 6638-6656.
    9. Dmitry B. Rokhlin, 2021. "Relative utility bounds for empirically optimal portfolios," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 93(3), pages 437-462, June.
    10. Suzanne Sniekers & Aad Vaart, 2020. "Adaptive Bayesian credible bands in regression with a Gaussian process prior," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 82(2), pages 386-425, August.
    11. Shota Gugushvili & Frank van der Meulen & Moritz Schauer & Peter Spreij, 2018. "Nonparametric Bayesian volatility estimation," Papers 1801.09956, arXiv.org, revised Mar 2019.
    12. Martin Burda & Remi Daviet, 2023. "Hamiltonian sequential Monte Carlo with application to consumer choice behavior," Econometric Reviews, Taylor & Francis Journals, vol. 42(1), pages 54-77, January.
    13. Shanshan Li & Yang Ning, 2015. "Estimation of covariate‐specific time‐dependent ROC curves in the presence of missing biomarkers," Biometrics, The International Biometric Society, vol. 71(3), pages 666-676, September.
    14. Agustín G. Nogales, 2022. "On Consistency of the Bayes Estimator of the Density," Mathematics, MDPI, vol. 10(4), pages 1-6, February.
    15. Minerva Mukhopadhyay & Didong Li & David B. Dunson, 2020. "Estimating densities with non‐linear support by using Fisher–Gaussian kernels," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(5), pages 1249-1271, December.
    16. Meier, Alexander & Kirch, Claudia & Meyer, Renate, 2020. "Bayesian nonparametric analysis of multivariate time series: A matrix Gamma Process approach," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    17. I. Votsi & G. Gayraud & V. S. Barbu & N. Limnios, 2021. "Hypotheses testing and posterior concentration rates for semi-Markov processes," Statistical Inference for Stochastic Processes, Springer, vol. 24(3), pages 707-732, October.
    18. Zach Dietz & William Lippitt & Sunder Sethuraman, 2023. "Stick-Breaking processes, Clumping, and Markov Chain Occupation Laws," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(1), pages 129-171, February.
    19. Francesco Denti & Michele Guindani & Fabrizio Leisen & Antonio Lijoi & William Duncan Wadsworth & Marina Vannucci, 2021. "Two‐group Poisson‐Dirichlet mixtures for multiple testing," Biometrics, The International Biometric Society, vol. 77(2), pages 622-633, June.
    20. Bhattacharya, Indrabati & Ghosal, Subhashis, 2021. "Bayesian multivariate quantile regression using Dependent Dirichlet Process prior," Journal of Multivariate Analysis, Elsevier, vol. 185(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:133:y:2019:i:c:p:40-52. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.