IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v53y2009i12p4370-4383.html
   My bibliography  Save this article

Nonparametric estimation of the threshold at an operating point on the ROC curve

Author

Listed:
  • Yousef, Waleed A.
  • Kundu, Subrata
  • Wagner, Robert F.

Abstract

In the problem of binary classification (or medical diagnosis), the classification rule (or diagnostic test) produces a continuous decision variable which is compared to a critical value (or threshold). Test values above (or below) that threshold are called positive (or negative) for disease. The two types of errors associated with every threshold value are Type I (false positive) and Type II (false negative) errors. The Receiver Operating Curve (ROC) describes the relationship between probabilities of these two types of errors. The inverse problem is considered; i.e., given the ROC curve (or its estimate) of a particular classification rule, one is interested in finding the value of the threshold [xi] that leads to a specific operating point on that curve. A nonparametric method for estimating the threshold is proposed. Asymptotic distribution is derived for the proposed estimator. Results from simulated data and real-world data are presented for finite sample size. Finding a particular threshold value is crucial in medical diagnoses, among other fields, where a medical test is used to classify a patient as "diseased" or "nondiseased" based on comparing the test result to a particular threshold value. When the ROC is estimated, an operating point is obtained by fixing probability of one type of error, and obtaining the other one from the estimated curve. Threshold estimation can then be viewed as a quantile estimation for one distribution but with the utilization of the second one.

Suggested Citation

  • Yousef, Waleed A. & Kundu, Subrata & Wagner, Robert F., 2009. "Nonparametric estimation of the threshold at an operating point on the ROC curve," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4370-4383, October.
    • Handle: RePEc:eee:csdana:v:53:y:2009:i:12:p:4370-4383
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(09)00236-9
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Margaret Sullivan Pepe, 2000. "An Interpretation for the ROC Curve and Inference Using GLM Procedures," Biometrics, The International Biometric Society, vol. 56(2), pages 352-359, June.
    2. Lloyd, Chris J. & Yong, Zhou, 1999. "Kernel estimators of the ROC curve are better than empirical," Statistics & Probability Letters, Elsevier, vol. 44(3), pages 221-228, September.
    3. Jing Qin, 2003. "Using logistic regression procedures for estimating receiver operating characteristic curves," Biometrika, Biometrika Trust, vol. 90(3), pages 585-596, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yousef, Waleed A., 2013. "Assessing classifiers in terms of the partial area under the ROC curve," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 51-70.
    2. Coolen-Maturi, Tahani & Elkhafifi, Faiza F. & Coolen, Frank P.A., 2014. "Three-group ROC analysis: A nonparametric predictive approach," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 69-81.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. William M. Briggs & Russell Zaretzki, 2008. "The Skill Plot: A Graphical Technique for Evaluating Continuous Diagnostic Tests," Biometrics, The International Biometric Society, vol. 64(1), pages 250-256, March.
    2. Zhang, Biao, 2006. "A semiparametric hypothesis testing procedure for the ROC curve area under a density ratio model," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1855-1876, April.
    3. Alicja Jokiel-Rokita & Rafał Topolnicki, 2019. "Minimum distance estimation of the binormal ROC curve," Statistical Papers, Springer, vol. 60(6), pages 2161-2183, December.
    4. Daniel J. Luckett & Eric B. Laber & Samer S. El‐Kamary & Cheng Fan & Ravi Jhaveri & Charles M. Perou & Fatma M. Shebl & Michael R. Kosorok, 2021. "Receiver operating characteristic curves and confidence bands for support vector machines," Biometrics, The International Biometric Society, vol. 77(4), pages 1422-1430, December.
    5. Y. Huang & M. S. Pepe, 2009. "A Parametric ROC Model-Based Approach for Evaluating the Predictiveness of Continuous Markers in Case–Control Studies," Biometrics, The International Biometric Society, vol. 65(4), pages 1133-1144, December.
    6. Beom Seuk Hwang & Zhen Chen, 2015. "An Integrated Bayesian Nonparametric Approach for Stochastic and Variability Orders in ROC Curve Estimation: An Application to Endometriosis Diagnosis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 923-934, September.
    7. Jin, Hua & Lu, Ying, 2009. "The ROC region of a regression tree," Statistics & Probability Letters, Elsevier, vol. 79(7), pages 936-942, April.
    8. Holly Janes & Margaret S. Pepe, 2008. "Matching in Studies of Classification Accuracy: Implications for Analysis, Efficiency, and Assessment of Incremental Value," Biometrics, The International Biometric Society, vol. 64(1), pages 1-9, March.
    9. Ziyi Li & Yijian Huang & Dattatraya Patil & Martin G. Sanda, 2023. "Covariate adjustment in continuous biomarker assessment," Biometrics, The International Biometric Society, vol. 79(1), pages 39-48, March.
    10. Elisa–María Molanes-López & Ricardo Cao, 2008. "Relative density estimation for left truncated and right censored data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(8), pages 693-720.
    11. Chen, Xiwei & Vexler, Albert & Markatou, Marianthi, 2015. "Empirical likelihood ratio confidence interval estimation of best linear combinations of biomarkers," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 186-198.
    12. Soutik Ghosal & Zhen Chen, 2022. "Discriminatory Capacity of Prenatal Ultrasound Measures for Large-for-Gestational-Age Birth: A Bayesian Approach to ROC Analysis Using Placement Values," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 14(1), pages 1-22, April.
    13. Lori E. Dodd & Margaret S. Pepe, 2003. "Partial AUC Estimation and Regression," Biometrics, The International Biometric Society, vol. 59(3), pages 614-623, September.
    14. Lloyd, Chris J., 2002. "Estimation of a convex ROC curve," Statistics & Probability Letters, Elsevier, vol. 59(1), pages 99-111, August.
    15. Holly Janes & Gary Longton & Margaret S. Pepe, 2009. "Accommodating covariates in receiver operating characteristic analysis," Stata Journal, StataCorp LP, vol. 9(1), pages 17-39, March.
    16. Arís Fanjul-Hevia & Wenceslao González-Manteiga, 2018. "A comparative study of methods for testing the equality of two or more ROC curves," Computational Statistics, Springer, vol. 33(1), pages 357-377, March.
    17. Rufibach Kaspar, 2012. "A Smooth ROC Curve Estimator Based on Log-Concave Density Estimates," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-29, April.
    18. Douglas Mossman & Hongying Peng, 2016. "Using Dual Beta Distributions to Create “Proper†ROC Curves Based on Rating Category Data," Medical Decision Making, , vol. 36(3), pages 349-365, April.
    19. Rodríguez-Álvarez, María Xosé & Roca-Pardiñas, Javier & Cadarso-Suárez, Carmen, 2011. "A new flexible direct ROC regression model: Application to the detection of cardiovascular risk factors by anthropometric measures," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3257-3270, December.
    20. Luo, Jingqin & Xiong, Chengjie, 2012. "DiagTest3Grp: An R Package for Analyzing Diagnostic Tests with Three Ordinal Groups," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 51(i03).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:53:y:2009:i:12:p:4370-4383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.