IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v20y2000i2p170-184.html
   My bibliography  Save this article

Using Localization Data from Image Interpretations to Improve Estimates of Performance Accuracy

Author

Listed:
  • Richard G. Swensson

Abstract

A recently developed model uses the localization of abnormalities on images to improve statistical precision in measuring detection accuracy A z , the area below an observer's receiver operating characteristic (ROC) curve for ratings of sampled normal and abnormal cases. This study evaluated that improvement by investigating how much the standard error of estimated A z decreased when the statistical analysis included localization data. Comparisons of analyses with vs without localizations were made for: 1) the estimates of A z from observers' rating ROC curves for nodular lesions on clinical chest films and liver CT scans; 2) the probability of correct choices between paired samples of normal and abnormal cases (equivalent to A z ); and 3) the sampling distributions of A z measured in Monte Carlo simulations of 2,000 independent rating experiments. Localization information considerably improved the precision of A z estimates, particularly when detection accuracy was low ( A z ~ 0.60). These data provided roughly the same benefits in estimation precision as would two-to-fourfold increases in the sizes of both 1) the samples of positive and negative cases and 2) the observer samples used to estimate A z means. Key words: ROC analysis; LROC; observer performance accuracy; observer vanability; detection; localization; image interpretation. (Med Decis Making 2000;20:170-185)

Suggested Citation

  • Richard G. Swensson, 2000. "Using Localization Data from Image Interpretations to Improve Estimates of Performance Accuracy," Medical Decision Making, , vol. 20(2), pages 170-184, April.
  • Handle: RePEc:sae:medema:v:20:y:2000:i:2:p:170-184
    DOI: 10.1177/0272989X0002000203
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X0002000203
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X0002000203?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:20:y:2000:i:2:p:170-184. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.