IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v7y1987i2p115-119.html
   My bibliography  Save this article

Workup Bias in Prediction Research

Author

Listed:
  • Robert J. Panzer
  • Anthony L. Suchman
  • Paul F. Griner

Abstract

Studies often suggest that accepted clinical predictors actually have little predictive strength. One explanation for some such results is the presence of workup bias. To explore the effects of workup bias in prediction research, the authors modeled the effects of workup bias on the ability of early clinical findings to predict intracerebral hemorrhage in patients with stroke. In a simulated biased sample, workup bias resulted in distorted operating characteristics for those clinical findings influencing application of the "gold standard" and for other related findings. Sensitivity was increased, but both specificity and likelihood ratios were decreased in the biased sample. Workup bias can spuriously decrease predictive abilities for accepted clinical findings when such findings guide application of the "gold standard." Investigators should be aware of the potential effects of workup bias, search for clues to its occurrence, and interpret study results carefully when it is present. Key words: workup bias; prediction rules; stroke; intracerebral hemorrhage. (Med Decis Making 7:115-119, 1987)

Suggested Citation

  • Robert J. Panzer & Anthony L. Suchman & Paul F. Griner, 1987. "Workup Bias in Prediction Research," Medical Decision Making, , vol. 7(2), pages 115-119, June.
  • Handle: RePEc:sae:medema:v:7:y:1987:i:2:p:115-119
    DOI: 10.1177/0272989X8700700209
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X8700700209
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X8700700209?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Barbara J. McNeil & James A. Hanley, 1984. "Statistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves," Medical Decision Making, , vol. 4(2), pages 137-150, June.
    2. Robert Gray & Colin B. Begg & Robert A. Greenes, 1984. "Construction of Receiver Operating Characteristic Curves when Disease Verification Is Subject to Selection Bias," Medical Decision Making, , vol. 4(2), pages 151-164, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. George A. Diamond, 1987. "ROCky III," Medical Decision Making, , vol. 7(4), pages 247-249, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. George A. Diamond, 1987. "ROC Steady," Medical Decision Making, , vol. 7(4), pages 238-243, December.
    2. Xiangjin Shen & Shiliang Li & Hiroki Tsurumi, 2013. "Comparison of Parametric and Semi-Parametric Binary Response Models," Departmental Working Papers 201308, Rutgers University, Department of Economics.
    3. Chinyereugo M Umemneku Chikere & Kevin Wilson & Sara Graziadio & Luke Vale & A Joy Allen, 2019. "Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard – An update," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-25, October.
    4. James A. Hanley, 1988. "The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves," Medical Decision Making, , vol. 8(3), pages 197-203, August.
    5. Leelambar Singh & Subbarayan Saravanan & J. Jacinth Jennifer & D. Abijith, 2021. "Application of multi-influence factor (MIF) technique for the identification of suitable sites for urban settlement in Tiruchirappalli City, Tamil Nadu, India," Asia-Pacific Journal of Regional Science, Springer, vol. 5(3), pages 797-823, October.
    6. Xiangjin Shen & Iskander Karibzhanov & Hiroki Tsurumi & Shiliang Li, 2022. "Comparison of Bayesian and Sample Theory Parametric and Semiparametric Binary Response Models," Staff Working Papers 22-31, Bank of Canada.
    7. Cohen, Jacqueline & Garman, Samuel & Gorr, Wilpen, 2009. "Empirical calibration of time series monitoring methods using receiver operating characteristic curves," International Journal of Forecasting, Elsevier, vol. 25(3), pages 484-497, July.
    8. K. Drakopoulos & R. S. Randhawa, 2021. "Why Perfect Tests May Not Be Worth Waiting For: Information as a Commodity," Management Science, INFORMS, vol. 67(11), pages 6678-6693, November.
    9. Roy M. Poses & Randall D. Cebul & Robert M. Centor, 1988. "Eualuating Physicians' Probabilistic Judgments," Medical Decision Making, , vol. 8(4), pages 233-240, December.
    10. James A. Hanley & Colin B. Begg, 1987. "Response to ROC Steady," Medical Decision Making, , vol. 7(4), pages 244-246, December.
    11. George Laking & Joanne Lord & Alastair Fischer, 2006. "The economics of diagnosis," Health Economics, John Wiley & Sons, Ltd., vol. 15(10), pages 1109-1120, October.
    12. Rennie, Nicola & Cleophas, Catherine & Sykulski, Adam M. & Dost, Florian, 2021. "Identifying and responding to outlier demand in revenue management," European Journal of Operational Research, Elsevier, vol. 293(3), pages 1015-1030.
    13. Bing Li & Constantine Gatsonis & Issa J. Dahabreh & Jon A. Steingrimsson, 2023. "Estimating the area under the ROC curve when transporting a prediction model to a target population," Biometrics, The International Biometric Society, vol. 79(3), pages 2382-2393, September.
    14. Paola Berchialla & Silvia Snidero & Alexandru Stancu & Cecilia Scarinzi & Roberto Corradetti & Dario Gregori & the ESFBI Study Group, 2007. "Predicting Severity of Foreign Body Injuries in Children in Upper Airways: An Approach Based on Regression Trees," Risk Analysis, John Wiley & Sons, vol. 27(5), pages 1255-1263, October.
    15. Page, John H. & Rotnitzky, Andrea, 2009. "Estimation of the disease-specific diagnostic marker distribution under verification bias," Computational Statistics & Data Analysis, Elsevier, vol. 53(3), pages 707-717, January.
    16. Juana-María Vivo & Manuel Franco & Donatella Vicari, 2018. "Rethinking an ROC partial area index for evaluating the classification performance at a high specificity range," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 12(3), pages 683-704, September.
    17. J Mauricio Calvo-Calle & Iwona Strug & Maria-Dorothea Nastke & Stephen P Baker & Lawrence J Stern, 2007. "Human CD4+ T Cell Epitopes from Vaccinia Virus Induced by Vaccination or Infection," PLOS Pathogens, Public Library of Science, vol. 3(10), pages 1-19, October.
    18. Rémi Baroso & Pauline Sellier & Federica Defendi & Delphine Charignon & Arije Ghannam & Mohammed Habib & Christian Drouet & Bertrand Favier, 2016. "Kininogen Cleavage Assay: Diagnostic Assistance for Kinin-Mediated Angioedema Conditions," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-16, September.
    19. Manuel Franco & Juana-María Vivo, 2021. "Evaluating the Performances of Biomarkers over a Restricted Domain of High Sensitivity," Mathematics, MDPI, vol. 9(21), pages 1-20, November.
    20. Maria G.M. Hunink & Douglas K. Richardson & Peter M. Doubilet & Colin B. Begg, 1990. "Testing for Fetal Pulmonary Maturity," Medical Decision Making, , vol. 10(3), pages 201-211, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:7:y:1987:i:2:p:115-119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.