IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v8y1988i4p233-240.html
   My bibliography  Save this article

Eualuating Physicians' Probabilistic Judgments

Author

Listed:
  • Roy M. Poses
  • Randall D. Cebul
  • Robert M. Centor

Abstract

Physicians increasingly are challenged to make probabilistic judgments quantitatively. Their ability to make such judgments may be directly linked to the quality of care they provide. Many methods are available to evaluate these judgments. Graphic means of assessment include the calibration curve, covariance graph, and receiver operating characteristic (ROC) curve. Statistical tools can measure the significance of departures from ideal calibration, and measure the area under ROC curve. Modeling the calibration curve using linear or logistic regression provides another method to assess probabilistic judgments, although these may be limited by failure of the data to meet the model's assumptions. Scoring rules provide indices of overall judgmental performance, although their reliability is difficult to gauge for small sample sizes. Decompositions of scoring rules separate judgmental performance into functional components. The authors provide preliminary guidelines for choosing methods for specific research in this area. Key Words: medical judgments; probabilistic judgments; ROC curves; calibration; models. (Med Decis Making 8:233-240, 1988)

Suggested Citation

  • Roy M. Poses & Randall D. Cebul & Robert M. Centor, 1988. "Eualuating Physicians' Probabilistic Judgments," Medical Decision Making, , vol. 8(4), pages 233-240, December.
    • Handle: RePEc:sae:medema:v:8:y:1988:i:4:p:233-240
    DOI: 10.1177/0272989X8800800403
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X8800800403
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X8800800403?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert M. Centor & J. Sanford Schwartz, 1985. "An Evaluation of Methods for Estimating the Area Under the Receiver Operating Characteristic (ROC) Curve," Medical Decision Making, , vol. 5(2), pages 149-156, June.
    2. Donna Katzman McClish, 1987. "Comparing the Areas under More Than Two Independent ROC Curves," Medical Decision Making, , vol. 7(3), pages 149-155, August.
    3. Budescu, David V. & Wallsten, Thomas S., 1985. "Consistency in interpretation of probabilistic phrases," Organizational Behavior and Human Decision Processes, Elsevier, vol. 36(3), pages 391-405, December.
    4. Ronis, David L. & Yates, J. Frank, 1987. "Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method," Organizational Behavior and Human Decision Processes, Elsevier, vol. 40(2), pages 193-218, October.
    5. Barbara J. McNeil & James A. Hanley, 1984. "Statistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves," Medical Decision Making, , vol. 4(2), pages 137-150, June.
    6. Robert M. Centor, 1985. "A Visicalc Program for Estimating the Area Under a Receiver Operating Characteristic (ROC) Curve," Medical Decision Making, , vol. 5(2), pages 139-148, June.
    7. Yates, J. Frank, 1988. "Analyzing the accuracy of probability judgments for multiple events: An extension of the covariance decomposition," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(3), pages 281-299, June.
    8. Keren, Gideon, 1987. "Facing uncertainty in the game of bridge: A calibration study," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(1), pages 98-114, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    2. Onkal, Dilek & Muradoglu, Gulnur, 1995. "Effects of feedback on probabilistic forecasts of stock prices," International Journal of Forecasting, Elsevier, vol. 11(2), pages 307-319, June.
    3. Onkal, Dilek & Muradoglu, Gulnur, 1996. "Effects of task format on probabilistic forecasting of stock prices," International Journal of Forecasting, Elsevier, vol. 12(1), pages 9-24, March.
    4. Wilkie-Thomson, Mary E. & Onkal-Atay, Dilek & Pollock, Andrew C., 1997. "Currency forecasting: an investigation of extrapolative judgement," International Journal of Forecasting, Elsevier, vol. 13(4), pages 509-526, December.
    5. Brenner, Lyle & Griffin, Dale & Koehler, Derek J., 2005. "Modeling patterns of probability calibration with random support theory: Diagnosing case-based judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 97(1), pages 64-81, May.
    6. McKenzie, Craig R.M. & Liersch, Michael J. & Yaniv, Ilan, 2008. "Overconfidence in interval estimates: What does expertise buy you?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 107(2), pages 179-191, November.
    7. Harvey, Nigel & Koehler, Derek J. & Ayton, Peter, 1997. "Judgments of Decision Effectiveness: Actor-Observer Differences in Overconfidence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 70(3), pages 267-282, June.
    8. Oberlechner, Thomas & Osler, Carol, 2012. "Survival of Overconfidence in Currency Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 47(1), pages 91-113, February.
    9. M Tavana & M A Sodenkamp, 2010. "A fuzzy multi-criteria decision analysis model for advanced technology assessment at Kennedy Space Center," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(10), pages 1459-1470, October.
    10. Prather-Kinsey, Jenice & Boyar, Scott & Hood, Anthony C., 2018. "Implications for IFRS principles-based and US GAAP rules-based applications: Are accountants’ decisions affected by work location and core self-evaluations?," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 32(C), pages 61-69.
    11. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    12. Maurizio Zollo, 2009. "Superstitious Learning with Rare Strategic Decisions: Theory and Evidence from Corporate Acquisitions," Organization Science, INFORMS, vol. 20(5), pages 894-908, October.
    13. Lybbert, Travis J. & Barrett, Christopher B. & McPeak, John G. & Luseno, Winnie K., 2007. "Bayesian Herders: Updating of Rainfall Beliefs in Response to External Forecasts," World Development, Elsevier, vol. 35(3), pages 480-497, March.
    14. Divesh S. Sharma & Errol R. Iselin, 2003. "The Relative Relevance of Cash Flow and Accrual Information for Solvency Assessments: A Multi‐Method Approach," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 30(7‐8), pages 1115-1140, September.
    15. repec:cup:judgdm:v:16:y:2021:i:2:p:363-393 is not listed on IDEAS
    16. Dennis Dittrich & Werner Guth & Boris Maciejovsky, 2005. "Overconfidence in investment decisions: An experimental approach," The European Journal of Finance, Taylor & Francis Journals, vol. 11(6), pages 471-491.
    17. Xiangjin Shen & Shiliang Li & Hiroki Tsurumi, 2013. "Comparison of Parametric and Semi-Parametric Binary Response Models," Departmental Working Papers 201308, Rutgers University, Department of Economics.
    18. Zaleskiewicz, Tomasz, 2011. "Financial forecasts during the crisis: Were experts more accurate than laypeople?," Journal of Economic Psychology, Elsevier, vol. 32(3), pages 384-390, June.
    19. Bolger, Fergus & Wright, George, 2017. "Use of expert knowledge to anticipate the future: Issues, analysis and directions," International Journal of Forecasting, Elsevier, vol. 33(1), pages 230-243.
    20. Srilata A. Zaheer, "undated". "Acceptable Risk: A Study of Global Currency Trading Rooms in the US and Japan," Center for Financial Institutions Working Papers 97-22, Wharton School Center for Financial Institutions, University of Pennsylvania.
    21. Michał Krawczyk & Maciej Wilamowski, 2022. "Calibration and incentives: evidence from contract bridge," Working Papers 2022-06, Faculty of Economic Sciences, University of Warsaw.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:8:y:1988:i:4:p:233-240. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.