IDEAS home Printed from https://ideas.repec.org/a/jfr/ijfr11/v3y2012i4p19-32.html
   My bibliography  Save this article

Does Supplementing Outcome Feedback with Performance Feedback Improve Probability Judgments?

Author

Listed:
  • Ning Du
  • Sandra Shelton
  • Ray Whittington

Abstract

This study examines the effect of feedback on calibration of auditors¡¯ probability judgment. Results from our experiment indicate that auditors¡¯ probability judgments are indeed poorly calibrated and auditors are in general overconfident. In addition, we investigate whether we can use feedback as a means to improve judgment quality. Our evidence indicates that outcome feedback, in spite of its simplicity, is effective in reducing overconfidence. Moreover, we find supplementing outcome feedback with performance feedback does not have any added benefits. Sometimes, it actually decreases judgment performance.

Suggested Citation

  • Ning Du & Sandra Shelton & Ray Whittington, 2012. "Does Supplementing Outcome Feedback with Performance Feedback Improve Probability Judgments?," International Journal of Financial Research, International Journal of Financial Research, Sciedu Press, vol. 3(4), pages 19-32, October.
    • Handle: RePEc:jfr:ijfr11:v:3:y:2012:i:4:p:19-32
    as

    Download full text from publisher

    File URL: http://www.sciedu.ca/journal/index.php/ijfr/article/view/1849/928
    Download Restriction: no
    File URL: http://www.sciedu.ca/journal/index.php/ijfr/article/view/1849
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bolger, Fergus & Onkal-Atay, Dilek, 2004. "The effects of feedback on judgmental interval predictions," International Journal of Forecasting, Elsevier, vol. 20(1), pages 29-39.
    2. Benson, P. George & Onkal, Dilek, 1992. "The effects of feedback and training on the performance of probability forecasters," International Journal of Forecasting, Elsevier, vol. 8(4), pages 559-573, December.
    3. Kennedy, J & Peecher, ME, 1997. "Judging auditors' technical knowledge," Journal of Accounting Research, Wiley Blackwell, vol. 35(2), pages 279-293.
    4. Stone, Eric R. & Opel, Ryan B., 2000. "Training to Improve Calibration and Discrimination: The Effects of Performance and Environmental Feedback," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(2), pages 282-309, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Parkhurst, Gregory M. & Nowell, Clifford, 2014. "The Role of Confidence in Truthful Revelation of Private Values," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 43(2), pages 1-16, August.
    2. Vivek Choudhary & Masha Shunko & Serguei Netessine & Seongjoon Koo, 2022. "Nudging Drivers to Safety: Evidence from a Field Experiment," Management Science, INFORMS, vol. 68(6), pages 4196-4214, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    2. Ross Gruetzemacher & Kang Bok Lee & David Paradice, 2024. "Calibration training for improving probabilistic judgments using an interactive app," Futures & Foresight Science, John Wiley & Sons, vol. 6(2), June.
    3. Bolger, Fergus & Onkal-Atay, Dilek, 2004. "The effects of feedback on judgmental interval predictions," International Journal of Forecasting, Elsevier, vol. 20(1), pages 29-39.
    4. Rianne Legerstee & Philip Hans Franses, 2014. "Do Experts’ SKU Forecasts Improve after Feedback?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
    5. Don A. Moore & Samuel A. Swift & Angela Minster & Barbara Mellers & Lyle Ungar & Philip Tetlock & Heather H. J. Yang & Elizabeth R. Tenney, 2017. "Confidence Calibration in a Multiyear Geopolitical Forecasting Competition," Management Science, INFORMS, vol. 63(11), pages 3552-3565, November.
    6. Dan Zhu & Qingwei Wang & John Goddard, 2022. "A new hedging hypothesis regarding prediction interval formation in stock price forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(4), pages 697-717, July.
    7. Patrick Krieger & Carsten Lausberg, 2021. "Entscheidungen, Entscheidungsfindung und Entscheidungsunterstützung in der Immobilienwirtschaft: Eine systematische Literaturübersicht [Decisions, decision-making and decisions support systems in r," Zeitschrift für Immobilienökonomie (German Journal of Real Estate Research), Springer;Gesellschaft für Immobilienwirtschaftliche Forschung e. V., vol. 7(1), pages 1-33, April.
    8. Ryvkin, Dmitry & Krajč, Marian & Ortmann, Andreas, 2012. "Are the unskilled doomed to remain unaware?," Journal of Economic Psychology, Elsevier, vol. 33(5), pages 1012-1031.
    9. Dmytro Babik & Rahul Singh & Xia Zhao & Eric W. Ford, 2017. "What you think and what I think: Studying intersubjectivity in knowledge artifacts evaluation," Information Systems Frontiers, Springer, vol. 19(1), pages 31-56, February.
    10. Owhoso, Vincent & Weickgenannt, Andrea, 2009. "Auditors’ self-perceived abilities in conducting domain audits," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 20(1), pages 3-21.
    11. Jeremy Rohmer & Eric Chojnacki, 2021. "Forecast of environment systems using expert judgements: performance comparison between the possibilistic and the classical model," Environment Systems and Decisions, Springer, vol. 41(1), pages 131-146, March.
    12. Onkal, Dilek & Muradoglu, Gulnur, 1995. "Effects of feedback on probabilistic forecasts of stock prices," International Journal of Forecasting, Elsevier, vol. 11(2), pages 307-319, June.
    13. Onkal, Dilek & Muradoglu, Gulnur, 1996. "Effects of task format on probabilistic forecasting of stock prices," International Journal of Forecasting, Elsevier, vol. 12(1), pages 9-24, March.
    14. Thomson, Mary E. & Onkal-Atay, Dilek & Pollock, Andrew C. & Macaulay, Alex, 2003. "The influence of trend strength on directional probabilistic currency predictions," International Journal of Forecasting, Elsevier, vol. 19(2), pages 241-256.
    15. Peecher, Mark E. & Solomon, Ira & Trotman, Ken T., 2013. "An accountability framework for financial statement auditors and related research questions," Accounting, Organizations and Society, Elsevier, vol. 38(8), pages 596-620.
    16. Andiola, Lindsay M., 2014. "Performance feedback in the audit environment: A review and synthesis of research on the behavioral effects," Journal of Accounting Literature, Elsevier, vol. 33(1), pages 1-36.
    17. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    18. Pollock, Andrew C. & Macaulay, Alex & Thomson, Mary E. & Onkal, Dilek, 2005. "Performance evaluation of judgemental directional exchange rate predictions," International Journal of Forecasting, Elsevier, vol. 21(3), pages 473-489.
    19. Pollock, Andrew C. & Macaulay, Alex & Onkal-Atay, Dilek & Wilkie-Thomson, Mary E., 1999. "Evaluating predictive performance of judgemental extrapolations from simulated currency series," European Journal of Operational Research, Elsevier, vol. 114(2), pages 281-293, April.
    20. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jfr:ijfr11:v:3:y:2012:i:4:p:19-32. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gina Perry (email available below). General contact details of provider: http://ijfr.sciedupress.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.