Training to Improve Calibration and Discrimination: The Effects of Performance and Environmental Feedback
Author
Abstract
Suggested Citation
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Balzer, William K. & Hammer, Leslie B. & Sumner, Kenneth E. & Birchenough, Todd R. & Martens, Sandra Parham & Raymark, Patrick H., 1994. "Effects of Cognitive Feedback Components, Display Format, and Elaboration on Performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 58(3), pages 369-385, June.
- Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
- Benson, P. George & Onkal, Dilek, 1992. "The effects of feedback and training on the performance of probability forecasters," International Journal of Forecasting, Elsevier, vol. 8(4), pages 559-573, December.
- Schneider, Sandra L., 1995. "Item Difficulty, Discrimination, and the Confidence-Frequency Effect in a Categorical Judgment Task," Organizational Behavior and Human Decision Processes, Elsevier, vol. 61(2), pages 148-167, February.
- Balzer, William K. & Sulsky, Lorne M. & Hammer, Leslie B. & Sumner, Kenneth E., 1992. "Task information, cognitive information, or functional validity information: Which components of cognitive feedback affect performance?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 53(1), pages 35-54, October.
- Remus, William & O'Conner, Marcus & Griggs, Kenneth, 1996. "Does Feedback Improve the Accuracy of Recurrent Judgmental Forecasts?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 66(1), pages 22-30, April.
- Yates, J. Frank & Lee, Ju-Whei & Shinotsuka, Hiromi & Patalano, Andrea L. & Sieck, Winston R., 1998. "Cross-Cultural Variations in Probability Judgment Accuracy: Beyond General Knowledge Overconfidence?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 74(2), pages 89-117, May.
- Suantak, Liana & Bolger, Fergus & Ferrell, William R., 1996. "The Hard-Easy Effect in Subjective Probability Calibration," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(2), pages 201-221, August.
- Keren, Gideon, 1987. "Facing uncertainty in the game of bridge: A calibration study," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(1), pages 98-114, February.
- Subbotin, Vadim, 1996. "Outcome Feedback Effects on Under- and Overconfident Judgments (General Knowledge Tasks)," Organizational Behavior and Human Decision Processes, Elsevier, vol. 66(3), pages 268-276, June.
- Thomas S. Wallsten & David V. Budescu, 1983. "State of the Art---Encoding Subjective Probabilities: A Psychological and Psychometric Review," Management Science, INFORMS, vol. 29(2), pages 151-173, February.
- Roth, Philip L., 1993. "Research Trends in Judgment and Their Implications for the Schmidt-Hunter Global Estimation Procedure," Organizational Behavior and Human Decision Processes, Elsevier, vol. 54(2), pages 299-319, March.
- Sharp, Glen L. & Cutler, Brian L. & Penrod, Steven D., 1988. "Performance feedback improves the resolution of confidence judgments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 42(3), pages 271-283, December.
- P. George Benson & Shawn P. Curley & Gerald F. Smith, 1995. "Belief Assessment: An Underdeveloped Phase of Probability Elicitation," Management Science, INFORMS, vol. 41(10), pages 1639-1653, October.
- Dawes, Robyn M. & Mulford, Matthew, 1996. "The False Consensus Effect and Overconfidence: Flaws in Judgment or Flaws in How We Study Judgment?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 201-211, March.
- Yates, J. Frank & Zhu, Ying & Ronis, David L. & Wang, Deng-Feng & Shinotsuka, Hiromi & Toda, Masanao, 1989. "Probability judgment accuracy: China, Japan, and the United States," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(2), pages 145-171, April.
- Arkes, Hal R. & Christensen, Caryn & Lai, Cheryl & Blumer, Catherine, 1987. "Two methods of reducing overconfidence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(1), pages 133-144, February.
- Brenner, Lyle A. & Koehler, Derek J. & Liberman, Varda & Tversky, Amos, 1996. "Overconfidence in Probability and Frequency Judgments: A Critical Examination," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 212-219, March.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Don A. Moore & Samuel A. Swift & Angela Minster & Barbara Mellers & Lyle Ungar & Philip Tetlock & Heather H. J. Yang & Elizabeth R. Tenney, 2017. "Confidence Calibration in a Multiyear Geopolitical Forecasting Competition," Management Science, INFORMS, vol. 63(11), pages 3552-3565, November.
- Fellner-Röhling, Gerlinde & Hromek, Kristijan & Kleinknecht, Janina & Ludwig, Sandra, 2023. "How to counteract biased self-assessments? An experimental investigation of reactions to social information," Journal of Economic Behavior & Organization, Elsevier, vol. 206(C), pages 1-25.
- Ryvkin, Dmitry & Krajč, Marian & Ortmann, Andreas, 2012. "Are the unskilled doomed to remain unaware?," Journal of Economic Psychology, Elsevier, vol. 33(5), pages 1012-1031.
- Ning Du & Sandra Shelton & Ray Whittington, 2012. "Does Supplementing Outcome Feedback with Performance Feedback Improve Probability Judgments?," International Journal of Financial Research, International Journal of Financial Research, Sciedu Press, vol. 3(4), pages 19-32, October.
- Rianne Legerstee & Philip Hans Franses, 2014.
"Do Experts’ SKU Forecasts Improve after Feedback?,"
Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
- Legerstee, R. & Franses, Ph.H.B.F., 2011. "Do experts' SKU forecasts improve after feedback?," Econometric Institute Research Papers EI2011-31, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Rianne Legerstee & Philip Hans Franses, 2011. "Do Experts' SKU Forecasts improve after Feedback?," Tinbergen Institute Discussion Papers 11-135/4, Tinbergen Institute.
- Bolger, Fergus & Onkal-Atay, Dilek, 2004. "The effects of feedback on judgmental interval predictions," International Journal of Forecasting, Elsevier, vol. 20(1), pages 29-39.
- Dmytro Babik & Rahul Singh & Xia Zhao & Eric W. Ford, 2017. "What you think and what I think: Studying intersubjectivity in knowledge artifacts evaluation," Information Systems Frontiers, Springer, vol. 19(1), pages 31-56, February.
- Camilleri, Adrian R. & Newell, Ben R., 2019. "Better calibration when predicting from experience (rather than description)," Organizational Behavior and Human Decision Processes, Elsevier, vol. 150(C), pages 62-82.
- Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
- Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Bolger, Fergus & Onkal-Atay, Dilek, 2004. "The effects of feedback on judgmental interval predictions," International Journal of Forecasting, Elsevier, vol. 20(1), pages 29-39.
- Don A. Moore & Samuel A. Swift & Angela Minster & Barbara Mellers & Lyle Ungar & Philip Tetlock & Heather H. J. Yang & Elizabeth R. Tenney, 2017. "Confidence Calibration in a Multiyear Geopolitical Forecasting Competition," Management Science, INFORMS, vol. 63(11), pages 3552-3565, November.
- Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
- Erik Angner, 2006. "Economists as experts: Overconfidence in theory and practice," Journal of Economic Methodology, Taylor & Francis Journals, vol. 13(1), pages 1-24.
- Browne, Glenn J. & Curley, Shawn P. & Benson, P. George, 1999. "The Effects of Subject-Defined Categories on Judgmental Accuracy in Confidence Assessment Tasks, , , , , , , , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 80(2), pages 134-154, November.
- Dorota Skała, 2008.
"Overconfidence in Psychology and Finance – an Interdisciplinary Literature Review,"
Bank i Kredyt, Narodowy Bank Polski, vol. 39(4), pages 33-50.
- Skala, Dorota, 2008. "Overconfidence in Psychology and Finance – an Interdisciplinary Literature Review," MPRA Paper 26386, University Library of Munich, Germany.
- Wallsten, Thomas S. & Gu, Hongbin, 2003. "Distinguishing choice and subjective probability estimation processes: Implications for theories of judgment and for cross-cultural comparisons," Organizational Behavior and Human Decision Processes, Elsevier, vol. 90(1), pages 111-123, January.
- Leung, Patrick W. & Trotman, Ken T., 2005. "The effects of feedback type on auditor judgment performance for configural and non-configural tasks," Accounting, Organizations and Society, Elsevier, vol. 30(6), pages 537-553, August.
- Onkal, Dilek & Muradoglu, Gulnur, 1996. "Effects of task format on probabilistic forecasting of stock prices," International Journal of Forecasting, Elsevier, vol. 12(1), pages 9-24, March.
- Mathew L. A. Hayward & Dean A. Shepherd & Dale Griffin, 2006. "A Hubris Theory of Entrepreneurship," Management Science, INFORMS, vol. 52(2), pages 160-172, February.
- Brenner, Lyle A., 2003. "A random support model of the calibration of subjective probabilities," Organizational Behavior and Human Decision Processes, Elsevier, vol. 90(1), pages 87-110, January.
- Patrick W. Leung & Ken T. Trotman, 2008. "Effect of different types of feedback on the level of auditors’ configural information processing," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 48(2), pages 301-318, June.
- Mary Kynn, 2008. "The ‘heuristics and biases’ bias in expert elicitation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(1), pages 239-264, January.
- Fischer, Ilan & Budescu, David V., 2005. "When do those who know more also know more about how much they know? The development of confidence and performance in categorical decision tasks," Organizational Behavior and Human Decision Processes, Elsevier, vol. 98(1), pages 39-53, September.
- Forbes, Daniel P., 2005. "Are some entrepreneurs more overconfident than others?," Journal of Business Venturing, Elsevier, vol. 20(5), pages 623-640, September.
- Brenner, Lyle & Griffin, Dale & Koehler, Derek J., 2005. "Modeling patterns of probability calibration with random support theory: Diagnosing case-based judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 97(1), pages 64-81, May.
- Ryvkin, Dmitry & Krajč, Marian & Ortmann, Andreas, 2012. "Are the unskilled doomed to remain unaware?," Journal of Economic Psychology, Elsevier, vol. 33(5), pages 1012-1031.
- Mel W Khaw & Luminita Stevens & Michael Woodford, 2021. "Individual differences in the perception of probability," PLOS Computational Biology, Public Library of Science, vol. 17(4), pages 1-25, April.
- Michael Muthukrishna & Joseph Henrich & Wataru Toyokawa & Takeshi Hamamura & Tatsuya Kameda & Steven J Heine, 2018. "Overconfidence is universal? Elicitation of Genuine Overconfidence (EGO) procedure reveals systematic differences across domain, task knowledge, and incentives in four populations," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-30, August.
- Thomson, Mary E. & Onkal-Atay, Dilek & Pollock, Andrew C. & Macaulay, Alex, 2003. "The influence of trend strength on directional probabilistic currency predictions," International Journal of Forecasting, Elsevier, vol. 19(2), pages 241-256.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jobhdp:v:83:y:2000:i:2:p:282-309. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/obhdp .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.