IDEAS home Printed from https://ideas.repec.org/h/spr/isochp/978-3-031-44424-1_5.html
   My bibliography  Save this book chapter

Should an Analyst Share Calibration Information with Experts?

In: Behavioral Decision Analysis

Author

Listed:
  • Saurabh Bansal

    (The Pennsylvania State University)

  • Mostafa Sabbaghi

    (The Pennsylvania State University
    California State University)

  • Rashmi Sharma

    (The Pennsylvania State University)

Abstract

Many times, expert judgment is used in a two-step procedure: (i) obtain judgments for calibration quantities for which true/empirical values are available to calibrate the expert’s judgmental errors, and then (ii) obtain judgments for focal quantities (quantities of interest but without historical data), adjust them using the calibration information, and then use the adjusted judgments to assist decision making. In such situations, should a decision analyst share the calibration information with the expert before the expert provides judgments for focal quantities? We answer this question using laboratory experiments. We specifically investigate the role of task complexity, numeracy, and self-awareness on the use of calibration information by the expert. We find that: (a) Expert judgment tends to be of a worse quality as task complexity increases, (b) Calibration feedback does not improve managerial judgments in a less complex task, but it does reduce the bias and (especially) noise in a more complex task, (c) Numeracy does not impact the use of calibration information by experts regardless of task complexity, and (d) Individuals are able to directionally discern whether they are doing well in less complex tasks, but not in more complex tasks. As such these results suggest that when faced with complex tasks experts do benefit from receiving calibration information. However, this benefit comes at the expense of rendering this information inapplicable for the decision analyst to adjust the focal judgments provided by an expert. In contrast, experts do not benefit from receiving calibration information for simple tasks, allowing decision analysts to continue to use the calibration information to adjust managerial judgments.

Suggested Citation

  • Saurabh Bansal & Mostafa Sabbaghi & Rashmi Sharma, 2024. "Should an Analyst Share Calibration Information with Experts?," International Series in Operations Research & Management Science, in: Florian M. Federspiel & Gilberto Montibeller & Matthias Seifert (ed.), Behavioral Decision Analysis, pages 81-103, Springer.
  • Handle: RePEc:spr:isochp:978-3-031-44424-1_5
    DOI: 10.1007/978-3-031-44424-1_5
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:isochp:978-3-031-44424-1_5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.