An experimental study of the effect of uncertainty representation on decision making

This paper presents the results of an experiment investigating the effects of using different formats for representing uncertain attribute evaluations on decision making. Study participants make a series of hypothetical choices using six uncertainty formats - probability distributions, expected values, standard deviations, three-point (minimum-median-maximum) approximations, quantiles, and scenarios - and effects on decision making are tracked in terms of the quality of the final choice, the specific characteristics of the selected alternatives, and the difficulty experienced in making a decision. The results provide insights into how subjects make single- and multi-criteria choices in the presence of uncertainty (and some format for representing uncertainty) but in the absence of any real facilitation. The use of probability distributions appeared to overload subjects with information, leading to poorer and more difficult choices than if some intermediate level of summary was used - in particular three-point approximations or quantiles.