IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v296y2022i2p587-600.html
   My bibliography  Save this article

What causes post-decision disappointment? Estimating the contributions of systematic and selection biases

Author

Listed:
  • Vilkkumaa, Eeva
  • Liesiö, Juuso

Abstract

Many empirical studies suggest that the realized values of highest-ranked decision alternatives tend to be systematically lower than estimated, causing the decision-maker to experience post-decision disappointment. This systematic overestimation of value has been explained by a systematic bias in the alternatives’ estimated values resulting from, e.g., a behavioural disposition towards overoptimism or even strategic misrepresentation. Nevertheless, even if these estimates are unbiased, the value of the selected alternative is likely to be overestimated due to selection bias. In this paper, we build models for measuring the shares of systematic and selection biases in generating post-decision disappointment, and develop approaches for estimating these models from data which contains the estimated values of all alternatives but the realized values of selected alternatives only. Results obtained from applying these models to real data on 5610 transportation infrastructure projects suggest that out of the total cost overrun of $2.77 billion, only ca. 24% can be attributed to systematic bias.

Suggested Citation

  • Vilkkumaa, Eeva & Liesiö, Juuso, 2022. "What causes post-decision disappointment? Estimating the contributions of systematic and selection biases," European Journal of Operational Research, Elsevier, vol. 296(2), pages 587-600.
    • Handle: RePEc:eee:ejores:v:296:y:2022:i:2:p:587-600
    DOI: 10.1016/j.ejor.2021.04.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721003325
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2021.04.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    2. Ulrike Malmendier & Geoffrey Tate, 2005. "CEO Overconfidence and Corporate Investment," Journal of Finance, American Finance Association, vol. 60(6), pages 2661-2700, December.
    3. Lahtinen, Tuomas J. & Hämäläinen, Raimo P., 2016. "Path dependence and biases in the even swaps decision analysis method," European Journal of Operational Research, Elsevier, vol. 249(3), pages 890-898.
    4. James Quirk & Katsuaki Terasawa, 1986. "ple Selection and Cost Underestimation Bias in Pioneer Projects," Land Economics, University of Wisconsin Press, vol. 62(2), pages 192-200.
    5. Avanidhar Subrahmanyam, 2008. "Behavioural Finance: A Review and Synthesis," European Financial Management, European Financial Management Association, vol. 14(1), pages 12-29, January.
    6. Bent Flyvbjerg, 2009. "Survival of the unfittest: why the worst infrastructure gets built--and what we can do about it," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 25(3), pages 344-367, Autumn.
    7. Ferretti, Valentina & Geneletti, Davide, 2020. "Does the spatial representation affect criteria weights in environmental decision-making? Insights from a behavioral experiment," Land Use Policy, Elsevier, vol. 97(C).
    8. Baker, Erin & Bosetti, Valentina & Salo, Ahti, 2020. "Robust portfolio decision analysis: An application to the energy research and development portfolio problem," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1107-1120.
    9. Vilkkumaa, Eeva & Liesiö, Juuso & Salo, Ahti, 2014. "Optimal strategies for selecting project portfolios using uncertain value estimates," European Journal of Operational Research, Elsevier, vol. 233(3), pages 772-783.
    10. A Morton & B Fasolo, 2009. "Behavioural decision theory for multi-criteria decision analysis: a guided tour," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 268-275, February.
    11. De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
    12. Odeck, James, 2004. "Cost overruns in road construction--what are their sizes and determinants?," Transport Policy, Elsevier, vol. 11(1), pages 43-53, January.
    13. Shleifer, Andrei, 2000. "Inefficient Markets: An Introduction to Behavioral Finance," OUP Catalogue, Oxford University Press, number 9780198292272.
    14. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    15. Diwakar Gupta & Eli M. Snir & Yibin Chen, 2015. "Contractors’ and Agency Decisions and Policy Implications in A+B Bidding," Production and Operations Management, Production and Operations Management Society, vol. 24(1), pages 159-177, January.
    16. Lahtinen, Tuomas J. & Hämäläinen, Raimo P. & Jenytin, Cosmo, 2020. "On preference elicitation processes which mitigate the accumulation of biases in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 282(1), pages 201-210.
    17. Kellner, Florian & Lienland, Bernhard & Utz, Sebastian, 2019. "An a posteriori decision support methodology for solving the multi-criteria supplier selection problem," European Journal of Operational Research, Elsevier, vol. 272(2), pages 505-522.
    18. James E. Smith & Robert L. Winkler, 2006. "The Optimizer's Curse: Skepticism and Postdecision Surprise in Decision Analysis," Management Science, INFORMS, vol. 52(3), pages 311-322, March.
    19. Janne Kettunen & Ahti Salo, 2017. "Estimation of Downside Risks in Project Portfolio Selection," Production and Operations Management, Production and Operations Management Society, vol. 26(10), pages 1839-1853, October.
    20. Wang, Chao & Guo, Peijun, 2017. "Behavioral models for first-price sealed-bid auctions with the one-shot decision theory," European Journal of Operational Research, Elsevier, vol. 261(3), pages 994-1000.
    21. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    22. David E. Bell, 1985. "Disappointment in Decision Making Under Uncertainty," Operations Research, INFORMS, vol. 33(1), pages 1-27, February.
    23. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    24. Ian N. Durbach & Gilberto Montibeller, 2019. "Behavioural Analytics: Exploring judgments and choices in large data sets," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(2), pages 255-268, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Singh, Aaditya & Scarf, Phil & Baker, Rose, 2023. "A unified theory for bivariate scores in possessive ball-sports: The case of handball," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1099-1112.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salo, Ahti & Doumpos, Michalis & Liesiö, Juuso & Zopounidis, Constantin, 2024. "Fifty years of portfolio optimization," European Journal of Operational Research, Elsevier, vol. 318(1), pages 1-18.
    2. Siebert, Johannes Ulrich & Kunz, Reinhard E. & Rolf, Philipp, 2021. "Effects of decision training on individuals’ decision-making proactivity," European Journal of Operational Research, Elsevier, vol. 294(1), pages 264-282.
    3. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    4. David Hirshleife, 2015. "Behavioral Finance," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 133-159, December.
    5. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    6. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    7. Gary J. Summers, 2021. "Friction and Decision Rules in Portfolio Decision Analysis," Decision Analysis, INFORMS, vol. 18(2), pages 101-120, June.
    8. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    9. Liesiö, Juuso & Salo, Ahti & Keisler, Jeffrey M. & Morton, Alec, 2021. "Portfolio decision analysis: Recent developments and future prospects," European Journal of Operational Research, Elsevier, vol. 293(3), pages 811-825.
    10. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    11. Love, Peter E.D. & Ika, Lavagnon A. & Ahiaga-Dagbui, Dominic D., 2019. "On de-bunking ‘fake news’ in a post truth era: Why does the Planning Fallacy explanation for cost overruns fall short?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 397-408.
    12. Shardul Phadnis & Chris Caplice & Yossi Sheffi & Mahender Singh, 2015. "Effect of scenario planning on field experts' judgment of long-range investment decisions," Strategic Management Journal, Wiley Blackwell, vol. 36(9), pages 1401-1411, September.
    13. Jiakun Zheng, 2020. "Optimal insurance design under narrow framing," Post-Print hal-04227370, HAL.
    14. Petter Osmundsen & Kristin Helen Roll, 2016. "Rig Rates and Drilling Speed: Reinforcing Effects," CESifo Working Paper Series 5895, CESifo.
    15. Zheng, Jiakun, 2020. "Optimal insurance design under narrow framing," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 596-607.
    16. Véronique Bessière, 2007. "Excès de confiance des dirigeants et décisions financières:une synthèse," Revue Finance Contrôle Stratégie, revues.org, vol. 10(1), pages 39-66, March.
    17. Matthew Rabin & Georg Weizsacker, 2009. "Narrow Bracketing and Dominated Choices," American Economic Review, American Economic Association, vol. 99(4), pages 1508-1543, September.
    18. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).
    19. Itzhak Ben-David & John R. Graham, 2013. "Managerial Miscalibration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1547-1584.
    20. Becker, Kai Helge, 2016. "An outlook on behavioural OR – Three tasks, three pitfalls, one definition," European Journal of Operational Research, Elsevier, vol. 249(3), pages 806-815.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:296:y:2022:i:2:p:587-600. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.