IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v61y2015i5p1121-1136.html
   My bibliography  Save this article

Sticking with What (Barely) Worked: A Test of Outcome Bias

Author

Listed:
  • Lars Lefgren

    (Department of Economics, Brigham Young University, Provo, Utah 84602)

  • Brennan Platt

    (Department of Economics, Brigham Young University, Provo, Utah 84602)

  • Joseph Price

    (Department of Economics, Brigham Young University, Provo, Utah 84602)

Abstract

Outcome bias occurs when an evaluator considers ex post outcomes when judging whether a choice was correct ex ante. We formalize this cognitive bias in a simple model of distorted Bayesian updating. We then examine strategy changes made by professional basketball coaches. We find that they are more likely to revise their strategy after a loss than a win---even for narrow losses, which are uninformative about team effectiveness. This increased strategy revision following a loss occurs even when a loss was expected and even when failure is due to factors beyond the team's control. These results are consistent with our model's predictions.Data, as supplemental material, are available at http://dx.doi.org/10.1287/mnsc.2014.1966 . This paper was accepted by Yuval Rottenstreich, judgment and decision making.

Suggested Citation

  • Lars Lefgren & Brennan Platt & Joseph Price, 2015. "Sticking with What (Barely) Worked: A Test of Outcome Bias," Management Science, INFORMS, vol. 61(5), pages 1121-1136, May.
    • Handle: RePEc:inm:ormnsc:v:61:y:2015:i:5:p:1121-1136
    DOI: 10.1287/mnsc.2014.1966
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2014.1966
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2014.1966?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Theo Offerman & Joep Sonnemans, 2004. "What’s Causing Overreaction? An Experimental Investigation of Recency and the Hot‐hand Effect," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(3), pages 533-554, October.
    2. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    3. Wolfers, Justin, 2002. "Are Voters Rational? Evidence from Gubernatorial Elections," Research Papers 1730, Stanford University, Graduate School of Business.
    4. David Card & Gordon B. Dahl, 2011. "Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 103-143.
    5. Ratner, Rebecca K. & Herbst, Kenneth C., 2005. "When good decisions have bad outcomes: The impact of affect on switching behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 96(1), pages 23-37, January.
    6. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    7. P.-A. Chiappori, 2002. "Testing Mixed-Strategy Equilibria When Players Are Heterogeneous: The Case of Penalty Kicks in Soccer," American Economic Review, American Economic Association, vol. 92(4), pages 1138-1151, September.
    8. Earl, Peter E, 1990. "Economics and Psychology: A Survey," Economic Journal, Royal Economic Society, vol. 100(402), pages 718-755, September.
    9. Lipshitz, Raanan, 1989. ""Either a medal or a corporal": The effects of success and failure on the evaluation of decision making and decision makers," Organizational Behavior and Human Decision Processes, Elsevier, vol. 44(3), pages 380-395, December.
    10. Gray, Philip K & Gray, Stephen F, 1997. "Testing Market Efficiency: Evidence from the NFL Sports Betting Market," Journal of Finance, American Finance Association, vol. 52(4), pages 1725-1737, September.
    11. repec:bla:econom:v:58:y:1991:i:232:p:417-40 is not listed on IDEAS
    12. Jones, Steven K. & Yurak, Tricia J. & Frisch, Deborah, 1997. "The Effect of Outcome Information on the Evaluation and Recall of Individuals' Own Decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 71(1), pages 95-120, July.
    13. Marianne Bertrand & Sendhil Mullainathan, 2001. "Are CEOs Rewarded for Luck? The Ones Without Principals Are," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 901-932.
    14. Catherine H. Tinsley & Robin L. Dillon & Matthew A. Cronin, 2012. "How Near-Miss Events Amplify or Attenuate Risky Decision Making," Management Science, INFORMS, vol. 58(9), pages 1596-1613, September.
    15. Devin G. Pope & Maurice E. Schweitzer, 2011. "Is Tiger Woods Loss Averse? Persistent Bias in the Face of Experience, Competition, and High Stakes," American Economic Review, American Economic Association, vol. 101(1), pages 129-157, February.
    16. Camerer, Colin & Loewenstein, George & Weber, Martin, 1989. "The Curse of Knowledge in Economic Settings: An Experimental Analysis," Journal of Political Economy, University of Chicago Press, vol. 97(5), pages 1232-1254, October.
    17. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    18. Jonah Berger & Devin Pope, 2011. "Can Losing Lead to Winning?," Management Science, INFORMS, vol. 57(5), pages 817-827, May.
    19. David Romer, 2006. "Do Firms Maximize? Evidence from Professional Football," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 340-365, April.
    20. Gino, Francesca & Shu, Lisa L. & Bazerman, Max H., 2010. "Nameless + harmless = blameless: When seemingly irrelevant factors influence judgment of (un)ethical behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 111(2), pages 93-101, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Raphael Flepp & Oliver Merz & Egon Franck, 2024. "When the league table lies: Does outcome bias lead to informationally inefficient markets?," Economic Inquiry, Western Economic Association International, vol. 62(1), pages 414-429, January.
    2. Oliver Merz & Raphael Flepp & Egon Franck, 2021. "Underestimating randomness: Outcome bias in betting exchange markets," Working Papers 390, University of Zurich, Department of Business Administration (IBW).
    3. Kausel, Edgar E. & Ventura, Santiago & Rodríguez, Arturo, 2019. "Outcome bias in subjective ratings of performance: Evidence from the (football) field," Journal of Economic Psychology, Elsevier, vol. 75(PB).
    4. Sandro Casal & Matteo Ploner & Alec N. Sproten, 2019. "Fostering The Best Execution Regime: An Experiment About Pecuniary Sanctions And Accountability In Fiduciary Money Management," Economic Inquiry, Western Economic Association International, vol. 57(1), pages 600-616, January.
    5. Ricardo Manuel Santos, 2024. "Modelling Strategies in Sports," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 52(2), pages 57-66, September.
    6. Raphael Flepp & Egon Franck, 2021. "The Performance Effects Of Wise And Unwise Managerial Dismissals," Economic Inquiry, Western Economic Association International, vol. 59(1), pages 186-198, January.
    7. Enzo Brox & Michael Lechner, 2024. "Teamwork and Spillover Effects in Performance Evaluations," Papers 2403.15200, arXiv.org.
    8. Pascal Flurin Meier & Raphael Flepp & Egon Franck, 2022. "Are Expectations Misled by Chance? Quasi-Experimental Evidence from Financial Analysts," Working Papers 396, University of Zurich, Department of Business Administration (IBW).
    9. Raphael Flepp & Egon Franck, 2019. "The role of boards' misperceptions in the relation between managerial turnover and performance: Evidence from European football," Working Papers 380, University of Zurich, Department of Business Administration (IBW).
    10. Christian König-Kersting & Monique Pollmann & Jan Potters & Stefan T. Trautmann, 2021. "Good decision vs. good results: Outcome bias in the evaluation of financial agents," Theory and Decision, Springer, vol. 90(1), pages 31-61, February.
    11. Anil Özdemir & Helmut Dietl & Giambattista Rossi & Robert Simmons, 2020. "Are Workers Rewarded for Inconsistent Performance?," Working Papers 386, University of Zurich, Department of Business Administration (IBW).
    12. Marc Brechot & Raphael Flepp, 2020. "Dealing With Randomness in Match Outcomes: How to Rethink Performance Evaluation in European Club Football Using Expected Goals," Journal of Sports Economics, , vol. 21(4), pages 335-362, May.
    13. Meier, Pascal Flurin & Flepp, Raphael & Franck, Egon, 2023. "Replication: Do coaches stick with what barely worked? Evidence of outcome bias in sports," Journal of Economic Psychology, Elsevier, vol. 99(C).
    14. Raphael Flepp & Pascal Flurin Meier, 2024. "Struck by Luck: Noisy Capability Cues and CEO Dismissal," Working Papers 389, University of Zurich, Department of Business Administration (IBW).
    15. Meier, Pascal Flurin & Flepp, Raphael & Meier, Philippe & Franck, Egon, 2022. "Outcome bias in self-evaluations: Quasi-experimental field evidence from Swiss driving license exams," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 292-309.
    16. Lefgren, Lars J. & Platt, Brennan & Price, Joseph & Higbee, Samuel, 2019. "Outcome based accountability: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 160(C), pages 121-137.
    17. Kaori Narita & Benjamin Holmes & Ian McHale, 2022. "Managerial Contribution to Firm Success: Evidence from Professional Football Leagues," Working Papers 202224, University of Liverpool, Department of Economics.
    18. Pascal Flurin Meier & Raphael Flepp & Philippe Meier & Egon Franck, 2022. "Outcome Bias in Self-evaluations: Quasi-experimental Field Evidence of Swiss Driving License Exams," Working Papers 392, University of Zurich, Department of Business Administration (IBW).
    19. Eric J. Allen & Patricia M. Dechow & Devin G. Pope & George Wu, 2017. "Reference-Dependent Preferences: Evidence from Marathon Runners," Management Science, INFORMS, vol. 63(6), pages 1657-1672, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lars Lefgren & Brennan Platt & Joseph Price, 2011. "Sticking with What (Barely) Worked," NBER Working Papers 17477, National Bureau of Economic Research, Inc.
    2. Lefgren, Lars J. & Platt, Brennan & Price, Joseph & Higbee, Samuel, 2019. "Outcome based accountability: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 160(C), pages 121-137.
    3. Meier, Pascal Flurin & Flepp, Raphael & Meier, Philippe & Franck, Egon, 2022. "Outcome bias in self-evaluations: Quasi-experimental field evidence from Swiss driving license exams," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 292-309.
    4. Björn Bartling & Leif Brandes & Daniel Schunk, 2012. "Expectations as reference points: field evidence from experienced subjects in a competitive, high-stakes environment," ECON - Working Papers 073, Department of Economics - University of Zurich.
    5. González-Díaz, Julio & Palacios-Huerta, Ignacio, 2016. "Cognitive performance in competitive environments: Evidence from a natural experiment," Journal of Public Economics, Elsevier, vol. 139(C), pages 40-52.
    6. Sebastian Bervoets & Bruno Decreuse & Mathieu Faure, 2014. "A Renewed Analysis of Cheating in Contests: Theory and Evidence from Recovery Doping," AMSE Working Papers 1441, Aix-Marseille School of Economics, France, revised Jun 2015.
    7. Brandes, Leif & Brechot, Marc & Franck, Egon, 2015. "Managers’ external social ties at work: Blessing or curse for the firm?," Journal of Economic Behavior & Organization, Elsevier, vol. 109(C), pages 203-216.
    8. Oliver Merz & Raphael Flepp & Egon Franck, 2021. "Underestimating randomness: Outcome bias in betting exchange markets," Working Papers 390, University of Zurich, Department of Business Administration (IBW).
    9. Romain Gauriot & Lionel Page, 2019. "Does Success Breed Success? a Quasi-Experiment on Strategic Momentum in Dynamic Contests," The Economic Journal, Royal Economic Society, vol. 129(624), pages 3107-3136.
    10. Raphael Flepp & Oliver Merz & Egon Franck, 2024. "When the league table lies: Does outcome bias lead to informationally inefficient markets?," Economic Inquiry, Western Economic Association International, vol. 62(1), pages 414-429, January.
    11. Bar-Eli, Michael & Krumer, Alex & Morgulev, Elia, 2020. "Ask not what economics can do for sports - Ask what sports can do for economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    12. Gabriel Natividad, 2013. "Financial Slack, Strategy, and Competition in Movie Distribution," Organization Science, INFORMS, vol. 24(3), pages 846-864, June.
    13. Gregory Besharov, 2004. "Second‐Best Considerations in Correcting Cognitive Biases," Southern Economic Journal, John Wiley & Sons, vol. 71(1), pages 12-20, July.
    14. Paserman, M. Daniele, 2023. "Gender Differences in Performance in Competitive Environments? Evidence from Professional Tennis Players," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 590-609.
    15. Reio Tanji, 2021. "Reference Dependence and Monetary Incentives: Evidence from Major League Baseball," Discussion Papers in Economics and Business 20-23, Osaka University, Graduate School of Economics.
    16. Björn Bartling & Leif Brandes & Daniel Schunk, 2015. "Expectations as Reference Points: Field Evidence from Professional Soccer," Management Science, INFORMS, vol. 61(11), pages 2646-2661, November.
    17. David C. Phillips, 2017. "Stopping on Nine: Evidence of Heuristic Managerial Decision‐Making in Major League Baseball Pitcher Substitutions," Southern Economic Journal, John Wiley & Sons, vol. 84(2), pages 577-599, October.
    18. Leif Brandes & Marc Brechot & Egon Franck, 2011. "The Temptation of Social Ties: When Interpersonal Network Transactions Hurt Firm Performance," Working Papers 00159, University of Zurich, Institute for Strategy and Business Economics (ISU), revised 2012.
    19. Michael William Gmeiner, 2019. "History-Dependent Mixed Strategies: Evidence From Major League Baseball," Journal of Sports Economics, , vol. 20(3), pages 371-398, April.
    20. Klaassen, Franc J.G.M. & Magnus, Jan R., 2009. "The efficiency of top agents: An analysis through service strategy in tennis," Journal of Econometrics, Elsevier, vol. 148(1), pages 72-85, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:61:y:2015:i:5:p:1121-1136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.