IDEAS home Printed from https://ideas.repec.org/p/rdg/emxxdp/em-dp2019-05.html
   My bibliography  Save this paper

Going with your gut: the (in)accuracy of forecast revisions in a football score prediction game

Author

Listed:
  • Carl Singleton

    (Department of Economics, University of Reading)

  • J. James Reade

    (Department of Economics, University of Reading)

  • Alasdair Brown

    (School of Economics, University of East Anglia)

Abstract

This paper studies 150 individuals who each chose to forecast the outcome of 380 fixed events, namely all football matches during the 2017/18 season of the English Premier League. The focus is on whether revisions to these forecasts before the matches began improved the likelihood of predicting correct scorelines and results. Against what theory might expect, we show how these revisions tended towards significantly worse forecasting performance, suggesting that individuals should have stuck with their initial judgements, or their `gut instincts'. This result is robust to both differences in the average forecasting ability of individuals and the predictability of matches. We find evidence this is because revisions to the forecast number of goals scored in football matches are generally excessive, especially when these forecasts were increased rather than decreased.

Suggested Citation

  • Carl Singleton & J. James Reade & Alasdair Brown, 2019. "Going with your gut: the (in)accuracy of forecast revisions in a football score prediction game," Economics Discussion Papers em-dp2019-05, Department of Economics, University of Reading, revised 01 Nov 2019.
    • Handle: RePEc:rdg:emxxdp:em-dp2019-05
    as

    Download full text from publisher

    File URL: http://www.reading.ac.uk/web/FILES/economics/emdp201905.pdf
    File Function: Revised version, 2019
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clements, Michael P., 1996. "Evaluating the rationality of fixed-event forecasts," Economic Research Papers 268705, University of Warwick - Department of Economics.
    2. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    3. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    4. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    5. De Bondt, Werner F M & Thaler, Richard H, 1990. "Do Security Analysts Overreact?," American Economic Review, American Economic Association, vol. 80(2), pages 52-57, May.
    6. Karen Croxson & J. James Reade, 2014. "Information and Efficiency: Goal Arrival in Soccer Betting," Economic Journal, Royal Economic Society, vol. 124(575), pages 62-91, March.
    7. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    8. Alasdair Brown & Dooruj Rambaccussing & J. James Reade & Giambattista Rossi, 2018. "Forecasting With Social Media: Evidence From Tweets On Soccer Matches," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1748-1763, July.
    9. Christian Deutscher & Bernd Frick & Marius Ötting, 2018. "Betting market inefficiencies are short-lived in German professional football," Applied Economics, Taylor & Francis Journals, vol. 50(30), pages 3240-3246, June.
    10. Boshnakov, Georgi & Kharrat, Tarak & McHale, Ian G., 2017. "A bivariate Weibull count model for forecasting association football scores," International Journal of Forecasting, Elsevier, vol. 33(2), pages 458-466.
    11. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    12. Michael Cain & David Law & David Peel, 2000. "The Favourite‐Longshot Bias and Market Efficiency in UK Football betting," Scottish Journal of Political Economy, Scottish Economic Society, vol. 47(1), pages 25-36, February.
    13. Peeters, Thomas, 2018. "Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results," International Journal of Forecasting, Elsevier, vol. 34(1), pages 17-29.
    14. Forrest, David & Simmons, Robert, 2000. "Forecasting sport: the behaviour and performance of football tipsters," International Journal of Forecasting, Elsevier, vol. 16(3), pages 317-331.
    15. Siem Jan Koopman & Rutger Lit, 2015. "A dynamic bivariate Poisson model for analysing and forecasting match results in the English Premier League," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(1), pages 167-186, January.
    16. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    17. De Bondt, Werner F M & Thaler, Richard, 1985. "Does the Stock Market Overreact?," Journal of Finance, American Finance Association, vol. 40(3), pages 793-805, July.
    18. Gary Chamberlain, 1980. "Analysis of Covariance with Qualitative Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 225-238.
    19. O'Connor, Marcus & Remus, William & Griggs, Ken, 1993. "Judgemental forecasting in times of change," International Journal of Forecasting, Elsevier, vol. 9(2), pages 163-172, August.
    20. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    21. Lawrence, Michael & O'Connor, Marcus, 2000. "Sales forecasting updates: how good are they in practice?," International Journal of Forecasting, Elsevier, vol. 16(3), pages 369-382.
    22. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    23. De Bondt, Werner P. M., 1993. "Betting on trends: Intuitive forecasts of financial risk and return," International Journal of Forecasting, Elsevier, vol. 9(3), pages 355-371, November.
    24. Bruno Deschamps & Olivier Gergaud, 2007. "Efficiency in Betting Markets: Evidence from English Football," Journal of Prediction Markets, University of Buckingham Press, vol. 1(1), pages 61-73, February.
    25. Clements, Michael P, 1995. "Rationality and the Role of Judgement in Macroeconomic Forecasting," Economic Journal, Royal Economic Society, vol. 105(429), pages 410-420, March.
    26. Goddard, John, 2005. "Regression models for forecasting goals and match results in association football," International Journal of Forecasting, Elsevier, vol. 21(2), pages 331-340.
    27. O'Connor, Marcus & Remus, William & Griggs, Kenneth, 2000. "Does updating judgmental forecasts improve forecast accuracy?," International Journal of Forecasting, Elsevier, vol. 16(1), pages 101-109.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bar-Eli, Michael & Krumer, Alex & Morgulev, Elia, 2020. "Ask not what economics can do for sports - Ask what sports can do for economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    4. Sarah Jewell & J. James Reade & Carl Singleton, 2020. "It's Just Not Cricket: The Uncontested Toss and the Gentleman's Game," Economics Discussion Papers em-dp2020-10, Department of Economics, University of Reading.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    2. Angelini, Giovanni & De Angelis, Luca & Singleton, Carl, 2022. "Informational efficiency and behaviour within in-play prediction markets," International Journal of Forecasting, Elsevier, vol. 38(1), pages 282-299.
    3. Hubáček, Ondřej & Šír, Gustav, 2023. "Beating the market with a bad predictive model," International Journal of Forecasting, Elsevier, vol. 39(2), pages 691-719.
    4. Butler, David & Butler, Robert & Eakins, John, 2021. "Expert performance and crowd wisdom: Evidence from English Premier League predictions," European Journal of Operational Research, Elsevier, vol. 288(1), pages 170-182.
    5. Wunderlich, Fabian & Memmert, Daniel, 2020. "Are betting returns a useful measure of accuracy in (sports) forecasting?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 713-722.
    6. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    7. Ruud H. Koning & Renske Zijm, 2023. "Betting market efficiency and prediction in binary choice models," Annals of Operations Research, Springer, vol. 325(1), pages 135-148, June.
    8. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    9. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    10. da Costa, Igor Barbosa & Marinho, Leandro Balby & Pires, Carlos Eduardo Santos, 2022. "Forecasting football results and exploiting betting markets: The case of “both teams to score”," International Journal of Forecasting, Elsevier, vol. 38(3), pages 895-909.
    11. Green, Lawrence & Sung, Ming-Chien & Ma, Tiejun & Johnson, Johnnie E. V., 2019. "To what extent can new web-based technology improve forecasts? Assessing the economic value of information derived from Virtual Globes and its rate of diffusion in a financial market," European Journal of Operational Research, Elsevier, vol. 278(1), pages 226-239.
    12. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    13. J Reade & C Singleton & L Vaughan Williams, 2020. "Betting Markets for English Premier League Results and Scorelines: Evaluating a Simple Forecasting Model," Economic Issues Journal Articles, Economic Issues, vol. 25(1), pages 87-106, March.
    14. Kai Fischer & Justus Haucap, 2020. "Betting Market Efficiency in the Presence of Unfamiliar Shocks: The Case of Ghost Games during the Covid-19 Pandemic," CESifo Working Paper Series 8526, CESifo.
    15. Pascal Flurin Meier & Raphael Flepp & Egon Franck, 2021. "Are sports betting markets semistrong efficient? Evidence from the COVID-19 pandemic," Working Papers 387, University of Zurich, Department of Business Administration (IBW).
    16. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
    17. Michels, Rouven & Ötting, Marius & Langrock, Roland, 2023. "Bettors’ reaction to match dynamics: Evidence from in-game betting," European Journal of Operational Research, Elsevier, vol. 310(3), pages 1118-1127.
    18. Marc Garnica-Caparrós & Daniel Memmert & Fabian Wunderlich, 2022. "Artificial data in sports forecasting: a simulation framework for analysing predictive models in sports," Information Systems and e-Business Management, Springer, vol. 20(3), pages 551-580, September.
    19. Hubáček, Ondřej & Šourek, Gustav & Železný, Filip, 2019. "Exploiting sports-betting market using machine learning," International Journal of Forecasting, Elsevier, vol. 35(2), pages 783-796.
    20. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.

    More about this item

    Keywords

    Judgement revision; Prediction making; Forecasting behaviour; Expectations;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • Z2 - Other Special Topics - - Sports Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rdg:emxxdp:em-dp2019-05. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexander Mihailov (email available below). General contact details of provider: https://edirc.repec.org/data/derdguk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.