IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v28y2009i1p1-18.html
   My bibliography  Save this article

Are all crowds equally wise? a comparison of political election forecasts by experts and the public

Author

Listed:
  • Lennart Sjöberg

Abstract

Four groups made forecasts of the outcome of the Swedish Parliamentary election in the fall of 2006. They consisted of members of the public, political scientists, journalists writing about domestic politics in Swedish daily newspapers, and journalists who were editing sections of readers' letters in daily newspapers. They estimated, using a 12-step category scale, which percentage of the votes that they believed seven parties would get in the election. Data were then obtained on the outcome of the election, and on the two opinions polls closest in time to it. When median forecasts were compared across groups, it was found that the group from the public was most successful in forecasting the outcome of the election. This was in spite of the fact that the median error made by individual members of that group was about 50% larger than the median error made by members of other groups. The two polls were less efficient than the group from the public and overestimated the span between the incumbent government and the opposition by a factor of 2. The members of the public and journalists showed some wishful thinking in their forecasts. There were large and consistent individual differences in forecasting ability. Men performed better than women, as did those who expressed more interest and knowledge in politics. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Lennart Sjöberg, 2009. "Are all crowds equally wise? a comparison of political election forecasts by experts and the public," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 1-18.
  • Handle: RePEc:jof:jforec:v:28:y:2009:i:1:p:1-18
    DOI: 10.1002/for.1083
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/for.1083
    File Function: Link to full text; subscription required
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.1083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew Leigh & Justin Wolfers, 2006. "Competing Approaches to Forecasting Elections: Economic Models, Opinion Polling and Prediction Markets," The Economic Record, The Economic Society of Australia, vol. 82(258), pages 325-340, September.
    2. Lewis-Beck, Michael S. & Skalaban, Andrew, 1989. "Citizen Forecasting: Can Voters See into the Future?," British Journal of Political Science, Cambridge University Press, vol. 19(1), pages 146-153, January.
    3. Thomas S. Gruca & Joyce E. Berg, 2007. "Public Information Bias and Prediction Market Accuracy," Journal of Prediction Markets, University of Buckingham Press, vol. 1(3), pages 219-231, December.
    4. Justin Wolfers & Eric Zitzewitz, 2004. "Prediction Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 107-126, Spring.
    5. repec:reg:rpubli:460 is not listed on IDEAS
    6. Lewis-Beck, Michael S. & Tien, Charles, 1999. "Voters as forecasters: a micromodel of election prediction," International Journal of Forecasting, Elsevier, vol. 15(2), pages 175-184, April.
    7. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    8. Andersson, Patric & Edman, Jan & Ekman, Mattias, 2005. "Predicting the World Cup 2002 in soccer: Performance and confidence of experts and non-experts," International Journal of Forecasting, Elsevier, vol. 21(3), pages 565-576.
    9. Andersson, Patric, 2004. "How well do financial experts perform? A review of empirical research on performance of analysts, day-traders, forecasters, fund managers, investors, and stockbrokers," SSE/EFI Working Paper Series in Business Administration 2004:9, Stockholm School of Economics.
    10. Georgios Tziralis & Ilias Tatsiopoulos, 2007. "Prediction Markets: An Extended Literature Review," Journal of Prediction Markets, University of Buckingham Press, vol. 1(1), pages 75-91, February.
    11. Jed D. Christiansen, 2007. "Prediction Markets: Practical Experiments in Small Markets and Behaviours Observed," Journal of Prediction Markets, University of Buckingham Press, vol. 1(1), pages 17-41, February.
    12. Donald Granberg & Sören Holmberg, 2002. "A Mass–Elite Comparison of Wishful Thinking," Social Science Quarterly, Southwestern Social Science Association, vol. 83(4), pages 1079-1085, December.
    13. Paul W. Rhode & Koleman S. Strumpf, 2004. "Historical Presidential Betting Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 127-141, Spring.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oliver Merz & Raphael Flepp & Egon Franck, 2021. "Underestimating randomness: Outcome bias in betting exchange markets," Working Papers 390, University of Zurich, Department of Business Administration (IBW).
    2. Brown, Alasdair & Reade, J. James & Vaughan Williams, Leighton, 2019. "When are prediction market prices most informative?," International Journal of Forecasting, Elsevier, vol. 35(1), pages 420-428.
    3. Niklas Valentin Lehmann, 2023. "Forecasting skill of a crowd-prediction platform: A comparison of exchange rate forecasts," Papers 2312.09081, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sjöberg, Lennart, 2006. "Are all crowds equally wise? A comparison of political election forecasts by experts and the public," SSE/EFI Working Paper Series in Business Administration 2006:9, Stockholm School of Economics, revised 08 Sep 2008.
    2. Khan, Urmee & Lieli, Robert P., 2018. "Information flow between prediction markets, polls and media: Evidence from the 2008 presidential primaries," International Journal of Forecasting, Elsevier, vol. 34(4), pages 696-710.
    3. Buckley, Patrick, 2016. "Harnessing the wisdom of crowds: Decision spaces for prediction markets," Business Horizons, Elsevier, vol. 59(1), pages 85-94.
    4. Patrick Buckley & Fergal O’Brien, 0. "The effect of malicious manipulations on prediction market accuracy," Information Systems Frontiers, Springer, vol. 0, pages 1-13.
    5. Snowberg, Erik & Wolfers, Justin & Zitzewitz, Eric, 2013. "Prediction Markets for Economic Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 657-687, Elsevier.
    6. Stiers, Dieter & Dassonneville, Ruth, 2018. "Affect versus cognition: Wishful thinking on election day," International Journal of Forecasting, Elsevier, vol. 34(2), pages 199-215.
    7. Schadner, Wolfgang, 2022. "U.S. Politics from a multifractal perspective," Chaos, Solitons & Fractals, Elsevier, vol. 155(C).
    8. Patrick Buckley & Fergal O’Brien, 2017. "The effect of malicious manipulations on prediction market accuracy," Information Systems Frontiers, Springer, vol. 19(3), pages 611-623, June.
    9. Valeria Croce & Karl Wöber & John Kester, 2016. "Expert identification and calibration for collective forecasting tasks," Tourism Economics, , vol. 22(5), pages 979-994, October.
    10. Edoardo Gaffeo, 2013. "Using information markets in grantmaking. An assessment of the issues involved and an application to Italian banking foundations," DEM Discussion Papers 2013/08, Department of Economics and Management.
    11. Joyce E. Berg & John Geweke & Thomas A. Rietz, 2010. "Memoirs of an indifferent trader: Estimating forecast distributions from prediction markets," Quantitative Economics, Econometric Society, vol. 1(1), pages 163-186, July.
    12. Franch, Fabio, 2021. "Political preferences nowcasting with factor analysis and internet data: The 2012 and 2016 US presidential elections," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    13. Goodwin, Paul & Meeran, Sheik & Dyussekeneva, Karima, 2014. "The challenges of pre-launch forecasting of adoption time series for new durable products," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1082-1097.
    14. Graefe, Andreas & Armstrong, J. Scott, 2011. "Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task," International Journal of Forecasting, Elsevier, vol. 27(1), pages 183-195.
    15. Riekhof, Hans-Christian & Riekhof, Marie-Catherine & Brinkhoff, Stefan, 2012. "Predictive Markets: Ein vielversprechender Weg zur Verbesserung der Prognosequalität im Unternehmen?," PFH Forschungspapiere/Research Papers 2012/07, PFH Private University of Applied Sciences, Göttingen.
    16. Siemroth, Christoph, 2014. "Why prediction markets work : The role of information acquisition and endogenous weighting," Working Papers 14-02, University of Mannheim, Department of Economics.
    17. Galanis, S. & Ioannou, C. & Kotronis, S., 2019. "Information Aggregation Under Ambiguity: Theory and Experimental Evidence," Working Papers 20/05, Department of Economics, City University London.
    18. Wolfers, Justin & Zitzewitz, Eric, 2006. "Prediction Markets in Theory and Practice," CEPR Discussion Papers 5578, C.E.P.R. Discussion Papers.
    19. Mikuláš Gangur & Miroslav Plevný, 2014. "Tools for Consumer Rights Protection in the Prediction of Electronic Virtual Market and Technological Changes," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 16(36), pages 578-578, May.
    20. Markus Glaser & Thomas Langer & Martin Weber, 2007. "On the Trend Recognition and Forecasting Ability of Professional Traders," Decision Analysis, INFORMS, vol. 4(4), pages 176-193, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:28:y:2009:i:1:p:1-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.