IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v30y2014i1p43-54.html
   My bibliography  Save this article

Combining forecasts: An application to elections

Author

Listed:
  • Graefe, Andreas
  • Armstrong, J. Scott
  • Jones, Randall J.
  • Cuzán, Alfred G.

Abstract

We summarize the literature on the effectiveness of combining forecasts by assessing the conditions under which combining is most valuable. Using data on the six US presidential elections from 1992 to 2012, we report the reductions in error obtained by averaging forecasts within and across four election forecasting methods: poll projections, expert judgment, quantitative models, and the Iowa Electronic Markets. Across the six elections, the resulting combined forecasts were more accurate than any individual component method, on average. The gains in accuracy from combining increased with the numbers of forecasts used, especially when these forecasts were based on different methods and different data, and in situations involving high levels of uncertainty. Such combining yielded error reductions of between 16% and 59%, compared to the average errors of the individual forecasts. This improvement is substantially greater than the 12% reduction in error that had been reported previously for combining forecasts.

Suggested Citation

  • Graefe, Andreas & Armstrong, J. Scott & Jones, Randall J. & Cuzán, Alfred G., 2014. "Combining forecasts: An application to elections," International Journal of Forecasting, Elsevier, vol. 30(1), pages 43-54.
  • Handle: RePEc:eee:intfor:v:30:y:2014:i:1:p:43-54
    DOI: 10.1016/j.ijforecast.2013.02.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207013000423
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2013.02.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Armstrong, J. Scott, 2007. "Significance tests harm progress in forecasting," International Journal of Forecasting, Elsevier, vol. 23(2), pages 321-327.
    2. Richard P. Larrick & Jack B. Soll, 2006. "Erratum--Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(2), pages 309-310, February.
    3. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    4. Armstrong, J. Scott & Graefe, Andreas, 2011. "Predicting elections from biographical information about candidates: A test of the index method," Journal of Business Research, Elsevier, vol. 64(7), pages 699-706, July.
    5. Montgomery, Jacob M. & Hollenbach, Florian M. & Ward, Michael D., 2012. "Improving Predictions using Ensemble Bayesian Model Averaging," Political Analysis, Cambridge University Press, vol. 20(3), pages 271-291, July.
    6. Stephen Haynes & Joe Stone, 2008. "A disaggregate approach to economic models of voting in U.S. presidential elections: forecasts of the 2008 election," Economics Bulletin, AccessEcon, vol. 4(28), pages 1-11.
    7. Andreas Graefe & J. Scott Armstrong, & Randall J. Jones & Alfred G. Cuz‡n, 2013. "Combined Forecasts of the 2012 Election: The PollyVote," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 28, pages 50-51, Winter.
    8. Graefe, Andreas & Armstrong, J. Scott, 2008. "Forecasting Elections from Voters’ Perceptions of Candidates’ Positions on Issues and Policies," MPRA Paper 9829, University Library of Munich, Germany.
    9. Fred Collopy & J. Scott Armstrong, 1992. "Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations," Management Science, INFORMS, vol. 38(10), pages 1394-1414, October.
    10. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    11. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    12. Anderson, Lisa R & Holt, Charles A, 1997. "Information Cascades in the Laboratory," American Economic Review, American Economic Association, vol. 87(5), pages 847-862, December.
    13. Dalrymple, Douglas J., 1987. "Sales forecasting practices: Results from a United States survey," International Journal of Forecasting, Elsevier, vol. 3(3-4), pages 379-391.
    14. Lichtman, Allan J., 2008. "The keys to the white house: An index forecast for 2008," International Journal of Forecasting, Elsevier, vol. 24(2), pages 301-309.
    15. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    16. Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
    17. Alfred Cuzan & J. Scott Armstrong & Randall J. Jones, Jr., 2005. "How We Computed the Pollyvote," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 1, pages 51-52, June.
    18. Robert L. Winkler & Robert T. Clemen, 2004. "Multiple Experts vs. Multiple Methods: Combining Correlation Assessments," Decision Analysis, INFORMS, vol. 1(3), pages 167-176, September.
    19. repec:ebl:ecbull:v:4:y:2008:i:28:p:1-11 is not listed on IDEAS
    20. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    21. Roy Batchelor & Pami Dua, 1995. "Forecaster Diversity and the Benefits of Combining Forecasts," Management Science, INFORMS, vol. 41(1), pages 68-75, January.
    22. Berg, Joyce E. & Nelson, Forrest D. & Rietz, Thomas A., 2008. "Prediction market accuracy in the long run," International Journal of Forecasting, Elsevier, vol. 24(2), pages 285-300.
    23. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    24. Jay A. DeSart & Thomas M. Holbrook, 2003. "Statewide Trial‐Heat Polls and the 2000 Presidential Election: A Forecast Model," Social Science Quarterly, Southwestern Social Science Association, vol. 84(3), pages 561-573, September.
    25. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    26. Jose, Victor Richmond R. & Winkler, Robert L., 2008. "Simple robust averages of forecasts: Some empirical results," International Journal of Forecasting, Elsevier, vol. 24(1), pages 163-169.
    27. Richard P. Larrick & Jack B. Soll, 2006. "Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(1), pages 111-127, January.
    28. Paul W. Rhode & Koleman S. Strumpf, 2004. "Historical Presidential Betting Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 127-141, Spring.
    29. Andreas Graefe & J. Scott Armstrong & Alfred G. Cuzán & Randall J. Jones, Jr., 2009. "Combined Forecasts of the 2008 Election: The Pollyvote," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 12, pages 41-42, Winter.
    30. Graefe, Andreas & Armstrong, J. Scott, 2011. "Conditions under which index models are useful: Reply to bio-index commentaries," Journal of Business Research, Elsevier, vol. 64(7), pages 693-695, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    2. Graefe, Andreas, 2023. "Embrace the differences: Revisiting the PollyVote method of combining forecasts for U.S. presidential elections (2004 to 2020)," International Journal of Forecasting, Elsevier, vol. 39(1), pages 170-177.
    3. von der Gracht, Heiko A. & Hommel, Ulrich & Prokesch, Tobias & Wohlenberg, Holger, 2016. "Testing weighting approaches for forecasting in a Group Wisdom Support System environment," Journal of Business Research, Elsevier, vol. 69(10), pages 4081-4094.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    6. Kang, Yanfei & Cao, Wei & Petropoulos, Fotios & Li, Feng, 2022. "Forecast with forecasts: Diversity matters," European Journal of Operational Research, Elsevier, vol. 301(1), pages 180-190.
    7. Zvi Schwartz & Timothy Webb & Jean-Pierre I van der Rest & Larissa Koupriouchina, 2021. "Enhancing the accuracy of revenue management system forecasts: The impact of machine and human learning on the effectiveness of hotel occupancy forecast combinations across multiple forecasting horizo," Tourism Economics, , vol. 27(2), pages 273-291, March.
    8. Graefe, Andreas & Armstrong, J. Scott & Jones, Randall J. & Cuzan, Alfred G., 2017. "Assessing the 2016 U.S. Presidential Election Popular Vote Forecasts," MPRA Paper 83282, University Library of Munich, Germany.
    9. repec:cup:judgdm:v:8:y:2013:i:2:p:91-105 is not listed on IDEAS
    10. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    11. Karsten Hueffer & Miguel A. Fonseca & Anthony Leiserowitz & Karen M. Taylor, 2013. "The wisdom of crowds: Predicting a weather and climate-related event," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 8(2), pages 91-105, March.
    12. Nowotarski, Jakub & Liu, Bidong & Weron, Rafał & Hong, Tao, 2016. "Improving short term load forecast accuracy via combining sister forecasts," Energy, Elsevier, vol. 98(C), pages 40-49.
    13. Graefe, Andreas, 2015. "Improving forecasts using equally weighted predictors," Journal of Business Research, Elsevier, vol. 68(8), pages 1792-1799.
    14. Graefe, Andreas, 2019. "Accuracy of German federal election forecasts, 2013 & 2017," International Journal of Forecasting, Elsevier, vol. 35(3), pages 868-877.
    15. repec:cup:judgdm:v:10:y:2015:i:3:p:265-276 is not listed on IDEAS
    16. Graefe, Andreas & Küchenhoff, Helmut & Stierle, Veronika & Riedl, Bernhard, 2015. "Limitations of Ensemble Bayesian Model Averaging for forecasting social science problems," International Journal of Forecasting, Elsevier, vol. 31(3), pages 943-951.
    17. Peter Bednarik & Thomas Schultze, 2015. "The effectiveness of imperfect weighting in advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(3), pages 265-276, May.
    18. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    19. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    20. Sebastian M. Blanc & Thomas Setzer, 2020. "Bias–Variance Trade-Off and Shrinkage of Weights in Forecast Combination," Management Science, INFORMS, vol. 66(12), pages 5720-5737, December.
    21. Yongchen Zhao, 2021. "The robustness of forecast combination in unstable environments: a Monte Carlo study of advanced algorithms," Empirical Economics, Springer, vol. 61(1), pages 173-199, July.
    22. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:30:y:2014:i:1:p:43-54. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.