Improving the wisdom of crowds with analysis of variance of predictions of related outcomes
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ijforecast.2021.03.011
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Ottaviani, Marco & Sorensen, Peter Norman, 2006.
"The strategy of professional forecasting,"
Journal of Financial Economics, Elsevier, vol. 81(2), pages 441-466, August.
- Marco Ottaviani & Peter Norman Sorensen, 2001. "The Strategy of Professional Forecasting," Discussion Papers 01-09, University of Copenhagen. Department of Economics.
- Marco Ottaviani & Peter Norman Sørensen, 2004. "The Strategy of Professional Forecasting," FRU Working Papers 2004/05, University of Copenhagen. Department of Economics. Finance Research Unit.
- Jonathan Baron & Barbara A. Mellers & Philip E. Tetlock & Eric Stone & Lyle H. Ungar, 2014. "Two Reasons to Make Aggregated Probability Forecasts More Extreme," Decision Analysis, INFORMS, vol. 11(2), pages 133-145, June.
- Ville A. Satopää & Robin Pemantle & Lyle H. Ungar, 2016. "Modeling Probability Forecasts via Information Diversity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1623-1633, October.
- Stephen C. Hora & Benjamin R. Fransen & Natasha Hawkins & Irving Susel, 2013. "Median Aggregation of Distribution Functions," Decision Analysis, INFORMS, vol. 10(4), pages 279-291, December.
- Moore, Don A. & Klein, William M.P., 2008. "Use of absolute and comparative performance feedback in absolute and comparative judgments and decisions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 107(1), pages 60-74, September.
- Fergus Bolger & Gene Rowe, 2015. "The Aggregation of Expert Judgment: Do Good Things Come to Those Who Weight?," Risk Analysis, John Wiley & Sons, vol. 35(1), pages 5-11, January.
- Oliver Kim & Steve C. Lim & Kenneth W. Shaw, 2001. "The Inefficiency of the Mean Analyst Forecast as a Summary Forecast of Earnings," Journal of Accounting Research, Wiley Blackwell, vol. 39(2), pages 329-335, September.
- Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91, January.
- Stephen C. Hora, 2004. "Probability Judgments for Continuous Quantities: Linear Combinations and Calibration," Management Science, INFORMS, vol. 50(5), pages 597-604, May.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- repec:nas:journl:v:115:y:2018:p:e12135-e12143 is not listed on IDEAS
- A. Dawid & M. DeGroot & J. Mortera & R. Cooke & S. French & C. Genest & M. Schervish & D. Lindley & K. McConway & R. Winkler, 1995. "Coherent combination of experts' opinions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 4(2), pages 263-313, December.
- Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
- Dražen Prelec & H. Sebastian Seung & John McCoy, 2017. "A solution to the single-question crowd wisdom problem," Nature, Nature, vol. 541(7638), pages 532-535, January.
- Marshall Fisher & Ananth Raman, 1996. "Reducing the Cost of Demand Uncertainty Through Accurate Response to Early Sales," Operations Research, INFORMS, vol. 44(1), pages 87-99, February.
- Asa B. Palley & Jack B. Soll, 2019. "Extracting the Wisdom of Crowds When Information Is Shared," Management Science, INFORMS, vol. 67(5), pages 2291-2309, May.
- Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Phillip E. Pfeifer, 2013. "The Wisdom of Competitive Crowds," Operations Research, INFORMS, vol. 61(6), pages 1383-1398, December.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
- Hyndman, Rob J. & Koehler, Anne B., 2006.
"Another look at measures of forecast accuracy,"
International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
- Rob J. Hyndman & Anne B. Koehler, 2005. "Another Look at Measures of Forecast Accuracy," Monash Econometrics and Business Statistics Working Papers 13/05, Monash University, Department of Econometrics and Business Statistics.
- Itai Areili & Yakov Babichenko & Rann Smorodinsky, 2017. "Robust Forecast Aggregation," Papers 1710.02838, arXiv.org, revised Feb 2018.
- McKelvey, Richard D & Page, Talbot, 1986. "Common Knowledge, Consensus, and Aggregate Information," Econometrica, Econometric Society, vol. 54(1), pages 109-127, January.
- Satopää, Ville A. & Baron, Jonathan & Foster, Dean P. & Mellers, Barbara A. & Tetlock, Philip E. & Ungar, Lyle H., 2014. "Combining multiple probability predictions using a simple logit model," International Journal of Forecasting, Elsevier, vol. 30(2), pages 344-356.
- Jose, Victor Richmond R. & Winkler, Robert L., 2008. "Simple robust averages of forecasts: Some empirical results," International Journal of Forecasting, Elsevier, vol. 24(1), pages 163-169.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
- Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022.
"Forecasting: theory and practice,"
International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
- Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
- Asa B. Palley & Jack B. Soll, 2019. "Extracting the Wisdom of Crowds When Information Is Shared," Management Science, INFORMS, vol. 67(5), pages 2291-2309, May.
- Cem Peker, 2023. "Extracting the collective wisdom in probabilistic judgments," Theory and Decision, Springer, vol. 94(3), pages 467-501, April.
- Satopää, Ville A. & Salikhov, Marat & Tetlock, Philip E. & Mellers, Barbara, 2023. "Decomposing the effects of crowd-wisdom aggregators: The bias–information–noise (BIN) model," International Journal of Forecasting, Elsevier, vol. 39(1), pages 470-485.
- Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
- Keppo, Jussi & Satopää, Ville A., 2024. "Bayesian herd detection for dynamic data," International Journal of Forecasting, Elsevier, vol. 40(1), pages 285-301.
- Yanwei Jia & Jussi Keppo & Ville Satopää, 2023. "Herding in Probabilistic Forecasts," Management Science, INFORMS, vol. 69(5), pages 2713-2732, May.
- Victor Richmond R. Jose & Yael Grushka-Cockayne & Kenneth C. Lichtendahl, 2014. "Trimmed Opinion Pools and the Crowd's Calibration Problem," Management Science, INFORMS, vol. 60(2), pages 463-475, February.
- Yakov Babichenko & Dan Garber, 2021. "Learning Optimal Forecast Aggregation in Partial Evidence Environments," Mathematics of Operations Research, INFORMS, vol. 46(2), pages 628-641, May.
- Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
- Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
- repec:cup:judgdm:v:14:y:2019:i:4:p:395-411 is not listed on IDEAS
- Li, Li & Kang, Yanfei & Li, Feng, 2023.
"Bayesian forecast combination using time-varying features,"
International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
- Li Li & Yanfei Kang & Feng Li, 2021. "Bayesian forecast combination using time-varying features," Papers 2108.02082, arXiv.org, revised Jun 2022.
- Patrick Afflerbach & Christopher Dun & Henner Gimpel & Dominik Parak & Johannes Seyfried, 2021. "A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 329-348, August.
- Ville A. Satopää & Robin Pemantle & Lyle H. Ungar, 2016. "Modeling Probability Forecasts via Information Diversity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1623-1633, October.
- Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
- Stephen Hora & Erim Kardeş, 2015. "Calibration, sharpness and the weighting of experts in a linear opinion pool," Annals of Operations Research, Springer, vol. 229(1), pages 429-450, June.
- Ying Han & David Budescu, 2019. "A universal method for evaluating the quality of aggregators," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 395-411, July.
- Ville A. Satopää & Marat Salikhov & Philip E. Tetlock & Barbara Mellers, 2021. "Bias, Information, Noise: The BIN Model of Forecasting," Management Science, INFORMS, vol. 67(12), pages 7599-7618, December.
- Anil Gaba & Ilia Tsetlin & Robert L. Winkler, 2017. "Combining Interval Forecasts," Decision Analysis, INFORMS, vol. 14(1), pages 1-20, March.
More about this item
Keywords
Bayesian updating; Central tendency; Judgmental forecasts; Information aggregation; Model averaging;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:37:y:2021:i:4:p:1728-1747. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.