IDEAS home Printed from https://ideas.repec.org/a/for/ijafaa/y2007i8p17-20.html
   My bibliography  Save this article

Methods to Elicit Forecasts from Groups: Delphi and Prediction Markets Compared

Author

Listed:
  • Kesten Green
  • J. Scott Armstrong
  • Andreas Graefe

Abstract

The Delphi technique is better than traditional group meetings for forecasting and has some advantages over another promising alternative to meetings, prediction markets. In this article, Kesten, Scott, and Andreas observe the increasing popularity of Delphi, describe the benefits of using this method to obtain forecasts from experts, compare it with prediction markets, and conclude that Delphi should be used more widely. Copyright International Institute of Forecasters, 2007

Suggested Citation

  • Kesten Green & J. Scott Armstrong & Andreas Graefe, 2007. "Methods to Elicit Forecasts from Groups: Delphi and Prediction Markets Compared," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 17-20, Fall.
    • Handle: RePEc:for:ijafaa:y:2007:i:8:p:17-20
    as

    Download full text from publisher

    File URL: https://foresight.forecasters.org/shop/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kesten C. Green & J. Scott Armstrong, 2004. "Value of Expertise For Forecasting Decisions in Conflicts," Monash Econometrics and Business Statistics Working Papers 27/04, Monash University, Department of Econometrics and Business Statistics.
    2. Sandra Hoffmann & Paul Fischbeck & Alan Krupnick & Michael McWilliams, 2007. "Elicitation from Large, Heterogeneous Expert Panels: Using Multiple Uncertainty Measures to Characterize Information Quality for Decision Analysis," Decision Analysis, INFORMS, vol. 4(2), pages 91-109, June.
    3. Gene Rowe, 2007. "A Guide to Delphi," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 11-16, Fall.
    4. Paul W. Rhode & Koleman S. Strumpf, 2004. "Historical Presidential Betting Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 127-141, Spring.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Graefe, Andreas & Armstrong, J. Scott, 2011. "Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task," International Journal of Forecasting, Elsevier, vol. 27(1), pages 183-195, January.
    2. Robert J. MacCoun, 2010. "Comment on "Rethinking America's Illegal Drug Policy"," NBER Chapters, in: Controlling Crime: Strategies and Tradeoffs, pages 281-289, National Bureau of Economic Research, Inc.
    3. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40, January.
    4. Maria Jose Marques & Gudrun Schwilch & Nina Lauterburg & Stephen Crittenden & Mehreteab Tesfai & Jannes Stolte & Pandi Zdruli & Claudio Zucca & Thorunn Petursdottir & Niki Evelpidou & Anna Karkani & Y, 2016. "Multifaceted Impacts of Sustainable Land Management in Drylands: A Review," Sustainability, MDPI, vol. 8(2), pages 1-34, February.
    5. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40.
    6. Milan Daus & Katharina Koberger & Kaan Koca & Felix Beckers & Jorge Encinas Fernández & Barbara Weisbrod & Daniel Dietrich & Sabine Ulrike Gerbersdorf & Rüdiger Glaser & Stefan Haun & Hilmar Hofmann &, 2021. "Interdisciplinary Reservoir Management—A Tool for Sustainable Water Resources Management," Sustainability, MDPI, vol. 13(8), pages 1-21, April.
    7. Keyvanfar, Ali & Shafaghat, Arezou & Abd Majid, Muhd Zaimi & Bin Lamit, Hasanuddin & Warid Hussin, Mohd & Binti Ali, Kherun Nita & Dhafer Saad, Alshahri, 2014. "User satisfaction adaptive behaviors for assessing energy efficient building indoor cooling and lighting environment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 39(C), pages 277-295.
    8. Samir Mili & Maria Bouhaddane, 2021. "Forecasting Global Developments and Challenges in Olive Oil Supply and Demand: A Delphi Survey from Spain," Agriculture, MDPI, vol. 11(3), pages 1-25, February.
    9. Angela Dalton & Alan Brothers & Stephen Walsh & Paul Whitney, 2010. "Expert Elicitation Method Selection Process and Method Comparison," Labsi Experimental Economics Laboratory University of Siena 030, University of Siena.
    10. Bloem da Silveira Junior, Luiz A. & Vasconcellos, Eduardo & Vasconcellos Guedes, Liliana & Guedes, Luis Fernando A. & Costa, Renato Machado, 2018. "Technology roadmapping: A methodological proposition to refine Delphi results," Technological Forecasting and Social Change, Elsevier, vol. 126(C), pages 194-206.
    11. Omid Bozorg-Haddad & Mohammad Delpasand & Sarvin ZamanZad-Ghavidel & Xuefeng Chu, 2024. "Developing a novel social–water capital index by gene expression programming," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(11), pages 28187-28217, November.
    12. Liu, Yaqin & Zhao, Guohao & Zhao, Yushan, 2016. "An analysis of Chinese provincial carbon dioxide emission efficiencies based on energy consumption structure," Energy Policy, Elsevier, vol. 96(C), pages 524-533.
    13. Ricardo Gomes & Alfeu Marques & Joaquim Sousa, 2013. "District Metered Areas Design Under Different Decision Makers’ Options: Cost Analysis," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 27(13), pages 4527-4543, October.
    14. Vicente Coll-Serrano & Salvador Carrasco-Arroyo & Olga Blasco-Blasco & Luis Vila-Lladosa, 2012. "Design of a Basic System of Indicators for Monitoring and Evaluating Spanish Cooperation’s Culture and Development Strategy," Evaluation Review, , vol. 36(4), pages 272-302, August.
    15. Goodwin, Paul & Meeran, Sheik & Dyussekeneva, Karima, 2014. "The challenges of pre-launch forecasting of adoption time series for new durable products," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1082-1097.
    16. Palma, David & Dios Ortuzar, Juan de & Casaubon, Gerard & Rizzi, Luis I. & Agosin, Eduardo, 2013. "Measuring consumer preferences using hybrid discrete choice models," Working Papers 164855, American Association of Wine Economists.
    17. Joshua Becker & Abdullah Almaatouq & EmH{o}ke-'Agnes Horv'at, 2020. "Network Structures of Collective Intelligence: The Contingent Benefits of Group Discussion," Papers 2009.07202, arXiv.org, revised Mar 2021.
    18. Geoff Woolcott & Dan Chamberlain & Zachary Hawes & Michelle Drefs & Catherine D. Bruce & Brent Davis & Krista Francis & David Hallowell & Lynn McGarvey & Joan Moss & Joanne Mulligan & Yukari Okamoto &, 2020. "The central position of education in knowledge mobilization: insights from network analyses of spatial reasoning research across disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2323-2347, December.
    19. Shin, Dong-Hee, 2015. "Effect of the customer experience on satisfaction with smartphones: Assessing smart satisfaction index with partial least squares," Telecommunications Policy, Elsevier, vol. 39(8), pages 627-641.
    20. Lang, Mark & Bharadwaj, Neeraj & Di Benedetto, C. Anthony, 2016. "How crowdsourcing improves prediction of market-oriented outcomes," Journal of Business Research, Elsevier, vol. 69(10), pages 4168-4176.
    21. Robert Reig & Ramona Schoder, 2010. "Forecasting Accuracy: Comparing Prediction Markets And Surveys – An Experimental Study," Journal of Prediction Markets, University of Buckingham Press, vol. 4(3), pages 1-19.
    22. Soyeon Caren Han & Yulu Liang & Hyunsuk Chung & Hyejin Kim & Byeong Ho Kang, 2016. "Chinese trending search terms popularity rank prediction," Information Technology and Management, Springer, vol. 17(2), pages 133-139, June.
    23. Sungchul Kim & Dongsik Jang & Sunghae Jun & Sangsung Park, 2015. "A Novel Forecasting Methodology for Sustainable Management of Defense Technology," Sustainability, MDPI, vol. 7(12), pages 1-17, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Scott Armstrong & Kesten C. Green, 2005. "Demand Forecasting: Evidence-based Methods," Monash Econometrics and Business Statistics Working Papers 24/05, Monash University, Department of Econometrics and Business Statistics.
    2. Romain Gauriot Author e-mail: romain.gauriot@nyu.edu & Lionel Page Author e-mail: lionel.page@uts.edu.au, 2021. "How Market Prices React to Information: Evidence from Binary Options Markets," Working Papers 20200058, New York University Abu Dhabi, Department of Social Science, revised Oct 2021.
    3. Galanis, S. & Ioannou, C. & Kotronis, S., 2019. "Information Aggregation Under Ambiguity: Theory and Experimental Evidence," Working Papers 20/05, Department of Economics, City University London.
    4. Wolfers, Justin & Zitzewitz, Eric, 2006. "Prediction Markets in Theory and Practice," CEPR Discussion Papers 5578, C.E.P.R. Discussion Papers.
    5. Dai, Min & Jia, Yanwei & Kou, Steven, 2021. "The wisdom of the crowd and prediction markets," Journal of Econometrics, Elsevier, vol. 222(1), pages 561-578.
    6. Green, Kesten C., 2005. "Game theory, simulated interaction, and unaided judgement for forecasting decisions in conflicts: Further evidence," International Journal of Forecasting, Elsevier, vol. 21(3), pages 463-472.
    7. Legge, Stefan & Schmid, Lukas, 2016. "Media attention and betting markets," European Economic Review, Elsevier, vol. 87(C), pages 304-333.
    8. Rhode, Paul W. & Snyder, Jr., James M. & Strumpf, Koleman, 2018. "The arsenal of democracy: Production and politics during WWII," Journal of Public Economics, Elsevier, vol. 166(C), pages 145-161.
    9. David Paton & Donald S. Siegel & Leighton Vaughan Williams, 2009. "The Growth of Gambling and Prediction Markets: Economic and Financial Implications," Economica, London School of Economics and Political Science, vol. 76(302), pages 219-224, April.
    10. Robert F. Bordley, 2009. "Combining the Opinions of Experts Who Partition Events Differently," Decision Analysis, INFORMS, vol. 6(1), pages 38-46, March.
    11. Coulomb, Renaud & Sangnier, Marc, 2014. "The impact of political majorities on firm value: Do electoral promises or friendship connections matter?," Journal of Public Economics, Elsevier, vol. 115(C), pages 158-170.
    12. Snowberg, Erik & Wolfers, Justin & Zitzewitz, Eric, 2013. "Prediction Markets for Economic Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 657-687, Elsevier.
    13. Erik Snowberg & Justin Wolfers & Eric Zitzewitz, 2011. "How Prediction Markets can Save Event Studies," CAMA Working Papers 2011-07, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    14. Almond, Douglas & Du, Xinming, 2020. "Later bedtimes predict President Trump’s performance," Economics Letters, Elsevier, vol. 197(C).
    15. Paul J. Healy & Sera Linardi & J. Richard Lowery & John O. Ledyard, 2010. "Prediction Markets: Alternative Mechanisms for Complex Environments with Few Traders," Management Science, INFORMS, vol. 56(11), pages 1977-1996, November.
    16. Schadner, Wolfgang, 2022. "U.S. Politics from a multifractal perspective," Chaos, Solitons & Fractals, Elsevier, vol. 155(C).
    17. António Brandão Moniz, 2012. "Avaliação participativa de tecnologia e sustentabilidade organizacional [Participative technology assessment and organisational sustainability]," IET Working Papers Series 06/2012, Universidade Nova de Lisboa, IET/CICS.NOVA-Interdisciplinary Centre on Social Sciences, Faculty of Science and Technology.
    18. Laura M. Keating & Lea Randall & Rebecca Stanton & Casey McCormack & Michael Lucid & Travis Seaborn & Sarah J. Converse & Stefano Canessa & Axel Moehrenschlager, 2023. "Using Decision Analysis to Determine the Feasibility of a Conservation Translocation," Decision Analysis, INFORMS, vol. 20(4), pages 295-310, December.
    19. Wunderlich, Fabian & Memmert, Daniel, 2020. "Are betting returns a useful measure of accuracy in (sports) forecasting?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 713-722.
    20. Green, Kesten C. & Armstrong, J. Scott, 2007. "Structured analogies for forecasting," International Journal of Forecasting, Elsevier, vol. 23(3), pages 365-376.

    More about this item

    JEL classification:

    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Delphi method in Wikipedia English
    2. デルファイ法 in Wikipedia Japanese
    3. Metoda Delphi in Wikipedia Romanian

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:for:ijafaa:y:2007:i:8:p:17-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael Gilliland (email available below). General contact details of provider: https://edirc.repec.org/data/iiforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.