IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v84y2014icp215-229.html
   My bibliography  Save this article

Assessing Delphi panel composition for strategic foresight — A comparison of panels based on company-internal and external participants

Author

Listed:
  • Förster, Bernadette
  • von der Gracht, Heiko

Abstract

Decision makers seek advice from others in order to make more accurate decisions, justify these decisions, and share responsibility. The Delphi survey technique finds broad acceptance as a decision support and forecasting tool. Recent research has discussed the composition of Delphi panels and whether company internal or external panelists should be consulted for strategic foresight. We make a contribution to this discussion by investigating whether internal and external participants of Delphi studies lead to differing results and how the differences can be utilized by decision makers. We consider differences that might be inherent not only to quantitative but also to qualitative Delphi data. Results of our research reveal that there are several significant differences between the two panels' evaluations, which lead to varying consultation practices for different strategic purposes.

Suggested Citation

  • Förster, Bernadette & von der Gracht, Heiko, 2014. "Assessing Delphi panel composition for strategic foresight — A comparison of panels based on company-internal and external participants," Technological Forecasting and Social Change, Elsevier, vol. 84(C), pages 215-229.
    • Handle: RePEc:eee:tefoso:v:84:y:2014:i:c:p:215-229
    DOI: 10.1016/j.techfore.2013.07.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162513001649
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2013.07.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Miller, Edward M, 1977. "Risk, Uncertainty, and Divergence of Opinion," Journal of Finance, American Finance Association, vol. 32(4), pages 1151-1168, September.
    2. Yaniv, Ilan, 2011. "Group diversity and decision quality: Amplification and attenuation of the framing effect," International Journal of Forecasting, Elsevier, vol. 27(1), pages 41-49, January.
    3. Vasconcelos, Flávio C. & Ramirez, Rafael, 2011. "Complexity in business environments," Journal of Business Research, Elsevier, vol. 64(3), pages 236-241, March.
    4. Paul Goodwin & George Wright, 2001. "Enhancing Strategy Evaluation in Scenario Planning: a Role for Decision Analysis," Journal of Management Studies, Wiley Blackwell, vol. 38(1), pages 1-16, January.
    5. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40, January.
    6. Armstrong, J. Scott & Overton, Terry S., 1977. "Estimating Nonresponse Bias in Mail Surveys," MPRA Paper 81694, University Library of Munich, Germany.
    7. Wright, George & Cairns, George & Goodwin, Paul, 2009. "Teaching scenario planning: Lessons from practice in academe and business," European Journal of Operational Research, Elsevier, vol. 194(1), pages 323-335, April.
    8. Yaniv, Ilan, 2011. "Group diversity and decision quality: Amplification and attenuation of the framing effect," International Journal of Forecasting, Elsevier, vol. 27(1), pages 41-49.
    9. Tanya Menon & Leigh Thompson & Hoon-Seok Choi, 2006. "Tainted Knowledge vs. Tempting Knowledge: People Avoid Knowledge from Internal Rivals and Seek Knowledge from External Rivals," Management Science, INFORMS, vol. 52(8), pages 1129-1144, August.
    10. Unknown, 2005. "Forward," 2005 Conference: Slovenia in the EU - Challenges for Agriculture, Food Science and Rural Affairs, November 10-11, 2005, Moravske Toplice, Slovenia 183804, Slovenian Association of Agricultural Economists (DAES).
    11. von der Gracht, Heiko A. & Darkow, Inga-Lena, 2010. "Scenarios for the logistics services industry: A Delphi-based analysis for 2025," International Journal of Production Economics, Elsevier, vol. 127(1), pages 46-59, September.
    12. Landeta, Jon & Barrutia, Jon, 2011. "People consultation to construct the future: A Delphi application," International Journal of Forecasting, Elsevier, vol. 27(1), pages 134-151, January.
    13. Naim, Mohamed & Aryee, Gilbert & Potter, Andrew, 2010. "Determining a logistics provider's flexibility capability," International Journal of Production Economics, Elsevier, vol. 127(1), pages 39-45, September.
    14. Alexander S. Alexiev & Justin J. P. Jansen & Frans A. J. Van den Bosch & Henk W. Volberda, 2010. "Top Management Team Advice Seeking and Exploratory Innovation: The Moderating Role of TMT Heterogeneity," Journal of Management Studies, Wiley Blackwell, vol. 47(7), pages 1343-1364, November.
    15. Harvey, Nigel & Fischer, Ilan, 1997. "Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility," Organizational Behavior and Human Decision Processes, Elsevier, vol. 70(2), pages 117-133, May.
    16. John F. Preble, 1984. "The selection of delphi panels for strategic planning purposes," Strategic Management Journal, Wiley Blackwell, vol. 5(2), pages 157-170, April.
    17. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    18. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    19. Michael R Czinkota & Ilkka A Ronkainen, 1997. "International Business and Trade in the Next Decade: Report from a Delphi Study," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 28(4), pages 827-844, December.
    20. von der Gracht, Heiko A., 2012. "Consensus measurement in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 79(8), pages 1525-1536.
    21. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40.
    22. Landeta, Jon & Barrutia, Jon, 2011. "People consultation to construct the future: A Delphi application," International Journal of Forecasting, Elsevier, vol. 27(1), pages 134-151.
    23. Piecyk, Maja I. & McKinnon, Alan C., 2010. "Forecasting the carbon footprint of road freight transport in 2020," International Journal of Production Economics, Elsevier, vol. 128(1), pages 31-42, November.
    24. Robert J. Lempert & David G. Groves & Steven W. Popper & Steve C. Bankes, 2006. "A General, Analytic Method for Generating Robust Strategies and Narrative Scenarios," Management Science, INFORMS, vol. 52(4), pages 514-528, April.
    25. Jeffrey G. Covin & Dennis P. Slevin, 1988. "The Influence Of Organization Structure On The Utility Of An Entrepreneurial Top Management Style," Journal of Management Studies, Wiley Blackwell, vol. 25(3), pages 217-234, May.
    26. Tanya Menon & Jeffrey Pfeffer, 2003. "Valuing Internal vs. External Knowledge: Explaining the Preference for Outsiders," Management Science, INFORMS, vol. 49(4), pages 497-513, April.
    27. Yaniv, Ilan & Milyavsky, Maxim, 2007. "Using advice from multiple sources to revise and improve judgments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(1), pages 104-120, May.
    28. Warth, Johannes & von der Gracht, Heiko A. & Darkow, Inga-Lena, 2013. "A dissent-based approach for multi-stakeholder scenario development — The future of electric drive vehicles," Technological Forecasting and Social Change, Elsevier, vol. 80(4), pages 566-583.
    29. P. J. Lamberson & Scott E. Page, 2012. "Optimal Forecasting Groups," Management Science, INFORMS, vol. 58(4), pages 805-810, April.
    30. Meijering, J.V. & Kampen, J.K. & Tobi, H., 2013. "Quantifying the development of agreement among experts in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 80(8), pages 1607-1614.
    31. Yaniv, Ilan, 2004. "Receiving other people's advice: Influence and benefit," Organizational Behavior and Human Decision Processes, Elsevier, vol. 93(1), pages 1-13, January.
    32. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    33. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    34. Geist, Monica R., 2010. "Using the Delphi method to engage stakeholders: A comparison of two studies," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 147-154, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Esmaelian, Majid & Tavana, Madjid & Di Caprio, Debora & Ansari, Reza, 2017. "A multiple correspondence analysis model for evaluating technology foresight methods," Technological Forecasting and Social Change, Elsevier, vol. 125(C), pages 188-205.
    2. Tobias Meyer & Heiko A. von der Gracht & Evi Hartmann, 2022. "Technology foresight for sustainable road freight transportation: Insights from a global real‐time Delphi study," Futures & Foresight Science, John Wiley & Sons, vol. 4(1), March.
    3. Steininger, Dennis M. & Gatzemeier, Simon, 2019. "Digitally forecasting new music product success via active crowdsourcing," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 167-180.
    4. Linares, Ian Marques Porto & De Paulo, Alex Fabianne & Porto, Geciane Silveira, 2019. "Patent-based network analysis to understand technological innovation pathways and trends," Technology in Society, Elsevier, vol. 59(C).
    5. Beiderbeck, Daniel & Frevel, Nicolas & von der Gracht, Heiko A. & Schmidt, Sascha L. & Schweitzer, Vera M., 2021. "The impact of COVID-19 on the European football ecosystem – A Delphi-based scenario analysis," Technological Forecasting and Social Change, Elsevier, vol. 165(C).
    6. Frevel, Nicolas & Beiderbeck, Daniel & Schmidt, Sascha L., 2022. "The impact of technology on sports – A prospective study," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    7. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    8. Peppel, Marcel & Ringbeck, Jürgen & Spinler, Stefan, 2022. "How will last-mile delivery be shaped in 2040? A Delphi-based scenario study," Technological Forecasting and Social Change, Elsevier, vol. 177(C).
    9. Zeng, Michael A. & Koller, Hans & Jahn, Reimo, 2019. "Open radar groups: The integration of online communities into open foresight processes," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 204-217.
    10. Zeng, Michael A., 2018. "Foresight by online communities – The case of renewable energies," Technological Forecasting and Social Change, Elsevier, vol. 129(C), pages 27-42.
    11. Roßmann, Bernhard & Canzaniello, Angelo & von der Gracht, Heiko & Hartmann, Evi, 2018. "The future and social impact of Big Data Analytics in Supply Chain Management: Results from a Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 135-149.
    12. Delke, Vincent & Schiele, Holger & Buchholz, Wolfgang & Kelly, Stephen, 2023. "Implementing Industry 4.0 technologies: Future roles in purchasing and supply management," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    13. Winkler, Jens & Moser, Roger, 2016. "Biases in future-oriented Delphi studies: A cognitive perspective," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 63-76.
    14. Marinković, Milan & Al-Tabbaa, Omar & Khan, Zaheer & Wu, Jie, 2022. "Corporate foresight: A systematic literature review and future research trajectories," Journal of Business Research, Elsevier, vol. 144(C), pages 289-311.
    15. Geissler, Dominik & Beiderbeck, Daniel & Schmidt, Sascha L. & Schreyer, Dominik, 2024. "Emerging technologies and shifting consumer motives: Projecting the future of the top-tier sports media product," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    16. Kopyto, Matthias & Lechler, Sabrina & von der Gracht, Heiko A. & Hartmann, Evi, 2020. "Potentials of blockchain technology in supply chain management: Long-term judgments of an international expert panel," Technological Forecasting and Social Change, Elsevier, vol. 161(C).
    17. Barrios, Maite & Guilera, Georgina & Nuño, Laura & Gómez-Benito, Juana, 2021. "Consensus in the delphi method: What makes a decision change?," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    18. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    19. von Briel, Frederik, 2018. "The future of omnichannel retail: A four-stage Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 132(C), pages 217-229.
    20. Beiderbeck, Daniel & Evans, Nicolas & Frevel, Nicolas & Schmidt, Sascha L., 2023. "The impact of technology on the future of football – A global Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 187(C).
    21. Moutinho, José da Assunção & Fernandes, Gabriela & Rabechini, Roque, 2024. "Evaluation in design science: A framework to support project studies in the context of University Research Centres," Evaluation and Program Planning, Elsevier, vol. 102(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Winkler, Jens & Moser, Roger, 2016. "Biases in future-oriented Delphi studies: A cognitive perspective," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 63-76.
    2. Zeng, Michael A. & Koller, Hans & Jahn, Reimo, 2019. "Open radar groups: The integration of online communities into open foresight processes," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 204-217.
    3. Spickermann, Alexander & Grienitz, Volker & von der Gracht, Heiko A., 2014. "Heading towards a multimodal city of the future?," Technological Forecasting and Social Change, Elsevier, vol. 89(C), pages 201-221.
    4. Philipp Ecken & Richard Pibernik, 2016. "Hit or Miss: What Leads Experts to Take Advice for Long-Term Judgments?," Management Science, INFORMS, vol. 62(7), pages 2002-2021, July.
    5. Spickermann, Alexander & Zimmermann, Martin & von der Gracht, Heiko A., 2014. "Surface- and deep-level diversity in panel selection — Exploring diversity effects on response behaviour in foresight," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 105-120.
    6. Engelke, Henning & Mauksch, Stefanie & Darkow, Inga-Lena & von der Gracht, Heiko A., 2015. "Opportunities for social enterprise in Germany — Evidence from an expert survey," Technological Forecasting and Social Change, Elsevier, vol. 90(PB), pages 635-646.
    7. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    8. von Briel, Frederik, 2018. "The future of omnichannel retail: A four-stage Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 132(C), pages 217-229.
    9. Belton, Ian & MacDonald, Alice & Wright, George & Hamlin, Iain, 2019. "Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 72-82.
    10. Barrios, Maite & Guilera, Georgina & Nuño, Laura & Gómez-Benito, Juana, 2021. "Consensus in the delphi method: What makes a decision change?," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    11. Fritschy, Carolin & Spinler, Stefan, 2019. "The impact of autonomous trucks on business models in the automotive and logistics industry–a Delphi-based scenario study," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    12. Wright, George & Rowe, Gene, 2011. "Group-based judgmental forecasting: An integration of extant knowledge and the development of priorities for a new research agenda," International Journal of Forecasting, Elsevier, vol. 27(1), pages 1-13, January.
    13. Förster, Bernadette, 2015. "Technology foresight for sustainable production in the German automotive supplier industry," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 237-248.
    14. Meijering, Jurian V. & Tobi, Hilde, 2016. "The effect of controlled opinion feedback on Delphi features: Mixed messages from a real-world Delphi experiment," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 166-173.
    15. repec:eee:intfor:v:27:y:2011:i:1:p:1-13 is not listed on IDEAS
    16. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    17. Schlecht, Laura & Schneider, Sabrina & Buchwald, Arne, 2021. "The prospective value creation potential of Blockchain in business models: A delphi study," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    18. Kopyto, Matthias & Lechler, Sabrina & von der Gracht, Heiko A. & Hartmann, Evi, 2020. "Potentials of blockchain technology in supply chain management: Long-term judgments of an international expert panel," Technological Forecasting and Social Change, Elsevier, vol. 161(C).
    19. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    20. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    21. Makkonen, Marika & Hujala, Teppo & Uusivuori, Jussi, 2016. "Policy experts' propensity to change their opinion along Delphi rounds," Technological Forecasting and Social Change, Elsevier, vol. 109(C), pages 61-68.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:84:y:2014:i:c:p:215-229. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.