IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i7p4287-4309.html
   My bibliography  Save this article

Elaborating or Aggregating? The Joint Effects of Group Decision-Making Structure and Systematic Errors on the Value of Group Interactions

Author

Listed:
  • Steffen Keck

    (Department of Business Administration, University of Vienna, 1090 Vienna, Austria)

  • Wenjie Tang

    (Institute of Operations Research and Analytics, National University of Singapore, Singapore 117602)

Abstract

We explore when group interactions will have a positive effect on the accuracy of quantitative judgments. The results from three laboratory experiments revealed that the value of group interactions, compared with a statistical aggregation of individual judgments, differed strongly between groups in which decisions were made based on consensus, compared with groups with a randomly assigned group leader, and that this effect was moderated by the level of systematic error among group members. In particular, when systematic errors were low, group interactions generally provided little value, and groups’ decision-making structure (consensus versus leader based) did not have a significant effect on the value of group interactions. However, when the level of systematic error was high, the value of interactions in groups with a randomly designated leader was strongly positive and significantly higher than in groups with a consensus decision-making structure where interactions still provided only little value. Moreover, we found that this effect was mediated by information elaboration—which was higher in leader groups but only had a significant effect on the value of group interactions when there was a high level of systematic error. Finally, we also identified two important boundary conditions for these results. In particular, leader groups did not provide more value than consensus groups in the presence of strong systematic errors when leaders were assigned based on prior individual performance rather than randomly or when group members had only little expertise in the task.

Suggested Citation

  • Steffen Keck & Wenjie Tang, 2021. "Elaborating or Aggregating? The Joint Effects of Group Decision-Making Structure and Systematic Errors on the Value of Group Interactions," Management Science, INFORMS, vol. 67(7), pages 4287-4309, July.
  • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4287-4309
    DOI: 10.1287/mnsc.2020.3688
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3688
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3688?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Graefe, Andreas & Armstrong, J. Scott, 2011. "Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task," International Journal of Forecasting, Elsevier, vol. 27(1), pages 183-195, January.
    2. Richard P. Larrick & Jack B. Soll, 2006. "Erratum--Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(2), pages 309-310, February.
    3. Schultze, Thomas & Mojzisch, Andreas & Schulz-Hardt, Stefan, 2012. "Why groups perform better than individuals at quantitative judgment tasks: Group-to-individual transfer as an alternative to differential weighting," Organizational Behavior and Human Decision Processes, Elsevier, vol. 118(1), pages 24-36.
    4. Hinsz, Verlin B., 1999. "Group Decision Making with Responses of a Quantitative Nature: The Theory of Social Decision Schemes for Quantities, , , , , , , , , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 80(1), pages 28-49, October.
    5. van Ginkel, Wendy P. & van Knippenberg, Daan, 2009. "Knowledge about the distribution of information and group decision making: When and why does it work?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(2), pages 218-229, March.
    6. Fast, Nathanael J. & Sivanathan, Niro & Mayer, Nicole D. & Galinsky, Adam D., 2012. "Power and overconfident decision-making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 117(2), pages 249-260.
    7. Ing-Haw Cheng & Sahil Raina & Wei Xiong, 2014. "Wall Street and the Housing Bubble," American Economic Review, American Economic Association, vol. 104(9), pages 2797-2829, September.
    8. Weldon, Elizabeth & Mustari, Elisa L., 1988. "Felt dispensability in groups of coactors: The effects of shared responsibility and explicit anonymity on cognitive effort," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(3), pages 330-351, June.
    9. repec:cup:judgdm:v:10:y:2015:i:2:p:130-143 is not listed on IDEAS
    10. See, Kelly E. & Morrison, Elizabeth W. & Rothman, Naomi B. & Soll, Jack B., 2011. "The detrimental effects of power on confidence, advice taking, and accuracy," Organizational Behavior and Human Decision Processes, Elsevier, vol. 116(2), pages 272-285.
    11. Anil Gaba & Ilia Tsetlin & Robert L. Winkler, 2017. "Combining Interval Forecasts," Decision Analysis, INFORMS, vol. 14(1), pages 1-20, March.
    12. Greenwood, Robin & Nagel, Stefan, 2009. "Inexperienced investors and bubbles," Journal of Financial Economics, Elsevier, vol. 93(2), pages 239-258, August.
    13. Julia A. Minson & Jennifer S. Mueller & Richard P. Larrick, 2018. "The Contingent Wisdom of Dyads: When Discussion Enhances vs. Undermines the Accuracy of Collaborative Judgments," Management Science, INFORMS, vol. 64(9), pages 4177-4192, September.
    14. Patrick R. Laughlin, 2011. "Basic Concepts In Group Problem Solving," Introductory Chapters, in: Group Problem Solving, Princeton University Press.
    15. Sniezek, Janet A. & Henry, Rebecca A., 1990. "Revision, Weighting, and commitment in consensus group judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 45(1), pages 66-84, February.
    16. Bonner, Bryan L. & Baumann, Michael R. & Dalal, Reeshad S., 2002. "The effects of member expertise on group decision-making and performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 88(2), pages 719-736, July.
    17. Shanteau, James, 1992. "Competence in experts: The role of task characteristics," Organizational Behavior and Human Decision Processes, Elsevier, vol. 53(2), pages 252-266, November.
    18. Stephen C. Hora, 2004. "Probability Judgments for Continuous Quantities: Linear Combinations and Calibration," Management Science, INFORMS, vol. 50(5), pages 597-604, May.
    19. Patrick R. Laughlin, 2011. "Group Problem Solving," Economics Books, Princeton University Press, edition 1, number 9339.
    20. Ambrus, Attila & Greiner, Ben & Pathak, Parag A., 2015. "How individual preferences are aggregated in groups: An experimental study," Journal of Public Economics, Elsevier, vol. 129(C), pages 1-13.
    21. Heath, Chip & Gonzalez, Rich, 1995. "Interaction with Others Increases Decision Confidence but Not Decision Quality: Evidence against Information Collection Views of Interactive Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 61(3), pages 305-326, March.
    22. Milch, Kerry F. & Weber, Elke U. & Appelt, Kirstin C. & Handgraaf, Michel J.J. & Krantz, David H., 2009. "From individual preference construction to group decisions: Framing effects and group processes," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(2), pages 242-255, March.
    23. Steffen Keck & Wenjie Tang, 2018. "Gender Composition and Group Confidence Judgment: The Perils of All-Male Groups," Management Science, INFORMS, vol. 64(12), pages 5877-5898, December.
    24. Sniezek, Janet A. & Henry, Rebecca A., 1989. "Accuracy and confidence in group judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(1), pages 1-28, February.
    25. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    26. Richard P. Larrick & Jack B. Soll, 2006. "Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(1), pages 111-127, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julia A. Minson & Jennifer S. Mueller & Richard P. Larrick, 2018. "The Contingent Wisdom of Dyads: When Discussion Enhances vs. Undermines the Accuracy of Collaborative Judgments," Management Science, INFORMS, vol. 64(9), pages 4177-4192, September.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Kausel, Edgar E. & Culbertson, Satoris S. & Leiva, Pedro I. & Slaughter, Jerel E. & Jackson, Alexander T., 2015. "Too arrogant for their own good? Why and when narcissists dismiss advice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 131(C), pages 33-50.
    4. Bonaccorsi, Andrea & Apreda, Riccardo & Fantoni, Gualtiero, 2020. "Expert biases in technology foresight. Why they are a problem and how to mitigate them," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    5. Boris Maciejovsky & David V. Budescu, 2020. "Too Much Trust in Group Decisions: Uncovering Hidden Profiles by Groups and Markets," Organization Science, INFORMS, vol. 31(6), pages 1497-1514, November.
    6. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    7. Bonner, Bryan L. & Bolinger, Alexander R., 2013. "Separating the confident from the correct: Leveraging member knowledge in groups to improve decision making and performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 122(2), pages 214-221.
    8. Vincenz Frey & Arnout van de Rijt, 2021. "Social Influence Undermines the Wisdom of the Crowd in Sequential Decision Making," Management Science, INFORMS, vol. 67(7), pages 4273-4286, July.
    9. Felipe A. Csaszar & J. P. Eggers, 2013. "Organizational Decision Making: An Information Aggregation View," Management Science, INFORMS, vol. 59(10), pages 2257-2277, October.
    10. Önkal, Dilek & Zeynep Sayım, K. & Lawrence, Michael, 2012. "Wisdom of group forecasts: Does role-playing play a role?," Omega, Elsevier, vol. 40(6), pages 693-702.
    11. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    12. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102, January.
    13. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
    14. von der Gracht, Heiko A. & Hommel, Ulrich & Prokesch, Tobias & Wohlenberg, Holger, 2016. "Testing weighting approaches for forecasting in a Group Wisdom Support System environment," Journal of Business Research, Elsevier, vol. 69(10), pages 4081-4094.
    15. Don A. Moore & Samuel A. Swift & Angela Minster & Barbara Mellers & Lyle Ungar & Philip Tetlock & Heather H. J. Yang & Elizabeth R. Tenney, 2017. "Confidence Calibration in a Multiyear Geopolitical Forecasting Competition," Management Science, INFORMS, vol. 63(11), pages 3552-3565, November.
    16. Alison Wood Brooks & Francesca Gino & Maurice E. Schweitzer, 2015. "Smart People Ask for (My) Advice: Seeking Advice Boosts Perceptions of Competence," Management Science, INFORMS, vol. 61(6), pages 1421-1435, June.
    17. Leiby, Justin, 2018. "The role of consultants and management prestige in management control system adoption," Accounting, Organizations and Society, Elsevier, vol. 66(C), pages 1-13.
    18. Rader, Christina A. & Soll, Jack B. & Larrick, Richard P., 2015. "Pushing away from representative advice: Advice taking, anchoring, and adjustment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 130(C), pages 26-43.
    19. Jack B. Soll & Asa B. Palley & Christina A. Rader, 2022. "The Bad Thing About Good Advice: Understanding When and How Advice Exacerbates Overconfidence," Management Science, INFORMS, vol. 68(4), pages 2949-2969, April.
    20. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4287-4309. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.