IDEAS home Printed from https://ideas.repec.org/a/spr/grdene/v33y2024i5d10.1007_s10726-024-09894-w.html
   My bibliography  Save this article

Advancing Content Synthesis in Macro-Task Crowdsourcing Facilitation Leveraging Natural Language Processing

Author

Listed:
  • Henner Gimpel

    (FIM Research Center for Information Management
    Digital Management
    Branch Business & Information Systems Engineering)

  • Robert Laubacher

    (Massachusetts Institute of Technology (MIT))

  • Oliver Meindl

    (FIM Research Center for Information Management
    Digital Management
    Branch Business & Information Systems Engineering)

  • Moritz Wöhl

    (FIM Research Center for Information Management
    Branch Business & Information Systems Engineering
    University of Augsburg)

  • Luca Dombetzki

    (TUM.ai)

Abstract

Macro-task crowdsourcing presents a promising approach to address wicked problems like climate change by leveraging the collective efforts of a diverse crowd. Such macro-task crowdsourcing requires facilitation. However, in the facilitation process, traditionally aggregating and synthesizing text contributions from the crowd is labor-intensive, demanding expertise and time from facilitators. Recent advancements in large language models (LLMs) have demonstrated human-level performance in natural language processing. This paper proposes an abstract design for an information system, developed through four iterations of a prototype, to support the synthesis process of contributions using LLM-based natural language processing. The prototype demonstrated promising results, enhancing efficiency and effectiveness in synthesis activities for macro-task crowdsourcing facilitation. By streamlining the synthesis process, the proposed system significantly reduces the effort to synthesize content, allowing for stronger integration of synthesized content into the discussions to reach consensus, ideally leading to more meaningful outcomes.

Suggested Citation

  • Henner Gimpel & Robert Laubacher & Oliver Meindl & Moritz Wöhl & Luca Dombetzki, 2024. "Advancing Content Synthesis in Macro-Task Crowdsourcing Facilitation Leveraging Natural Language Processing," Group Decision and Negotiation, Springer, vol. 33(5), pages 1301-1322, October.
    • Handle: RePEc:spr:grdene:v:33:y:2024:i:5:d:10.1007_s10726-024-09894-w
    DOI: 10.1007/s10726-024-09894-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10726-024-09894-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10726-024-09894-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Aida Azadegan & Gwendolyn Kolfschoten, 2014. "An Assessment Framework for Practicing Facilitator," Group Decision and Negotiation, Springer, vol. 23(5), pages 1013-1045, September.
    2. L. Alberto Franco & Mie Femø Nielsen, 2018. "Examining Group Facilitation In Situ: The Use of Formulations in Facilitation Practice," Group Decision and Negotiation, Springer, vol. 27(5), pages 735-756, October.
    3. Ken Peffers & Tuure Tuunanen & Björn Niehaves, 2018. "Design science research genres: introduction to the special issue on exemplars and criteria for applicable design science research," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(2), pages 129-139, March.
    4. Lieselot Danneels & Stijn Viaene, 2022. "Identifying Digital Transformation Paradoxes," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(4), pages 483-500, August.
    5. Terri L. Griffith & Mark A. Fuller & Gregory B. Northcraft, 1998. "Facilitator Influence in Group Support Systems: Intended and Unintended Effects," Information Systems Research, INFORMS, vol. 9(1), pages 20-36, March.
    6. A. Adla & P. Zarate & J.-L. Soubie, 2011. "A Proposal of Toolkit for GDSS Facilitators," Group Decision and Negotiation, Springer, vol. 20(1), pages 57-77, January.
    7. Geoffrey Barbier & Reza Zafarani & Huiji Gao & Gabriel Fung & Huan Liu, 2012. "Maximizing benefits from crowdsourced data," Computational and Mathematical Organization Theory, Springer, vol. 18(3), pages 257-279, September.
    8. Mohamed Khalifa & RonChi-Wai Kwok & Robert Davison, 2002. "The Effects of Process and Content Facilitation Restrictiveness on GSS-Mediated Collaborative Learning," Group Decision and Negotiation, Springer, vol. 11(5), pages 345-361, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henner Gimpel & Vanessa Graf-Seyfried & Robert Laubacher & Oliver Meindl, 2023. "Towards Artificial Intelligence Augmenting Facilitation: AI Affordances in Macro-Task Crowdsourcing," Group Decision and Negotiation, Springer, vol. 32(1), pages 75-124, February.
    2. Aida Azadegan & Gwendolyn Kolfschoten, 2014. "An Assessment Framework for Practicing Facilitator," Group Decision and Negotiation, Springer, vol. 23(5), pages 1013-1045, September.
    3. Maggie Wang, Yazhu & Matook, Sabine & Dennis, Alan R., 2024. "Unintended consequences of humanoid service robots: A case study of public service organizations," Journal of Business Research, Elsevier, vol. 174(C).
    4. Younès El Manzani & Mohamed Larbi Sidmou & Jean-Jack Cegarra, 2018. "Does IS0 9001 quality management system support product innovation? An analysis from the sociotechnical systems theory," Post-Print hal-03080217, HAL.
    5. Amer Al Shishany & Radwan Kharabsheh & Waed Elnsour & Jackson Adams, 2017. "The Future of Group Decision Support System Supported Meetings: Perceiving the Value and the Need for Competitive Strategies," International Review of Management and Marketing, Econjournals, vol. 7(2), pages 263-271.
    6. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    7. Igor Melnykov & Volodymyr Melnykov, 2020. "A Note on the Formal Implementation of the K-means Algorithm with Hard Positive and Negative Constraints," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 789-809, October.
    8. Richard Ormerod, 2024. "Pragmatism as practice theory: The experience of systems and OR scholars," Systems Research and Behavioral Science, Wiley Blackwell, vol. 41(1), pages 52-81, January.
    9. Nici Zimmermann & Katherine Curran, 2023. "Dynamics of interdisciplinarity: a microlevel analysis of communication and facilitation in a group model‐building workshop," System Dynamics Review, System Dynamics Society, vol. 39(4), pages 336-370, October.
    10. Roberto Osorno-Hinojosa & Mikko Koria & Delia del Carmen Ramírez-Vázquez & Gabriela Calvario, 2023. "Designing Platforms for Micro and Small Enterprises in Emerging Economies: Sharing Value through Open Innovation," Sustainability, MDPI, vol. 15(14), pages 1-17, July.
    11. Jorge E. Hernández & Josefa Mula & Raúl Poler & Andrew C. Lyons, 2014. "Collaborative Planning in Multi-tier Supply Chains Supported by a Negotiation-Based Mechanism and Multi-agent System," Group Decision and Negotiation, Springer, vol. 23(2), pages 235-269, March.
    12. Lionel P. Robert Jr & Alan R. Dennis & Manju K. Ahuja, 2018. "Differences are Different: Examining the Effects of Communication Media on the Impacts of Racial and Gender Diversity in Decision-Making Teams," Information Systems Research, INFORMS, vol. 29(3), pages 525-545, September.
    13. Rens Kortmann & Vincent Peters, 2021. "Becoming the Unseen Helmsman - Game facilitator competencies for novice, experienced, and non-game facilitators," Simulation & Gaming, , vol. 52(3), pages 255-272, June.
    14. Gilberto Montibeller & L. Alberto Franco & Ashley Carreras, 2020. "A Risk Analysis Framework for Prioritizing and Managing Biosecurity Threats," Risk Analysis, John Wiley & Sons, vol. 40(11), pages 2462-2477, November.
    15. Irene Pluchinotta & Akin O. Kazakçi & Raffaele Giordano & Alexis Tsoukiàs, 2019. "Design Theory for Generating Alternatives in Public Decision Making Processes," Group Decision and Negotiation, Springer, vol. 28(2), pages 341-375, April.
    16. Ormerod, Richard & Yearworth, Mike & White, Leroy, 2023. "Understanding participant actions in OR interventions using practice theories: A research agenda," European Journal of Operational Research, Elsevier, vol. 306(2), pages 810-827.
    17. Jorge Velez-Castiblanco & Diana Londono-Correa & Olandy Naranjo-Rivera, 2018. "The Structure of Problem Structuring Conversations: A Boundary Games Approach," Group Decision and Negotiation, Springer, vol. 27(5), pages 853-884, October.
    18. Choon-Ling Sia & Bernard C. Y. Tan & Kwok-Kee Wei, 2002. "Group Polarization and Computer-Mediated Communication: Effects of Communication Cues, Social Presence, and Anonymity," Information Systems Research, INFORMS, vol. 13(1), pages 70-90, March.
    19. Franco, L. Alberto & Hämäläinen, Raimo P. & Rouwette, Etiënne A.J.A. & Leppänen, Ilkka, 2021. "Taking stock of behavioural OR: A review of behavioural studies with an intervention focus," European Journal of Operational Research, Elsevier, vol. 293(2), pages 401-418.
    20. A. Adla & P. Zarate & J.-L. Soubie, 2011. "A Proposal of Toolkit for GDSS Facilitators," Group Decision and Negotiation, Springer, vol. 20(1), pages 57-77, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:grdene:v:33:y:2024:i:5:d:10.1007_s10726-024-09894-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.