IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v34y2023i2p487-507.html
   My bibliography  Save this article

Augmenting Social Bot Detection with Crowd-Generated Labels

Author

Listed:
  • Victor Benjamin

    (Department of Information Systems, Arizona State University, Tempe, Arizona 85287)

  • T. S. Raghu

    (Department of Information Systems, Arizona State University, Tempe, Arizona 85287)

Abstract

Social media platforms are facing increasing numbers of cyber-adversaries seeking to manipulate online discourse by using social bots (i.e., social media software robots) to help automate and scale their attacks. Likewise, some social media users can identify social bot activity at varying degrees of confidence. In this research, human reactions to social bot messages are used to augment existing social bot detection capabilities. Speech act theory is used to inspire a framework for assessing the credibility of instances where users identify potential bot activity, as not all user responses are of equal credibility for assisting with the bot detection task. The framework is then operationalized through deep learning methodologies to develop a computational system for identifying social bots. Real-world performance and practicality of the developed framework is demonstrated on a live, crowd-sourced data set collected from a real-world social media platform. Results show that consideration of crowd reactions to suspected bots can significantly improve bot detection performance. Furthermore, consideration of speech acts to evaluate crowd reactions can even further augment the system’s performance, although speech acts themselves are not necessary to observe performance boost through crowd intelligence. This study serves as a grounding point for future work that can explore an augmented model for detecting other forms of algorithmically generated content within social media platforms.

Suggested Citation

  • Victor Benjamin & T. S. Raghu, 2023. "Augmenting Social Bot Detection with Crowd-Generated Labels," Information Systems Research, INFORMS, vol. 34(2), pages 487-507, June.
    • Handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:487-507
    DOI: 10.1287/isre.2022.1136
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.1136
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2022.1136?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ritu Agarwal & Vasant Dhar, 2014. "Editorial —Big Data, Data Science, and Analytics: The Opportunity and Challenge for IS Research," Information Systems Research, INFORMS, vol. 25(3), pages 443-448, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raeesi, Ramin & Sahebjamnia, Navid & Mansouri, S. Afshin, 2023. "The synergistic effect of operational research and big data analytics in greening container terminal operations: A review and future directions," European Journal of Operational Research, Elsevier, vol. 310(3), pages 943-973.
    2. Jinyang Zheng & Zhengling Qi & Yifan Dou & Yong Tan, 2019. "How Mega Is the Mega? Exploring the Spillover Effects of WeChat Using Graphical Model," Information Systems Research, INFORMS, vol. 30(4), pages 1343-1362, December.
    3. Canhoto, Ana Isabel & Clear, Fintan, 2020. "Artificial intelligence and machine learning as business tools: A framework for diagnosing value destruction potential," Business Horizons, Elsevier, vol. 63(2), pages 183-193.
    4. Shahriar Akter & Samuel Fosso Wamba, 2019. "Big data and disaster management: a systematic review and agenda for future research," Annals of Operations Research, Springer, vol. 283(1), pages 939-959, December.
    5. Issam Laguir & Sachin Modgil & Indranil Bose & Shivam Gupta & Rebecca Stekelorum, 2023. "Performance effects of analytics capability, disruption orientation, and resilience in the supply chain under environmental uncertainty," Annals of Operations Research, Springer, vol. 324(1), pages 1269-1293, May.
    6. Hajer Kefi & Sitesh Indra & Talel Abdessalem, 2016. "Social media marketing analytics : a multicultural approach applied to the beauty & cosmetic sector," Post-Print hal-01456580, HAL.
    7. Ahmed Abbasi & Jingjing Li & Donald Adjeroh & Marie Abate & Wanhong Zheng, 2019. "Don’t Mention It? Analyzing User-Generated Content Signals for Early Adverse Event Warnings," Information Systems Research, INFORMS, vol. 30(3), pages 1007-1028, September.
    8. Lamperti, Fabio, 2024. "Unlocking machine learning for social sciences: The case for identifying Industry 4.0 adoption across business restructuring events," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    9. Godé, Cécile & Brion, Sébastien, 2024. "The affordance-actualization process of predictive analytics: Towards a configurational framework of a predictive policing system," Technological Forecasting and Social Change, Elsevier, vol. 204(C).
    10. Patrick Mikalef & Ilias O. Pappas & John Krogstie & Michail Giannakos, 2018. "Big data analytics capabilities: a systematic literature review and research agenda," Information Systems and e-Business Management, Springer, vol. 16(3), pages 547-578, August.
    11. Luvai Motiwalla & Amit V. Deokar & Surendra Sarnikar & Angelika Dimoka, 2019. "Leveraging Data Analytics for Behavioral Research," Information Systems Frontiers, Springer, vol. 21(4), pages 735-742, August.
    12. Chatterjee, Sheshadri & Chaudhuri, Ranjan & Gupta, Shivam & Sivarajah, Uthayasankar & Bag, Surajit, 2023. "Assessing the impact of big data analytics on decision-making processes, forecasting, and performance of a firm," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    13. Abhishek Behl & Pankaj Dutta & Stefan Lessmann & Yogesh K. Dwivedi & Samarjit Kar, 2019. "A conceptual framework for the adoption of big data analytics by e-commerce startups: a case-based approach," Information Systems and e-Business Management, Springer, vol. 17(2), pages 285-318, December.
    14. Shivam Gupta & Nezih Altay & Zongwei Luo, 2019. "Big data in humanitarian supply chain management: a review and further research directions," Annals of Operations Research, Springer, vol. 283(1), pages 1153-1173, December.
    15. Morgan Swink & Kejia Hu & Xiande Zhao, 2022. "Analytics applications, limitations, and opportunities in restaurant supply chains," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3710-3726, October.
    16. Jean-Sébastien Lacam & David Salvetat, 2021. "Big data and Smart data: two interdependent and synergistic digital policies within a virtuous data exploitation loop," Post-Print hal-03434863, HAL.
    17. Shet, Sateesh.V. & Poddar, Tanuj & Wamba Samuel, Fosso & Dwivedi, Yogesh K., 2021. "Examining the determinants of successful adoption of data analytics in human resource management – A framework for implications," Journal of Business Research, Elsevier, vol. 131(C), pages 311-326.
    18. Shu-Yi Liaw & Thi Mai Le, 2017. "Comparing Mediation Effect of Functional and Emotional Value in the Relationship between Pros of Applying Big Data," International Journal of Marketing Studies, Canadian Center of Science and Education, vol. 9(4), pages 66-75, August.
    19. Plamen Yankov & Stefka Petrova & Svetlana Todorova, 2021. "Digital Advantages for the Construction Industry," Izvestia Journal of the Union of Scientists - Varna. Economic Sciences Series, Union of Scientists - Varna, Economic Sciences Section, vol. 10(3), pages 21-32, December.
    20. Zhang, Yucheng & Zhang, Meng & Li, Jing & Liu, Guangjian & Yang, Miles M. & Liu, Siqi, 2021. "A bibliometric review of a decade of research: Big data in business research – Setting a research agenda," Journal of Business Research, Elsevier, vol. 131(C), pages 374-390.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:487-507. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.