IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i4p2940-d1059535.html
   My bibliography  Save this article

A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education

Author

Listed:
  • Xinjie Deng

    (Faculty of Foreign Studies, Beijing Language and Culture University, Beijing 100083, China)

  • Zhonggen Yu

    (Faculty of Foreign Studies, Beijing Language and Culture University, Beijing 100083, China)

Abstract

The development of artificial intelligence in recent years has promoted the use of chatbot technology in sustainable education. Many studies examined the effect of chatbots on learning outcomes. However, scant studies summarized the effectiveness of chatbots in education. The aim of the study is to investigate the effect of chatbot-assisted learning on various components and how different moderator variables influenced the effectiveness. This study, through a meta-analysis, reviewed 32 empirical studies with 2201 participants published between 2010 and 2022. The results showed that chatbot technology exerted a medium-to-high effect on overall learning outcomes regardless of moderator variables, i.e., intervention duration, chatbot roles, and learning content. In terms of learning components, chatbots could significantly improve explicit reasoning, learning achievement, knowledge retention, and learning interest despite negative findings in critical thinking, learning engagement, and motivation. Future research could expand chatbot research by including different learning components.

Suggested Citation

  • Xinjie Deng & Zhonggen Yu, 2023. "A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:4:p:2940-:d:1059535
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/4/2940/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/4/2940/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ming Li & Zhonggen Yu, 2022. "Teachers’ Satisfaction, Role, and Digital Literacy during the COVID-19 Pandemic," Sustainability, MDPI, vol. 14(3), pages 1-19, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jibon Naher, 2023. "A Survey to Understand the experience of ChatGPT Usage among Engineering University Students in Bangladesh," Technium, Technium Science, vol. 15(1), pages 1-8.
    2. Carlos Cacciuttolo & Yaneth Vásquez & Deyvis Cano & Fernando Valenzuela, 2023. "Research Thesis for Undergraduate Engineering Programs in the Digitalization Era: Learning Strategies and Responsible Research Conduct Road to a University Education 4.0 Paradigm," Sustainability, MDPI, vol. 15(14), pages 1-27, July.
    3. Maria Karyotaki & Athanasios Drigas & Charalabos Skianis, 2024. "Contributions of the 9-Layered Model of Giftedness to the Development of a Conversational Agent for Healthy Ageing and Sustainable Living," Sustainability, MDPI, vol. 16(7), pages 1-18, March.
    4. Goran Bubaš & Antonela Čižmešija & Andreja Kovačić, 2023. "Development of an Assessment Scale for Measurement of Usability and User Experience Characteristics of Bing Chat Conversational AI," Future Internet, MDPI, vol. 16(1), pages 1-19, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kenneth David Strang, 2023. "How effective is business education in the workplace: structural equation model of soft and hard skill competencies," SN Business & Economics, Springer, vol. 3(1), pages 1-29, January.
    2. Xinjie Deng & Zhonggen Yu, 2022. "A Systematic Review of Machine-Translation-Assisted Language Learning for Sustainable Education," Sustainability, MDPI, vol. 14(13), pages 1-15, June.
    3. Ebrahim Navid Sadjadi, 2023. "Challenges and Opportunities for Education Systems with the Current Movement toward Digitalization at the Time of COVID-19," Mathematics, MDPI, vol. 11(2), pages 1-14, January.
    4. Frank Guerra-Reyes & Miguel Naranjo-Toro & Andrea Basantes-Andrade & Eric Guerra-Davila & Andrés Benavides-Piedra, 2023. "COVID-19, Didactic Practices, and Representations Assumed by Preservice Teachers at Universidad Técnica del Norte-Ecuador," Sustainability, MDPI, vol. 15(6), pages 1-17, March.
    5. Lourdes Vital-López & Raul García-García & Juvenal Rodríguez-Reséndíz & Willfrido Jacobo Paredes-García & Marco Antonio Zamora-Antuñano & Temidayo Oluyomi-Elufisan & Hugo Rodríguez Reséndiz & Ana Ruth, 2022. "The Impacts of COVID-19 on Technological and Polytechnic University Teachers," Sustainability, MDPI, vol. 14(8), pages 1-27, April.
    6. Sanchayan Banerjee & Beatriz Jambrina-Canseco & Benjamin Brundu-Gonzalez & Claire Gordon & Jenni Carr, 2023. "Nudge or not, university teachers have mixed feelings about online teaching," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-10, December.
    7. Niki Glaveli & Panagiotis Manolitzas & Eftychia Tsourou & Evangelos Grigoroudis, 2024. "Unlocking Teacher Job Satisfaction During the COVID-19 Pandemic: a Multi-criteria Satisfaction Analysis," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 1264-1285, March.
    8. Marcin Awdziej & Magdalena Jaciow & Marcin Lipowski & Jolanta Tkaczyk & Robert Wolny, 2023. "Students Digital Maturity and Its Implications for Sustainable Behavior," Sustainability, MDPI, vol. 15(9), pages 1-22, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:4:p:2940-:d:1059535. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.