IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i2p559-d1565598.html
   My bibliography  Save this article

The Role of Learning Analytics in Evaluating Course Effectiveness

Author

Listed:
  • Billy T. M. Wong

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

  • Kam Cheong Li

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

  • Mengjin Liu

    (Institute for Research in Open and Innovative Education, Hong Kong Metropolitan University, Homantin, Kowloon, Hong Kong, China)

Abstract

This study aims to examine the use of learning analytics in course evaluation within higher education institutions, in order to identify effective methodologies and best practices for leveraging data to improve educational effectiveness. Following the PRISMA guidelines, a systematic literature search was conducted in Scopus, yielding 34 relevant studies published between 2015 and 2024 for analysis. The results reveal six key categories of learning analytics applications: sentiment analysis, questionnaire analysis, engagement analysis, topic classification, predictive modelling, and performance analysis. The data sources for learning analytics applications primarily include questionnaires and learning management systems. While descriptive analysis was found to be the most commonly employed analytical technique, advanced techniques such as machine learning, artificial intelligence, and social network analysis are becoming more prominent. The studies addressed a wide range of elements associated with course evaluation, including course design, content quality, assignments, instructional strategies, workload, feedback mechanisms, and the integration of technology. These findings highlight the importance of adopting holistic approaches to capture the multifaceted nature of student experiences. This study also uncovers major limitations in the existing research, such as small sample sizes, potential biases due to the use of survey-based methods, and challenges in generalising findings across disciplines. These insights underscore the need for further research to enhance the methodologies used in course evaluations. This study contributes to advancing learning analytics practices and emphasises the importance of innovative approaches for evaluating and improving course effectiveness.

Suggested Citation

  • Billy T. M. Wong & Kam Cheong Li & Mengjin Liu, 2025. "The Role of Learning Analytics in Evaluating Course Effectiveness," Sustainability, MDPI, vol. 17(2), pages 1-22, January.
    • Handle: RePEc:gam:jsusta:v:17:y:2025:i:2:p:559-:d:1565598
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/2/559/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/17/2/559/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Mongeon & Adèle Paul-Hus, 2016. "The journal coverage of Web of Science and Scopus: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 213-228, January.
    2. Billy T. M. Wong & Kam Cheong Li & Hon Tung Chan & Simon K. S. Cheung, 2023. "HyFlex Learning Research and Practice: A Longitudinal Analysis," Sustainability, MDPI, vol. 15(12), pages 1-18, June.
    3. Rosemary J. Avery & W. Keith Bryant & Alan Mathios & Hyojin Kang & Duncan Bell, 2006. "Electronic Course Evaluations: Does an Online Delivery System Influence Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 21-37, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tripathy, Prajukta & Jena, Pabitra Kumar & Mishra, Bikash Ranjan, 2024. "Systematic literature review and bibliometric analysis of energy efficiency," Renewable and Sustainable Energy Reviews, Elsevier, vol. 200(C).
    2. Maribel Vega-Arce & Gonzalo Salas & Gastón Núñez-Ulloa & Cristián Pinto-Cortez & Ivelisse Torres Fernandez & Yuh-Shan Ho, 2019. "Research performance and trends in child sexual abuse research: a Science Citation Index Expanded-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1505-1525, December.
    3. Antonio-José Moreno-Guerrero & María Elena Parra-González & Jesús López-Belmonte & Adrián Segura-Robles, 2022. "Science mapping analysis of “cultural” in web of science (1908–2019)," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(1), pages 239-257, February.
    4. Adela Toscano-Valle & Antonio Sianes & Francisco Santos-Carrillo & Luis A. Fernández-Portillo, 2022. "Can the Rational Design of International Institutions Solve Cooperation Problems? Insights from a Systematic Literature Review," Sustainability, MDPI, vol. 14(13), pages 1-22, June.
    5. Serhat Burmaoglu & Ozcan Saritas, 2019. "An evolutionary analysis of the innovation policy domain: Is there a paradigm shift?," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 823-847, March.
    6. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    7. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    8. Vanessa Sandoval-Romero & Vincent Larivière, 2020. "The national system of researchers in Mexico: implications of publication incentives for researchers in social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 99-126, January.
    9. Vivek Kumar Singh & Prashasti Singh & Mousumi Karmakar & Jacqueline Leta & Philipp Mayr, 2021. "The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5113-5142, June.
    10. Mike Thelwall, 2020. "Mid-career field switches reduce gender disparities in academic publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1365-1383, June.
    11. Patricia de Oliveira Melo & Renata Marques Britto & Tharcisio Cotta Fontainha & Adriana Leiras & Renata Albergaria de Mello Bandeira, 2017. "Evaluation of community leaders’ perception regarding Alerta Rio, the warning system for landslides caused by heavy rains in Rio de Janeiro," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 89(3), pages 1343-1368, December.
    12. Nasrabadi, Mohamadreza Azar & Beauregard, Yvan & Ekhlassi, Amir, 2024. "The implication of user-generated content in new product development process: A systematic literature review and future research agenda," Technological Forecasting and Social Change, Elsevier, vol. 206(C).
    13. Stephen B. DeLoach, 2011. "What Every Economist Should Know About the Evaluation of Teaching: A Review of the Literature," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 34, Edward Elgar Publishing.
    14. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    15. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    16. repec:hal:cepnwp:hal-01922266 is not listed on IDEAS
    17. Théodore Nikiema & Eugène C. Ezin & Sylvain Kpenavoun Chogou, 2023. "Bibliometric Analysis of the State of Research on Agroecology Adoption and Methods Used for Its Assessment," Sustainability, MDPI, vol. 15(21), pages 1-18, November.
    18. Esther Salmerón-Manzano & Francisco Manzano-Agugliaro, 2018. "The Higher Education Sustainability through Virtual Laboratories: The Spanish University as Case of Study," Sustainability, MDPI, vol. 10(11), pages 1-22, November.
    19. Ignacio Rodríguez-Rodríguez & José-Víctor Rodríguez & Niloofar Shirvanizadeh & Andrés Ortiz & Domingo-Javier Pardo-Quiles, 2021. "Applications of Artificial Intelligence, Machine Learning, Big Data and the Internet of Things to the COVID-19 Pandemic: A Scientometric Review Using Text Mining," IJERPH, MDPI, vol. 18(16), pages 1-29, August.
    20. Maurer, Moritz, 2025. "Wild Experiments? Restricting Narratives in Research on Alternative Food and Agriculture Networks," OSF Preprints u2tyv, Center for Open Science.
    21. Manuel Sánchez-Pérez & Nuria Rueda-López & María Belén Marín-Carrillo & Eduardo Terán-Yépez, 2021. "Theoretical dilemmas, conceptual review and perspectives disclosure of the sharing economy: a qualitative analysis," Review of Managerial Science, Springer, vol. 15(7), pages 1849-1883, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:2:p:559-:d:1565598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.