IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i10p5822-d812497.html
   My bibliography  Save this article

Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment

Author

Listed:
  • Younyoung Choi

    (Department of Psychology, Ajou University, Suwon 16499, Korea)

  • Hyunwoo Lee

    (Biohealth Convergence-Open-Sharing System, Dankook University, Cheonan 31116, Korea)

Abstract

(1) Background: A learner’s cognitive load in a learning system should be effectively addressed to provide optimal learning processing because the cognitive load explains individual learning differences. However, little empirical research has been conducted into the validation of a cognitive load measurement tool (cognitive load scale, i.e., CLS) suited to online learning systems within higher education. The purpose of this study was to evaluate the psychometric properties of the CLS in an online learning system within higher education through the framework suggested by the Standards for Educational and Psychological Testing. (2) Methods: Data from 800 learners were collected from a cyber-university in South Korea. The age of students ranged from 20 to 64. The CLS was developed, including three components: extraneous cognitive load, intrinsic cognitive load, and germane cognitive load. Then, psychometric properties of the CLS were evaluated including reliability and validity. Evidence relating to content validity, construct validity, and criterion validity were collected. The response pattern of each item was evaluated on the basis of item response theory (IRT). Cronbach’s α was computed for reliability. (3) Results: The CLS presented high internal consistency. A three-factor model with extraneous cognitive load, intrinsic cognitive load, and germane cognitive load was suggested by exploratory and confirmatory factor analysis. This three-factor model is consistent with the previous research into the cognitive load in an offline learning environment. Higher levels of the extraneous cognitive load and intrinsic cognitive load were related to lower levels of academic achievement in an online learning environment, but the germane cognitive load was not significantly positively associated with midterm exam scores, though it was significantly related to the final exam scores. IRT analysis showed that the item-fit statistics for all items were acceptable. Lastly, the measurement invariance was examined through differential item functioning analysis (DIF), with the results suggesting that the items did not contain measurement variance in terms of gender. (4) Conclusions: This validation study of the CLS in an online learning environment within higher education assesses psychometric properties and suggests that the CLS is valid and reliable with a three-factor model. There is a need for an evaluation tool to take into account the cognitive load among learners in online learning system because the characteristics of learners within higher education were varied. This CLS will help instructional/curriculum designers and educational instructors to provide more effective instructions and identify individual learning differences in an online learning environment within higher education.

Suggested Citation

  • Younyoung Choi & Hyunwoo Lee, 2022. "Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment," IJERPH, MDPI, vol. 19(10), pages 1-12, May.
    • Handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/10/5822/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/19/10/5822/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Maria-Crina Radu & Carol Schnakovszky & Eugen Herghelegiu & Vlad-Andrei Ciubotariu & Ion Cristea, 2020. "The Impact of the COVID-19 Pandemic on the Quality of Educational Process: A Student Survey," IJERPH, MDPI, vol. 17(21), pages 1-15, October.
    2. Younyoung Choi & Young Il Cho, 2020. "Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System," Sustainability, MDPI, vol. 12(19), pages 1-13, September.
    3. Juan Chaves & Antonio A. Lorca-Marín & Emilio José Delgado-Algarra, 2020. "Methodology of Specialist Physicians Training: From Traditional to e-Learning," IJERPH, MDPI, vol. 17(20), pages 1-19, October.
    4. Zhixin Zhang & Gang Xu & Jing Gao & Lu Wang & Yonghai Zhu & Zhiyong Li & Wei Zhou, 2020. "Effects of E-Learning Environment Use on Visual Function of Elementary and Middle School Students: A Two-Year Assessment—Experience from China," IJERPH, MDPI, vol. 17(5), pages 1-19, February.
    5. Melissa A. Schilling & Patricia Vidal & Robert E. Ployhart & Alexandre Marangoni, 2003. "Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve," Management Science, INFORMS, vol. 49(1), pages 39-56, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mostafa Aboulnour Salem & Abu Elnasr E. Sobaih, 2022. "ADIDAS: An Examined Approach for Enhancing Cognitive Load and Attitudes towards Synchronous Digital Learning Amid and Post COVID-19 Pandemic," IJERPH, MDPI, vol. 19(24), pages 1-16, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fumiya Tanji & Yuki Kodama, 2021. "Prevalence of Psychological Distress and Associated Factors in Nursing Students during the COVID-19 Pandemic: A Cross-Sectional Study," IJERPH, MDPI, vol. 18(19), pages 1-10, October.
    2. Eelke Wiersma, 2007. "Conditions That Shape the Learning Curve: Factors That Increase the Ability and Opportunity to Learn," Management Science, INFORMS, vol. 53(12), pages 1903-1915, December.
    3. Schilling, Melissa A. & Green, Elad, 2011. "Recombinant search and breakthrough idea generation: An analysis of high impact papers in the social sciences," Research Policy, Elsevier, vol. 40(10), pages 1321-1331.
    4. Diwas Singh KC & Bradley R. Staats, 2012. "Accumulating a Portfolio of Experience: The Effect of Focal and Related Experience on Surgeon Performance," Manufacturing & Service Operations Management, INFORMS, vol. 14(4), pages 618-633, October.
    5. Tim R. Holcomb & R. Duane Ireland & R. Michael Holmes Jr. & Michael A. Hitt, 2009. "Architecture of Entrepreneurial Learning: Exploring the Link among Heuristics, Knowledge, and Action," Entrepreneurship Theory and Practice, , vol. 33(1), pages 167-192, January.
    6. Parker, Owen N. & Mui, Rachel & Bhawe, Nachiket & Semadeni, Matthew, 2022. "Insight or ignorance: How collaborative history in a workgroup fits with project type to shape performance," Journal of Business Research, Elsevier, vol. 152(C), pages 154-167.
    7. Amit Mehra & Rajiv Dewan & Marshall Freimer, 2011. "Firms as Incubators of Open-Source Software," Information Systems Research, INFORMS, vol. 22(1), pages 22-38, March.
    8. Fioretti, Guido, 2009. "From men and machines to the organizational learning curve," MPRA Paper 19392, University Library of Munich, Germany.
    9. Sze-Sze Wong, 2004. "Distal and Local Group Learning: Performance Trade-offs and Tensions," Organization Science, INFORMS, vol. 15(6), pages 645-656, December.
    10. Robert S. Huckman & Bradley R. Staats, 2008. "Variation in Experience and Team Familiarity: Addressing the Knowledge Acquisition-Application Problem," Harvard Business School Working Papers 09-035, Harvard Business School.
    11. Fioretti, Guido, 2007. "The organizational learning curve," European Journal of Operational Research, Elsevier, vol. 177(3), pages 1375-1384, March.
    12. Jonathan R. Clark & Robert S. Huckman, 2012. "Broadening Focus: Spillovers, Complementarities, and Specialization in the Hospital Industry," Management Science, INFORMS, vol. 58(4), pages 708-722, April.
    13. Toft-Kehler, Rasmus & Wennberg, Karl & Kim, Phillip H., 2014. "Practice makes perfect: Entrepreneurial-experience curves and venture performance," Journal of Business Venturing, Elsevier, vol. 29(4), pages 453-470.
    14. Daniela Roxana Matasariu & Ludmila Lozneanu & Iuliana Elena Bujor & Alexandra Elena Cristofor & Cristina Elena Mandici & Marcel Alexandru Găină & Cristinel Ștefănescu & Vasile Lucian Boiculese & Ioana, 2023. "The Impact of the COVID-19 Pandemic on Quality Education of the Medical Young Generation," IJERPH, MDPI, vol. 20(5), pages 1-19, February.
    15. Kristina Vaarst Andersen & Karin Beukel & Beverly B. Tyler, 2021. "Learning to Litigate: the Relationship Between Past Litigation Experience and Litigation Outcomes in the Chinese Intellectual Property System," Schmalenbach Journal of Business Research, Springer, vol. 73(3), pages 479-500, December.
    16. Carolyn D. Egelman & Dennis Epple & Linda Argote & Erica R.H. Fuchs, 2013. "Learning by Doing in a Multi-Product Manufacturing Environment: Product Variety, Customizations, and Overlapping Product Generations," NBER Working Papers 19674, National Bureau of Economic Research, Inc.
    17. Antonio Malva & Stijn Kelchtermans & Bart Leten & Reinhilde Veugelers, 2015. "Basic science as a prescription for breakthrough inventions in the pharmaceutical industry," The Journal of Technology Transfer, Springer, vol. 40(4), pages 670-695, August.
    18. Martín Martín, Oscar & Chetty, Sylvie & Bai, Wensong, 2022. "Foreign market entry knowledge and international performance: The mediating role of international market selection and network capability," Journal of World Business, Elsevier, vol. 57(2).
    19. Jamal Shamsie & Michael J. Mannor, 2013. "Looking Inside the Dream Team: Probing Into the Contributions of Tacit Knowledge as an Organizational Resource," Organization Science, INFORMS, vol. 24(2), pages 513-529, April.
    20. Lee, Cheng-Yu & Wang, Ming-Chao & Huang, Yen-Chih, 2015. "The double-edged sword of technological diversity in R&D alliances: Network position and learning speed as moderators," European Management Journal, Elsevier, vol. 33(6), pages 450-461.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.