IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i10p5822-d812497.html
   My bibliography  Save this article

Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment

Author

Listed:
  • Younyoung Choi

    (Department of Psychology, Ajou University, Suwon 16499, Korea)

  • Hyunwoo Lee

    (Biohealth Convergence-Open-Sharing System, Dankook University, Cheonan 31116, Korea)

Abstract

(1) Background: A learner’s cognitive load in a learning system should be effectively addressed to provide optimal learning processing because the cognitive load explains individual learning differences. However, little empirical research has been conducted into the validation of a cognitive load measurement tool (cognitive load scale, i.e., CLS) suited to online learning systems within higher education. The purpose of this study was to evaluate the psychometric properties of the CLS in an online learning system within higher education through the framework suggested by the Standards for Educational and Psychological Testing. (2) Methods: Data from 800 learners were collected from a cyber-university in South Korea. The age of students ranged from 20 to 64. The CLS was developed, including three components: extraneous cognitive load, intrinsic cognitive load, and germane cognitive load. Then, psychometric properties of the CLS were evaluated including reliability and validity. Evidence relating to content validity, construct validity, and criterion validity were collected. The response pattern of each item was evaluated on the basis of item response theory (IRT). Cronbach’s α was computed for reliability. (3) Results: The CLS presented high internal consistency. A three-factor model with extraneous cognitive load, intrinsic cognitive load, and germane cognitive load was suggested by exploratory and confirmatory factor analysis. This three-factor model is consistent with the previous research into the cognitive load in an offline learning environment. Higher levels of the extraneous cognitive load and intrinsic cognitive load were related to lower levels of academic achievement in an online learning environment, but the germane cognitive load was not significantly positively associated with midterm exam scores, though it was significantly related to the final exam scores. IRT analysis showed that the item-fit statistics for all items were acceptable. Lastly, the measurement invariance was examined through differential item functioning analysis (DIF), with the results suggesting that the items did not contain measurement variance in terms of gender. (4) Conclusions: This validation study of the CLS in an online learning environment within higher education assesses psychometric properties and suggests that the CLS is valid and reliable with a three-factor model. There is a need for an evaluation tool to take into account the cognitive load among learners in online learning system because the characteristics of learners within higher education were varied. This CLS will help instructional/curriculum designers and educational instructors to provide more effective instructions and identify individual learning differences in an online learning environment within higher education.

Suggested Citation

  • Younyoung Choi & Hyunwoo Lee, 2022. "Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment," IJERPH, MDPI, vol. 19(10), pages 1-12, May.
    • Handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/10/5822/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/19/10/5822/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Maria-Crina Radu & Carol Schnakovszky & Eugen Herghelegiu & Vlad-Andrei Ciubotariu & Ion Cristea, 2020. "The Impact of the COVID-19 Pandemic on the Quality of Educational Process: A Student Survey," IJERPH, MDPI, vol. 17(21), pages 1-15, October.
    2. Juan Chaves & Antonio A. Lorca-Marín & Emilio José Delgado-Algarra, 2020. "Methodology of Specialist Physicians Training: From Traditional to e-Learning," IJERPH, MDPI, vol. 17(20), pages 1-19, October.
    3. Melissa A. Schilling & Patricia Vidal & Robert E. Ployhart & Alexandre Marangoni, 2003. "Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve," Management Science, INFORMS, vol. 49(1), pages 39-56, January.
    4. Younyoung Choi & Young Il Cho, 2020. "Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System," Sustainability, MDPI, vol. 12(19), pages 1-13, September.
    5. Zhixin Zhang & Gang Xu & Jing Gao & Lu Wang & Yonghai Zhu & Zhiyong Li & Wei Zhou, 2020. "Effects of E-Learning Environment Use on Visual Function of Elementary and Middle School Students: A Two-Year Assessment—Experience from China," IJERPH, MDPI, vol. 17(5), pages 1-19, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mostafa Aboulnour Salem & Abu Elnasr E. Sobaih, 2022. "ADIDAS: An Examined Approach for Enhancing Cognitive Load and Attitudes towards Synchronous Digital Learning Amid and Post COVID-19 Pandemic," IJERPH, MDPI, vol. 19(24), pages 1-16, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fumiya Tanji & Yuki Kodama, 2021. "Prevalence of Psychological Distress and Associated Factors in Nursing Students during the COVID-19 Pandemic: A Cross-Sectional Study," IJERPH, MDPI, vol. 18(19), pages 1-10, October.
    2. Eelke Wiersma, 2007. "Conditions That Shape the Learning Curve: Factors That Increase the Ability and Opportunity to Learn," Management Science, INFORMS, vol. 53(12), pages 1903-1915, December.
    3. Schilling, Melissa A. & Green, Elad, 2011. "Recombinant search and breakthrough idea generation: An analysis of high impact papers in the social sciences," Research Policy, Elsevier, vol. 40(10), pages 1321-1331.
    4. Diwas Singh KC & Bradley R. Staats, 2012. "Accumulating a Portfolio of Experience: The Effect of Focal and Related Experience on Surgeon Performance," Manufacturing & Service Operations Management, INFORMS, vol. 14(4), pages 618-633, October.
    5. Parker, Owen N. & Mui, Rachel & Bhawe, Nachiket & Semadeni, Matthew, 2022. "Insight or ignorance: How collaborative history in a workgroup fits with project type to shape performance," Journal of Business Research, Elsevier, vol. 152(C), pages 154-167.
    6. Fioretti, Guido, 2009. "From men and machines to the organizational learning curve," MPRA Paper 19392, University Library of Munich, Germany.
    7. Sze-Sze Wong, 2004. "Distal and Local Group Learning: Performance Trade-offs and Tensions," Organization Science, INFORMS, vol. 15(6), pages 645-656, December.
    8. Jonathan R. Clark & Robert S. Huckman, 2012. "Broadening Focus: Spillovers, Complementarities, and Specialization in the Hospital Industry," Management Science, INFORMS, vol. 58(4), pages 708-722, April.
    9. Carolyn D. Egelman & Dennis Epple & Linda Argote & Erica R.H. Fuchs, 2013. "Learning by Doing in a Multi-Product Manufacturing Environment: Product Variety, Customizations, and Overlapping Product Generations," NBER Working Papers 19674, National Bureau of Economic Research, Inc.
    10. Lee, Cheng-Yu & Wang, Ming-Chao & Huang, Yen-Chih, 2015. "The double-edged sword of technological diversity in R&D alliances: Network position and learning speed as moderators," European Management Journal, Elsevier, vol. 33(6), pages 450-461.
    11. Shu-Mei Liu & Fong-Ching Chang & Cheng-Yu Chen & Shu-Fang Shih & Bo Meng & Eric Ng & Chia-Hsuan Hsu & Yi-Te Chiang & Xiao-Jie Mao & Ming-Yan Yi & Ben LePage & Wei-Ta Fang, 2021. "Effects of Parental Involvement in a Preschool-Based Eye Health Intervention Regarding Children’s Screen Use in China," IJERPH, MDPI, vol. 18(21), pages 1-14, October.
    12. Wang, Xuequn & Lin, Xiaolin & Spencer, Marilyn K., 2019. "Exploring the effects of extrinsic motivation on consumer behaviors in social commerce: Revealing consumers’ perceptions of social commerce benefits," International Journal of Information Management, Elsevier, vol. 45(C), pages 163-175.
    13. Julian Pineres Ramirez, 2015. "A learning-capacity framework: knowledge reconfiguration and knowledge orientation," Working Papers 4, Faculty of Economics and Management, Pontificia Universidad Javeriana Cali.
    14. June-Young Kim & Ji-Yub (Jay) Kim & Anne S. Miner, 2009. "Organizational Learning from Extreme Performance Experience: The Impact of Success and Recovery Experience," Organization Science, INFORMS, vol. 20(6), pages 958-978, December.
    15. Shao, Shuai & Yang, Zhenbing & Xu, Le & Yang, Lili, 2024. "Environmental protection experience of secretaries and effectiveness of environmental governance: Evidence from COD discharge in China," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 237-253.
    16. Luv Sharma & Aravind Chandrasekaran & Elliot Bendoly, 2020. "Does the Office of Patient Experience Matter in Improving Delivery of Care?," Production and Operations Management, Production and Operations Management Society, vol. 29(4), pages 833-855, April.
    17. Lettl, Christopher & Rost, Katja & von Wartburg, Iwan, 2009. "Why are some independent inventors 'heroes' and others 'hobbyists'? The moderating role of technological diversity and specialization," Research Policy, Elsevier, vol. 38(2), pages 243-254, March.
    18. Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2013. "Learning from Customers: Individual and Organizational Effects in Outsourced Radiological Services," Organization Science, INFORMS, vol. 24(5), pages 1539-1557, October.
    19. Buckley, Peter J. & Craig, Thomas D. & Mudambi, Ram, 2019. "Time to learn? Assignment duration in global value chain organization," Journal of Business Research, Elsevier, vol. 103(C), pages 508-518.
    20. Laurence Capron, 2016. "Strategies for M&As: when is acquisition the right mode to grow?," Accounting and Business Research, Taylor & Francis Journals, vol. 46(5), pages 453-462, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:10:p:5822-:d:812497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.