IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i16p12253-d1214788.html
   My bibliography  Save this article

An Expert-Opinion-Based Evaluation Framework for Sustainable Technology-Enhanced Learning Using Z-Numbers and Fuzzy Logarithm Methodology of Additive Weights

Author

Listed:
  • Anđelka Štilić

    (The College of Tourism, Academy of Applied Studies Belgrade, Bulevar Zorana Ðindića 152a, 11070 Belgrade, Serbia)

  • Edisa Puška

    (Ninth Primary School, Department of Education, Government of Brčko District of Bosnia and Herzegovina, Maoča bb., 76100 Brčko, Bosnia and Herzegovina)

  • Adis Puška

    (Department of Public Safety, Government of Brčko District of Bosnia and Herzegovina, Bulevara Mira 1, 76100 Brčko, Bosnia and Herzegovina)

  • Darko Božanić

    (Military Academy, University of Defence in Belgrade, Veljka Lukica Kurjaka 33, 11000 Belgrade, Serbia)

Abstract

As technology continues to shape the landscape of education, the need for effective evaluation frameworks for sustainable technology-enhanced learning (TEL) becomes increasingly vital. This study presents an expert-opinion-based evaluation framework, utilizing Z-numbers and the fuzzy logarithm methodology of additive weights (LMAW), to assess the sustainability of TEL approaches. This framework focuses on four main criteria: cloud services compliance, cloud M-Learning essentials, system and technological advancement, and organizations management readiness. Additionally, it incorporates 17 sub-criteria to provide a comprehensive evaluation of the system. Drawing on the expertise of subject matter specialists, the evaluation framework utilizes Z-numbers to account for the inherent uncertainty and imprecision in expert judgments. The fuzzy LMAW is applied to calculate the overall scores for each criterion and sub-criterion, enabling a quantitative measure of their importance in the evaluation process. The findings of this study will contribute to the development of a robust and scientifically rigorous evaluation framework for sustainable TEL. By incorporating expert opinions and employing Z-LMAW, decision-makers and stakeholders can objectively assess the sustainability of TEL systems. This framework holds promise for informing the design and implementation of strategies to enhance the quality, compliance, and technological advancements in TEL environments.

Suggested Citation

  • Anđelka Štilić & Edisa Puška & Adis Puška & Darko Božanić, 2023. "An Expert-Opinion-Based Evaluation Framework for Sustainable Technology-Enhanced Learning Using Z-Numbers and Fuzzy Logarithm Methodology of Additive Weights," Sustainability, MDPI, vol. 15(16), pages 1-18, August.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:16:p:12253-:d:1214788
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/16/12253/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/16/12253/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Valentin Kuleto & Milena Ilić & Mihail Dumangiu & Marko Ranković & Oliva M. D. Martins & Dan Păun & Larisa Mihoreanu, 2021. "Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions," Sustainability, MDPI, vol. 13(18), pages 1-16, September.
    2. Linda Daniela & Anna Visvizi & Calixto Gutiérrez-Braojos & Miltiadis D. Lytras, 2018. "Sustainable Higher Education and Technology-Enhanced Learning (TEL)," Sustainability, MDPI, vol. 10(11), pages 1-22, October.
    3. María Soledad Ramírez-Montoya & Lucy Andrade-Vargas & Diana Rivera-Rogel & May Portuguez-Castro, 2021. "Trends for the Future of Education Programs for Professional Development," Sustainability, MDPI, vol. 13(13), pages 1-17, June.
    4. Quadri Noorulhasan Naveed & Adel Ibrahim Qahmash & Mohamed Rafik N. Qureshi & Naim Ahmad & Mohammed Aref Abdul Rasheed & Md Akhtaruzzaman, 2023. "Analyzing Critical Success Factors for Sustainable Cloud-Based Mobile Learning (CBML) in Crisp and Fuzzy Environment," Sustainability, MDPI, vol. 15(2), pages 1-19, January.
    5. May Portuguez Castro & Marcela Georgina Gómez Zermeño, 2020. "Challenge Based Learning: Innovative Pedagogy for Sustainability through e-Learning in Higher Education," Sustainability, MDPI, vol. 12(10), pages 1-15, May.
    6. Javier Orozco-Messana & Juan Miguel Martínez-Rubio & Ana Maria Gonzálvez-Pons, 2020. "Sustainable Higher Education Development through Technology Enhanced Learning," Sustainability, MDPI, vol. 12(9), pages 1-13, April.
    7. United Nations UN, 2015. "Transforming our World: the 2030 Agenda for Sustainable Development," Working Papers id:7559, eSocialSciences.
    8. Elias G. Carayannis & Joanna Morawska-Jancelewicz, 2022. "The Futures of Europe: Society 5.0 and Industry 5.0 as Driving Forces of Future Universities," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(4), pages 3445-3471, December.
    9. Gwo-Jen Hwang & Yun-Fang Tu, 2021. "Roles and Research Trends of Artificial Intelligence in Mathematics Education: A Bibliometric Mapping Analysis and Systematic Review," Mathematics, MDPI, vol. 9(6), pages 1-19, March.
    10. Chiara Magrini & Jana Nicolas & Holger Berg & Alberto Bellini & Enrico Paolini & Nazarena Vincenti & Luca Campadello & Alessandra Bonoli, 2021. "Using Internet of Things and Distributed Ledger Technology for Digital Circular Economy Enablement: The Case of Electronic Equipment," Sustainability, MDPI, vol. 13(9), pages 1-19, April.
    11. Nawab Khan & Ram L. Ray & Hazem S. Kassem & Sajjad Hussain & Shemei Zhang & Muhammad Khayyam & Muhammad Ihtisham & Simplice A. Asongu, 2021. "Potential Role of Technology Innovation in Transformation of Sustainable Food Systems: A Review," Agriculture, MDPI, vol. 11(10), pages 1-20, October.
    12. Hezekiah O. Falola & Opeyemi O. Ogueyungbo & Anthonia A. Adeniji & Evaristus Adesina, 2022. "Exploring Sustainable E-Learning Platforms for Improved Universities’ Faculty Engagement in the New World of Work," Sustainability, MDPI, vol. 14(7), pages 1-14, March.
    13. Abdulloev Ilhom & Epstein Gil S. & Gang Ira N., 2020. "A Downside to the Brain Gain Story," Economics, Sciendo, vol. 8(2), pages 9-20, December.
    14. HyeJin Lee & Yohan Hwang, 2022. "Technology-Enhanced Education through VR-Making and Metaverse-Linking to Foster Teacher Readiness and Sustainable Learning," Sustainability, MDPI, vol. 14(8), pages 1-21, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shengxuan Tang & Ming Cai & Yao Xiao, 2024. "A Cross-Citation-Based Model for Technological Advancement Assessment: Methodology and Application," Sustainability, MDPI, vol. 16(1), pages 1-20, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sunghwan Hwang, 2022. "Examining the Effects of Artificial Intelligence on Elementary Students’ Mathematics Achievement: A Meta-Analysis," Sustainability, MDPI, vol. 14(20), pages 1-18, October.
    2. Richard Glassey & Olle Bälter, 2021. "Sustainable Approaches for Accelerated Learning," Sustainability, MDPI, vol. 13(21), pages 1-24, October.
    3. Rocsana Bucea-Manea-Țoniş & Valentin Kuleto & Simona Corina Dobre Gudei & Costin Lianu & Cosmin Lianu & Milena P. Ilić & Dan Păun, 2022. "Artificial Intelligence Potential in Higher Education Institutions Enhanced Learning Environment in Romania and Serbia," Sustainability, MDPI, vol. 14(10), pages 1-18, May.
    4. Paulina Schiappacasse & Bernhard Müller & Le Thuy Linh, 2019. "Towards Responsible Aggregate Mining in Vietnam," Resources, MDPI, vol. 8(3), pages 1-15, August.
    5. Pina Puntillo, 2023. "Circular economy business models: Towards achieving sustainable development goals in the waste management sector—Empirical evidence and theoretical implications," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(2), pages 941-954, March.
    6. Schlör, Holger & Venghaus, Sandra & Hake, Jürgen-Friedrich, 2018. "The FEW-Nexus city index – Measuring urban resilience," Applied Energy, Elsevier, vol. 210(C), pages 382-392.
    7. Jean-Louis Combes & Alexandru Minea & Pegdéwendé Nestor Sawadogo, 2019. "Assessing the effects of combating illicit financial flows on domestic tax revenue mobilization in developing countries," Post-Print halshs-02315734, HAL.
    8. Nelson, Ewan & Warren, Peter, 2020. "UK transport decoupling: On track for clean growth in transport?," Transport Policy, Elsevier, vol. 90(C), pages 39-51.
    9. Ibrahim Ari & Muammer Koc, 2018. "Sustainable Financing for Sustainable Development: Understanding the Interrelations between Public Investment and Sovereign Debt," Sustainability, MDPI, vol. 10(11), pages 1-25, October.
    10. R. Ebrahimi & S. Choobchian & H. Farhadian & I. Goli & E. Farmandeh & H. Azadi, 2022. "Investigating the effect of vocational education and training on rural women’s empowerment," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-11, December.
    11. Benjamin Nölting & Bettina König & Anne B. Zimmermann & Antonietta Di Giulio & Martina Schäfer & Flurina Schneider, 2022. "Dealing with the COVID-19 pandemic: an opportunity to reflect on sustainability research," Sustainability Nexus Forum, Springer, vol. 30(1), pages 11-27, December.
    12. Rashmi Jaipal, 2017. "Psychology at the Crossroads," Psychology and Developing Societies, , vol. 29(2), pages 125-159, September.
    13. Bárbara Galleli & Elder Semprebon & Joyce Aparecida Ramos dos Santos & Noah Emanuel Brito Teles & Mateus Santos de Freitas-Martins & Raquel Teodoro da Silva Onevetch, 2021. "Institutional Pressures, Sustainable Development Goals and COVID-19: How Are Organisations Engaging?," Sustainability, MDPI, vol. 13(21), pages 1-21, November.
    14. Sagarika Dey & Priyanka Devi, 2019. "Impact of TVET on Labour Market Outcomes and Women’s Empowerment in Rural Areas: A Case Study from Cachar District, Assam," Indian Journal of Human Development, , vol. 13(3), pages 357-371, December.
    15. Rostami-Tabar, Bahman & Ali, Mohammad M. & Hong, Tao & Hyndman, Rob J. & Porter, Michael D. & Syntetos, Aris, 2022. "Forecasting for social good," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1245-1257.
    16. Maria Sassi, 2020. "A SEM Approach to the Direct and Indirect Links between WaSH Services and Access to Food in Countries in Protracted Crises: The Case of Western Bahr-el-Ghazal State, South Sudan," Sustainability, MDPI, vol. 12(22), pages 1-13, November.
    17. Seebacher, Moritz, 2023. "Pathways to progress: The complementarity of bicycles and road infrastructure for girls’ education," Economics of Education Review, Elsevier, vol. 97(C).
    18. Christina Tsouti & Christina Papadaskalopoulou & Angeliki Konsta & Panagiotis Andrikopoulos & Margarita Panagiotopoulou & Sofia Papadaki & Christos Boukouvalas & Magdalini Krokida & Katerina Valta, 2023. "Investigating the Environmental Benefits of Novel Films for the Packaging of Fresh Tomatoes Enriched with Antimicrobial and Antioxidant Compounds through Life Cycle Assessment," Sustainability, MDPI, vol. 15(10), pages 1-22, May.
    19. Olga Stepanova & Magdalena Romanov, 2021. "Urban Planning as a Strategy to Implement Social Sustainability Policy Goals? The Case of Temporary Housing for Immigrants in Gothenburg, Sweden," Sustainability, MDPI, vol. 13(4), pages 1-17, February.
    20. Alberto Bertossi & Stefania Troiano & Francesco Marangon, 2022. "Where is sustainability? An assessment of vending products," RIVISTA DI STUDI SULLA SOSTENIBILITA', FrancoAngeli Editore, vol. 0(1), pages 155-180.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:16:p:12253-:d:1214788. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.