IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v63y2017icp93-100.html
   My bibliography  Save this article

An AHP-based evaluation method for teacher training workshop on information and communication technology

Author

Listed:
  • Lucas, Rochelle Irene
  • Promentilla, Michael Angelo
  • Ubando, Aristotle
  • Tan, Raymond Girard
  • Aviso, Kathleen
  • Yu, Krista Danielle

Abstract

The emergence of information and communication technology (ICT) has created opportunities for enhancing the learning process at different educational levels. However, its potential benefits can only be fully realized if teachers are properly trained to utilize such tools. The rapid evolution of ICT also necessitates rigorous assessment of training programs by participants. Thus, this study proposes an evaluation framework based on the Analytic Hierarchy Process (AHP) to systematically evaluate such workshops designed for teachers. The evaluation model is decomposed hierarchically into four main criteria namely: (1) workshop design, (2) quality of content of the workshop, (3) quality of delivery of the content of the workshop, and the (4) relevance of the workshop. These criteria are further disaggregated into 24 sub-indicators to measure the effectiveness of the workshop as perceived by the participants based on their own expectations. This framework is applied to a case study of ICT workshops done in the Philippines. In this case, relevance of the workshop is found to be the most important main criterion identified by the participants, particularly on the new ICT knowledge that promotes teachers’ professional growth and development. The workshop evaluation index (WEI) is also proposed as a metric to support decision-making by providing a mechanism for benchmarking performance, tracking improvement over time, and developing strategies for the design and improvement of training programs or workshops on ICT for teachers.

Suggested Citation

  • Lucas, Rochelle Irene & Promentilla, Michael Angelo & Ubando, Aristotle & Tan, Raymond Girard & Aviso, Kathleen & Yu, Krista Danielle, 2017. "An AHP-based evaluation method for teacher training workshop on information and communication technology," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 93-100.
  • Handle: RePEc:eee:epplan:v:63:y:2017:i:c:p:93-100
    DOI: 10.1016/j.evalprogplan.2017.04.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718916301239
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2017.04.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vargas, Luis G., 1990. "An overview of the analytic hierarchy process and its applications," European Journal of Operational Research, Elsevier, vol. 48(1), pages 2-8, September.
    2. Kamvysi, Konstantina & Gotzamani, Katerina & Andronikidis, Andreas & Georgiou, Andreas C., 2014. "Capturing and prioritizing students’ requirements for course design by embedding Fuzzy-AHP and linear programming in QFD," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1083-1094.
    3. Saaty, Thomas L. & Vargas, Luis G., 1987. "Uncertainty and rank order in the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 32(1), pages 107-117, October.
    4. Vaidya, Omkarprasad S. & Kumar, Sushil, 2006. "Analytic hierarchy process: An overview of applications," European Journal of Operational Research, Elsevier, vol. 169(1), pages 1-29, February.
    5. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    6. Diaz-Balteiro, L & González-Pachón, J. & Romero, C., 2017. "Measuring systems sustainability with multi-criteria methods: A critical review," European Journal of Operational Research, Elsevier, vol. 258(2), pages 607-616.
    7. Pohekar, S. D. & Ramachandran, M., 2004. "Application of multi-criteria decision making to sustainable energy planning--A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 8(4), pages 365-381, August.
    8. Somsuk, Nisakorn & Laosirihongthong, Tritos, 2014. "A fuzzy AHP to prioritize enabling factors for strategic management of university business incubators: Resource-based view," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 198-210.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. María-José Vieira & Camino Ferreira & Agustín Rodríguez-Esteban & Javier Vidal, 2021. "Towards Sustainable Development in Education: Implementing a VET System for In-Service Teachers in Albania," Sustainability, MDPI, vol. 13(16), pages 1-15, August.
    2. Min Tao & Xiong Wang, 2023. "An Integrated MCDM Model for Sustainable Course Planning: An Empirical Case Study in Accounting Education," Sustainability, MDPI, vol. 15(6), pages 1-25, March.
    3. Nikolić, Vlastimir & Petković, Dalibor & Denić, Nebojša & Milovančević, Miloš & Gavrilović, Snežana, 2019. "Appraisal and review of e-learning and ICT systems in teaching process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 456-464.
    4. Pourhejazy, Pourya & Isaksen, K. Robert, 2024. "Exploring the curricular and pedagogical decision criteria for research-based learning design in undergraduate studies," Evaluation and Program Planning, Elsevier, vol. 103(C).
    5. Baffoe, Gideon, 2019. "Exploring the utility of Analytic Hierarchy Process (AHP) in ranking livelihood activities for effective and sustainable rural development interventions in developing countries," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 197-204.
    6. Teasdale, Rebecca M. & Strasser, Mikayla & Moore, Ceily & Graham, Kara E., 2023. "Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning," Evaluation and Program Planning, Elsevier, vol. 97(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhu, Bin & Xu, Zeshui, 2014. "Stochastic preference analysis in numerical preference relations," European Journal of Operational Research, Elsevier, vol. 237(2), pages 628-633.
    2. Ormerod, Richard J. & Ulrich, Werner, 2013. "Operational research and ethics: A literature review," European Journal of Operational Research, Elsevier, vol. 228(2), pages 291-307.
    3. Paweł Karczmarek & Witold Pedrycz & Adam Kiersztyn, 2021. "Fuzzy Analytic Hierarchy Process in a Graphical Approach," Group Decision and Negotiation, Springer, vol. 30(2), pages 463-481, April.
    4. Xu, Zeshui & Chen, Jian, 2008. "Some models for deriving the priority weights from interval fuzzy preference relations," European Journal of Operational Research, Elsevier, vol. 184(1), pages 266-280, January.
    5. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    6. Tohid Atashbar, 2013. "Iranian Disease: Why a Developing Country's Government Did Not Listen to Economists' Advices," American Journal of Economics and Sociology, Wiley Blackwell, vol. 72(3), pages 732-760, July.
    7. Zhu, Bin & Xu, Zeshui, 2014. "Analytic hierarchy process-hesitant group decision making," European Journal of Operational Research, Elsevier, vol. 239(3), pages 794-801.
    8. Hocine, Amine & Kouaissah, Noureddine, 2020. "XOR analytic hierarchy process and its application in the renewable energy sector," Omega, Elsevier, vol. 97(C).
    9. Calabrese, Armando & Costa, Roberta & Levialdi, Nathan & Menichini, Tamara, 2019. "Integrating sustainability into strategic decision-making: A fuzzy AHP method for the selection of relevant sustainability issues," Technological Forecasting and Social Change, Elsevier, vol. 139(C), pages 155-168.
    10. Virginia Racioppi & Gabriella Marcarelli & Massimo Squillante, 2015. "Modelling a sustainable requalification problem by analytic hierarchy process," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(4), pages 1661-1677, July.
    11. Jana Krejčí & Alessio Ishizaka, 2018. "FAHPSort: A Fuzzy Extension of the AHPSort Method," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1119-1145, July.
    12. Liu, Fang & Zhang, Wei-Guo & Zhang, Li-Hua, 2014. "Consistency analysis of triangular fuzzy reciprocal preference relations," European Journal of Operational Research, Elsevier, vol. 235(3), pages 718-726.
    13. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Influence of aggregation and measurement scale on ranking a compromise alternative in AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(4), pages 700-710, April.
    14. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Does AHP help us make a choice? An experimental evaluation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(10), pages 1801-1812, October.
    15. Dinulescu Ruxandra & Dobrin Cosmin, 2022. "Applying the fuzzy analytical hierarchy process for classifying and prioritizing healthcare quality attributes," Management & Marketing, Sciendo, vol. 17(1), pages 15-40, March.
    16. Ahadi, Pedram & Fakhrabadi, Farbod & Pourshaghaghy, Alireza & Kowsary, Farshad, 2023. "Optimal site selection for a solar power plant in Iran via the Analytic Hierarchy Process (AHP)," Renewable Energy, Elsevier, vol. 215(C).
    17. Ian Durbach, 2019. "Scenario planning in the analytic hierarchy process," Futures & Foresight Science, John Wiley & Sons, vol. 1(2), June.
    18. Peng Sun & Jiawei Yang & Yongfeng Zhi, 2019. "Multi-attribute decision-making method based on Taylor expansion," International Journal of Distributed Sensor Networks, , vol. 15(3), pages 15501477198, March.
    19. Antonopoulos, I.-S. & Perkoulidis, G. & Logothetis, D. & Karkanias, C., 2014. "Ranking municipal solid waste treatment alternatives considering sustainability criteria using the analytical hierarchical process tool," Resources, Conservation & Recycling, Elsevier, vol. 86(C), pages 149-159.
    20. Richard Hnilica & Martin Jankovský & Miroslav Dado & Valéria Messingerová & Marián Schwarz & Darina Veverková, 2017. "Use of the analytic hierarchy process for complex assessment of the work environment," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(1), pages 93-101, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:63:y:2017:i:c:p:93-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.