IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v36y2008i5p754-765.html
   My bibliography  Save this article

An AHP-based evaluation procedure for Innovative Educational Projects: A face-to-face vs. computer-mediated case study

Author

Listed:
  • Meløn, Mønica García
  • Aragonés Beltran, Pablo
  • Carmen González Cruz, M.

Abstract

In this paper a procedure to evaluate proposals for Educational Innovation Projects is proposed. This methodology should help the Institute of Educational Sciences of the Politechnical University of Valencia to choose the best Educational Project, the final aim being to provide the Administration with a stringent evaluation methodology, since the current evaluation methodology was found to be neither sufficiently objective nor systematic. Since in the definition and evaluation of these Educational Projects diverse stakeholders are involved, the process has been approached as a MCDA carried out by a group of experts. Although a whole methodology is proposed, the paper has been focused on the weight assignment of the different criteria chosen by the experts. The experts have been asked to act in two different ways: in face-to-face meetings in which a consensus or compromise had to be reached, and meetings at distance where the experts have given their individual judgements, which have been next combined using the geometric mean with the software EC 2000 [Expert Choice 2000 Team. Pittsburgh: Expert Choice, Inc.; 2001]. This procedure has allowed the authors to analyse the possible scenarios that the IES board team might come up against in the future. The main difference between the two ways of work is the dimension of physical space or the distance between the members of the evaluating team. This distance has a significant effect on the way team members relate to each other.

Suggested Citation

  • Meløn, Mønica García & Aragonés Beltran, Pablo & Carmen González Cruz, M., 2008. "An AHP-based evaluation procedure for Innovative Educational Projects: A face-to-face vs. computer-mediated case study," Omega, Elsevier, vol. 36(5), pages 754-765, October.
    • Handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:754-765
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(06)00028-4
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mustafa, A. & Goh, M., 1996. "Multi-criterion models for higher education administration," Omega, Elsevier, vol. 24(2), pages 167-178, April.
    2. Politis, Y. & Siskos, Y., 2004. "Multicriteria methodology for the evaluation of a Greek engineering department," European Journal of Operational Research, Elsevier, vol. 156(1), pages 223-240, July.
    3. Katrin Borcherding & Thomas Eppel & Detlof von Winterfeldt, 1991. "Comparison of Weighting Judgments in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 37(12), pages 1603-1619, December.
    4. Mareschal, Bertrand, 1988. "Weight stability intervals in multicriteria decision aid," European Journal of Operational Research, Elsevier, vol. 33(1), pages 54-64, January.
    5. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    6. Forgionne, Guisseppi A. & Kohli, Rajiv & Jennings, Darniet, 2002. "An AHP analysis of quality in AI and DSS journals," Omega, Elsevier, vol. 30(3), pages 171-183, June.
    7. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    8. Davey, Anne & Olson, David & Wallenius, Jyrki, 1994. "The process of multiattribute decision making: A case study of selecting applicants for a Ph.D. program," European Journal of Operational Research, Elsevier, vol. 72(3), pages 469-484, February.
    9. Baltes, Boris B. & Dickson, Marcus W. & Sherman, Michael P. & Bauer, Cara C. & LaGanke, Jacqueline S., 2002. "Computer-Mediated Communication and Group Decision Making: A Meta-Analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 87(1), pages 156-179, January.
    10. Gerardine DeSanctis & R. Brent Gallupe, 1987. "A Foundation for the Study of Group Decision Support Systems," Management Science, INFORMS, vol. 33(5), pages 589-609, May.
    11. Caballero, R. & Galache, T. & Gomez, T. & Molina, J. & Torrico, A., 2001. "Efficient assignment of financial resources within a university system. Study of the University of Malaga," European Journal of Operational Research, Elsevier, vol. 133(2), pages 298-309, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tayfun Büke & Aylin Çiğdem Köne, 2016. "Assessing Air Quality in Turkey: A Proposed, Air Quality Index," Sustainability, MDPI, vol. 8(1), pages 1-8, January.
    2. Satish Tyagi, 2016. "An improved fuzzy-AHP (IFAHP) approach to compare SECI modes," International Journal of Production Research, Taylor & Francis Journals, vol. 54(15), pages 4520-4536, August.
    3. Mehmet Yüksel, 2019. "A Model Proposal for the Evaluation of Chemistry Education in the Context of Learning Environment," Asian Journal of Education and Training, Asian Online Journal Publishing Group, vol. 5(3), pages 488-494.
    4. Ramakrishnan Ramanathan & Geetha Subramanian & Dipak Chaudhuri, 2010. "Quantitative Assessment of Stakeholder Perceptions for Tourism Development," Tourism Economics, , vol. 16(1), pages 99-116, March.
    5. Wenshuai Wu & Gang Kou, 2016. "A group consensus model for evaluating real estate investment alternatives," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 2(1), pages 1-10, December.
    6. Oliva, Gabriele & Scala, Antonio & Setola, Roberto & Dell’Olmo, Paolo, 2019. "Opinion-based optimal group formation," Omega, Elsevier, vol. 89(C), pages 164-176.
    7. Silvia ISTRATE & Valerica NESTIAN & Maria NEAGU, 2018. "A Company Improvement Analysis using the AHP and the ANP Methods," Economics and Applied Informatics, "Dunarea de Jos" University of Galati, Faculty of Economics and Business Administration, issue 2, pages 48-59.
    8. Goswami Shankha Shubhra, 2020. "Outranking Methods: Promethee I and Promethee II," Foundations of Management, Sciendo, vol. 12(1), pages 93-110, January.
    9. Kao, Chiang & Pao, Hwei-Lan, 2012. "Predicting project approvals: A case of grants from the National Science Council of Taiwan," Omega, Elsevier, vol. 40(1), pages 89-95, January.
    10. Hasan, Mostafa & Büyüktahtakın, İ. Esra & Elamin, Elshami, 2019. "A multi-criteria ranking algorithm (MCRA) for determining breast cancer therapy," Omega, Elsevier, vol. 82(C), pages 83-101.
    11. Li Huang & Jian Huang & Wei Wang, 2018. "The Sustainable Development Assessment of Reservoir Resettlement Based on a BP Neural Network," IJERPH, MDPI, vol. 15(1), pages 1-15, January.
    12. Ramanathan, Usha, 2013. "Aligning supply chain collaboration using Analytic Hierarchy Process," Omega, Elsevier, vol. 41(2), pages 431-440.
    13. Saud Alshehri & Yacine Rezgui & Haijiang Li, 2015. "Disaster community resilience assessment method: a consensus-based Delphi and AHP approach," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 78(1), pages 395-416, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miller, Michael & Mattes, Katharina, 2014. "Demonstration of a multi-criteria based decision support framework for selecting PSS to increase resource efficiency," Working Papers "Sustainability and Innovation" S11/2014, Fraunhofer Institute for Systems and Innovation Research (ISI).
    2. Mohammad Rahman & Lena Jaumann & Nils Lerche & Fabian Renatus & Ann Buchs & Rudolf Gade & Jutta Geldermann & Martin Sauter, 2015. "Selection of the Best Inland Waterway Structure: A Multicriteria Decision Analysis Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 29(8), pages 2733-2749, June.
    3. Haralambopoulos, D.A. & Polatidis, H., 2003. "Renewable energy projects: structuring a multi-criteria group decision-making framework," Renewable Energy, Elsevier, vol. 28(6), pages 961-973.
    4. Maria Cunha & João Marques & Dragan Savić, 2020. "A Flexible Approach for the Reinforcement of Water Networks Using Multi-Criteria Decision Analysis," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(14), pages 4469-4490, November.
    5. Agata Sielska, 2010. "Multicriteria rankings of open-end investment funds and their stability," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 20(1), pages 111-129.
    6. Wolters, W. T. M. & Mareschal, B., 1995. "Novel types of sensitivity analysis for additive MCDM methods," European Journal of Operational Research, Elsevier, vol. 81(2), pages 281-290, March.
    7. Daniel R. Georgiadis & Thomas A. Mazzuchi & Shahram Sarkani, 2013. "Using multi criteria decision making in analysis of alternatives for selection of enabling technology," Systems Engineering, John Wiley & Sons, vol. 16(3), pages 287-303, September.
    8. Schuwirth, N. & Reichert, P. & Lienert, J., 2012. "Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater," European Journal of Operational Research, Elsevier, vol. 220(2), pages 472-483.
    9. Duvivier, D. & Meskens, N. & Ahues, M., 2013. "A fast multicriteria decision-making tool for industrial scheduling problems," International Journal of Production Economics, Elsevier, vol. 145(2), pages 753-760.
    10. Fontana, Veronika & Ebner, Manuel & Schirpke, Uta & Ohndorf, Markus & Pritsch, Hanna & Tappeiner, Ulrike & Kurmayer, Rainer, 2023. "An integrative approach to evaluate ecosystem services of mountain lakes using multi-criteria decision analysis," Ecological Economics, Elsevier, vol. 204(PA).
    11. Behzadian, Majid & Kazemzadeh, R.B. & Albadvi, A. & Aghdasi, M., 2010. "PROMETHEE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 200(1), pages 198-215, January.
    12. Lerche, Nils & Wilkens, Ines & Schmehl, Meike & Eigner-Thiel, Swantje & Geldermann, Jutta, 2019. "Using methods of Multi-Criteria Decision Making to provide decision support concerning local bioenergy projects," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    13. Stefanos Xenarios & Heracles Polatidis & Matthew McCartney & Attila Nemes, 2015. "Developing a User-Based Decision-Aid Framework for Water Storage Systems in Sub-Saharan Africa: The Case of Blue Nile Basin in Ethiopia," Water Economics and Policy (WEP), World Scientific Publishing Co. Pte. Ltd., vol. 1(04), pages 1-30, December.
    14. Zheng, Jun & Lienert, Judit, 2018. "Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS," European Journal of Operational Research, Elsevier, vol. 267(1), pages 273-287.
    15. De Keyser, Wim & Peeters, Peter, 1996. "A note on the use of PROMETHEE multicriteria methods," European Journal of Operational Research, Elsevier, vol. 89(3), pages 457-461, March.
    16. Henry Huang & Yves De Smet & Cathy Macharis & Nguyen Anh Vu Doan, 2020. "Collaborative decision-making in sustainable mobility: identifying possible consensuses in the multi-actor multi-criteria analysis based on inverse mixed-integer linear optimization," ULB Institutional Repository 2013/311571, ULB -- Universite Libre de Bruxelles.
    17. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    18. Denys Yemshanov & Frank H. Koch & Yakov Ben‐Haim & Marla Downing & Frank Sapio & Marty Siltanen, 2013. "A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept," Risk Analysis, John Wiley & Sons, vol. 33(9), pages 1694-1709, September.
    19. Guh, Yuh-Yuan, 1997. "Introduction to a new weighting method -- Hierarchy consistency analysis," European Journal of Operational Research, Elsevier, vol. 102(1), pages 215-226, October.
    20. Hajkowicz, Stefan, 2006. "Taking a closer look at multiple criteria analysis and economic evaluation," 2006 Conference (50th), February 8-10, 2006, Sydney, Australia 139785, Australian Agricultural and Resource Economics Society.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:754-765. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.