IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i19p2396-d643446.html
   My bibliography  Save this article

An Academic Performance Indicator Using Flexible Multi-Criteria Methods

Author

Listed:
  • Olga Blasco-Blasco

    (Departamento de Economía Aplicada, Facultad de Economía, Universitat de València, Avda. Tarongers s/n, 46022 Valencia, Spain
    These authors contributed equally to this work.)

  • Marina Liern-García

    (Department of Maths Analises, Universitat de València, Av. Blasco Ibáñez 13, 46010 Valencia, Spain
    These authors contributed equally to this work.)

  • Aarón López-García

    (Department of Computer Science, Universitat de València, Av. Blasco Ibáñez 13, 46010 Valencia, Spain
    These authors contributed equally to this work.)

  • Sandra E. Parada-Rico

    (School of Mathematics, Industrial University of Santander, Carrera 27 Calle 9, Edificio Camilo Torres, Bucaramanga 680002, Colombia
    These authors contributed equally to this work.)

Abstract

Composite indicators are a very useful tool for conveying summary information on the overall performance of institutions and facilitating decision-making. Increasingly, there is a demand for indicators that allow performance to be assessed after the implementation of a strategy. This has several difficulties, and in this paper, we address three of them: how to evaluate at different points in time, how to estimate the weighting of the criteria and how to normalize the data. Our proposal is based on multicriteria techniques, using a recent method, uwTOPSIS, and is applied to data collected from 2975 students enrolled in the first year of science and engineering at the Industrial University of Santander (Colombia) from the first semester of 2016 to the first semester of 2019. In the paper, we show that our proposal makes it possible to measure and evaluate the academic performance of students at two points in time, and this allows the University to know whether its student support policy has been successful and to what degree it has been effective. Due to the large amount of data handled, data management has been done using R programming language, and model implementation has been done with Python.

Suggested Citation

  • Olga Blasco-Blasco & Marina Liern-García & Aarón López-García & Sandra E. Parada-Rico, 2021. "An Academic Performance Indicator Using Flexible Multi-Criteria Methods," Mathematics, MDPI, vol. 9(19), pages 1-19, September.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:19:p:2396-:d:643446
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/19/2396/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/19/2396/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. R. E. Bellman & L. A. Zadeh, 1970. "Decision-Making in a Fuzzy Environment," Management Science, INFORMS, vol. 17(4), pages 141-164, December.
    2. I. Ivanova & F.J. Arcelus & G. Srinivasan, 1999. "An Assessment of the Measurement Properties of the Human Development Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 46(2), pages 157-179, February.
    3. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    4. Mareschal, Bertrand, 1988. "Weight stability intervals in multicriteria decision aid," European Journal of Operational Research, Elsevier, vol. 33(1), pages 54-64, January.
    5. Ouenniche, Jamal & Pérez-Gladish, Blanca & Bouslah, Kais, 2018. "An out-of-sample framework for TOPSIS-based classifiers with application in bankruptcy prediction," Technological Forecasting and Social Change, Elsevier, vol. 131(C), pages 111-116.
    6. F. Hutton Barron & Bruce E. Barrett, 1996. "Decision Quality Using Ranked Attribute Weights," Management Science, INFORMS, vol. 42(11), pages 1515-1523, November.
    7. Fischer, Gregory W., 1995. "Range Sensitivity of Attribute Weights in Multiattribute Value Models," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(3), pages 252-266, June.
    8. Constantin Zopounidis & Michael Doumpos, 2017. "Multiple Criteria Decision Making," Post-Print hal-02880222, HAL.
    9. Sandra E. Parada & Olga Blasco-Blasco & Vicente Liern, 2019. "Adequacy Indicators Based on Pre-established Goals: An Implementation in a Colombian University," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(1), pages 1-24, May.
    10. José Vicens-Colom & Joe Holles & Vicente Liern, 2021. "Measuring Sustainability with Unweighted TOPSIS: An Application to Sustainable Tourism in Spain," Sustainability, MDPI, vol. 13(9), pages 1-14, May.
    11. Giuseppe Munda & Michela Nardo & Michaela Saisana & Tanja Srebotnjak, 2009. "Measuring uncertainties in composite indicators of sustainability," International Journal of Environmental Technology and Management, Inderscience Enterprises Ltd, vol. 11(1/2/3), pages 7-26.
    12. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    13. Michael Freudenberg, 2003. "Composite Indicators of Country Performance: A Critical Assessment," OECD Science, Technology and Industry Working Papers 2003/16, OECD Publishing.
    14. Claudia Margarita Acuña-Soto & Vicente Liern & Blanca Pérez-Gladish, 2020. "Multiple criteria performance evaluation of YouTube mathematical educational videos by IS-TOPSIS," Operational Research, Springer, vol. 20(4), pages 2017-2039, December.
    15. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    16. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marianela Carrillo, 2022. "Measuring Progress towards Sustainability in the European Union within the 2030 Agenda Framework," Mathematics, MDPI, vol. 10(12), pages 1-23, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandra E. Parada & Olga Blasco-Blasco & Vicente Liern, 2019. "Adequacy Indicators Based on Pre-established Goals: An Implementation in a Colombian University," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(1), pages 1-24, May.
    2. Michela Gnaldi & M. Giovanna Ranalli, 2016. "Measuring University Performance by Means of Composite Indicators: A Robustness Analysis of the Composite Measure Used for the Benchmark of Italian Universities," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(2), pages 659-675, November.
    3. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    4. Riccardo Natoli & Segu Zuhair, 2011. "Measuring Progress: A Comparison of the GDP, HDI, GS and the RIE," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 33-56, August.
    5. Yelin Fu & Kong Xiangtianrui & Hao Luo & Lean Yu, 2020. "Constructing Composite Indicators with Collective Choice and Interval-Valued TOPSIS: The Case of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(1), pages 117-135, November.
    6. Edson Kogachi & Adonias Ferreira & Carlos Cavalcante & Marcelo Embiruçu, 2021. "Development of Performance Evaluation Indicators for Table Grape Packaging Units. 2. Global Indexes," Sustainability, MDPI, vol. 13(11), pages 1-16, June.
    7. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    8. Yeh, Chung-Hsing & J. Willis, Robert & Deng, Hepu & Pan, Hongqi, 1999. "Task oriented weighting in multi-criteria analysis," European Journal of Operational Research, Elsevier, vol. 119(1), pages 130-146, November.
    9. Cantone, Giulio Giacomo & Tomaselli, Venera, 2024. "On the Coherence of Composite Indexes: Multiversal Model and Specification Analysis for an Index of Well-Being," MetaArXiv d5y26, Center for Open Science.
    10. Carrillo, Marianela & Jorge, Jesús M., 2017. "Multidimensional Analysis of Regional Tourism Sustainability in Spain," Ecological Economics, Elsevier, vol. 140(C), pages 89-98.
    11. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    12. Marco Marozzi, 2015. "Measuring Trust in European Public Institutions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(3), pages 879-895, September.
    13. Marco Marozzi, 2021. "Perceived Justifiability Towards Morally Debatable Behaviors Across Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(2), pages 759-778, January.
    14. Yang Ding & Yelin Fu & Kin Keung Lai & W. K. John Leung, 2018. "Using Ranked Weights and Acceptability Analysis to Construct Composite Indicators: A Case Study of Regional Sustainable Society Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 871-885, October.
    15. Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    16. Omrani, Hashem & Fahimi, Pegah & Mahmoodi, Abdollah, 2020. "A data envelopment analysis game theory approach for constructing composite indicator: An application to find out development degree of cities in West Azarbaijan province of Iran," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).
    17. Tania, Fernández-García & Vicente, Liern & Blanca, Pérez-Gladish & Fernando, Rubiera-Morollón, 2022. "Measuring the territorial effort in research, development, and innovation from a multiple criteria approach: Application to the Spanish regions case," Technology in Society, Elsevier, vol. 70(C).
    18. Javier Bilbao-Ubillos, 2013. "Another Approach to Measuring Human Development: The Composite Dynamic Human Development Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 111(2), pages 473-484, April.
    19. Matteo Mazziotta & Adriano Pareto, 2016. "On a Generalized Non-compensatory Composite Index for Measuring Socio-economic Phenomena," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 127(3), pages 983-1003, July.
    20. Aleksandra Maksimovska & Aleksandar Stojkov, 2019. "Composite Indicator of Social Responsiveness of Local Governments: An Empirical Mapping of the Networked Community Governance Paradigm," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 669-706, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:19:p:2396-:d:643446. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.