IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v267y2018i1p381-392.html
   My bibliography  Save this article

Composite indicators as generalized benefit-of-the-doubt weighted averages

Author

Listed:
  • Rogge, Nicky

Abstract

Composite indicators (CIs) are usually computed as arithmetic (weighted) averages of (often normalized) sub-indicators. Several studies criticized this procedure for implying requirements and properties that are often hard to maintain in practical applications. Recent studies explored the multiplicative aggregation and more specifically the geometric (weighted) average as aggregator in CI-building. This paper takes this exploration one step further by considering other members of the family of generalized (weighted) averages as aggregator in the construction of CIs. It is argued that the choice for a particular version of the generalized weighted average enables to reflect decision makers’ attitudes in the evaluation. For the Human Development Index, results show that the choice for a specific version of the generalized (weighted) average as aggregator in CI-construction impacts country rankings.

Suggested Citation

  • Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    • Handle: RePEc:eee:ejores:v:267:y:2018:i:1:p:381-392
    DOI: 10.1016/j.ejor.2017.11.048
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221717310597
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2017.11.048?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cooper, William W. & Ruiz, Jose L. & Sirvent, Inmaculada, 2007. "Choosing weights from alternative optimal solutions of dual multiplier models in DEA," European Journal of Operational Research, Elsevier, vol. 180(1), pages 443-458, July.
    2. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    3. Wang, Ying-Ming & Chin, Kwai-Sang, 2010. "Some alternative models for DEA cross-efficiency evaluation," International Journal of Production Economics, Elsevier, vol. 128(1), pages 332-338, November.
    4. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    5. Satya R. Chakravarty, 2003. "A Generalized Human Development Index," Review of Development Economics, Wiley Blackwell, vol. 7(1), pages 99-114, February.
    6. Picazo-Tadeo, Andrés J. & Castillo-Giménez, Juana & Beltrán-Esteve, Mercedes, 2014. "An intertemporal approach to measuring environmental performance with directional distance functions: Greenhouse gas emissions in the European Union," Ecological Economics, Elsevier, vol. 100(C), pages 173-182.
    7. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    8. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    9. Mathieu Lefebvre & Tim Coelli & Pierre Pestieau, 2010. "On the Convergence of Social Protection Performance in the European Union," CESifo Economic Studies, CESifo Group, vol. 56(2), pages 300-322, June.
    10. Kortelainen, Mika, 2008. "Dynamic environmental performance analysis: A Malmquist index approach," Ecological Economics, Elsevier, vol. 64(4), pages 701-715, February.
    11. F J Blancas & I Contreras & J M Ramírez-Hurtado, 2013. "Constructing a composite indicator with multiplicative aggregation under the objective of ranking alternatives," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(5), pages 668-678, May.
    12. Chris Tofallis, 2013. "An automatic-democratic approach to weight setting for the new human development index," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(4), pages 1325-1345, October.
    13. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    14. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    15. Cherchye, Laurens & Knox Lovell, C.A. & Moesen, Wim & Van Puyenbroeck, Tom, 2007. "One market, one number? A composite indicator assessment of EU internal market dynamics," European Economic Review, Elsevier, vol. 51(3), pages 749-779, April.
    16. Fare, Rolf & Zelenyuk, Valentin, 2003. "On aggregate Farrell efficiencies," European Journal of Operational Research, Elsevier, vol. 146(3), pages 615-620, May.
    17. Anderson, Gordon & Crawford, Ian & Leicester, Andrew, 2011. "Welfare rankings from multivariate data, a nonparametric approach," Journal of Public Economics, Elsevier, vol. 95(3), pages 247-252.
    18. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    19. Koen Decancq & María Ana Lugo, 2013. "Weights in Multidimensional Indices of Wellbeing: An Overview," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 7-34, January.
    20. Shyamal Chowdhury & Lyn Squire, 2006. "Setting weights for aggregate indices: An application to the commitment to development index and human development index," Journal of Development Studies, Taylor & Francis Journals, vol. 42(5), pages 761-771.
    21. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    22. Wade D. Cook & Joe Zhu, 2015. "DEA Cross Efficiency," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 2, pages 23-43, Springer.
    23. Ravallion, Martin, 2012. "Troubling tradeoffs in the Human Development Index," Journal of Development Economics, Elsevier, vol. 99(2), pages 201-209.
    24. Rogge, Nicky, 2012. "Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index," Working Papers 2012/08, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    25. Iñaki Permanyer, 2012. "Uncertainty and robustness in composite indices rankings," Oxford Economic Papers, Oxford University Press, vol. 64(1), pages 57-79, January.
    26. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    27. Despotis, D.K., 2005. "Measuring human development via data envelopment analysis: the case of Asia and the Pacific," Omega, Elsevier, vol. 33(5), pages 385-390, October.
    28. Liang, Liang & Wu, Jie & Cook, Wade D. & Zhu, Joe, 2008. "Alternative secondary goals in DEA cross-efficiency evaluation," International Journal of Production Economics, Elsevier, vol. 113(2), pages 1025-1030, June.
    29. Van den Bossche, Filip & Rogge, Nicky & Devooght, Kurt & Van Puyenbroeck, Tom, 2010. "Robust Corporate Social Responsibility investment screening," Ecological Economics, Elsevier, vol. 69(5), pages 1159-1169, March.
    30. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    31. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    32. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    33. Sagar, Ambuj D. & Najam, Adil, 1998. "The human development index: a critical review," Ecological Economics, Elsevier, vol. 25(3), pages 249-264, June.
    34. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    35. D K Despotis, 2005. "A reassessment of the human development index via data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 969-980, August.
    36. Mariano, Enzo Barberio & Sobreiro, Vinicius Amorim & Rebelatto, Daisy Aparecida do Nascimento, 2015. "Human development and data envelopment analysis: A structured literature review," Omega, Elsevier, vol. 54(C), pages 33-49.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    2. Su, Weihua & Chen, Sibo & Zhang, Chonghui & Li, Kevin W., 2023. "A subgroup dominance-based benefit of the doubt method for addressing rank reversals: A case study of the human development index in Europe," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1299-1317.
    3. Koronakos, Gregory & Smirlis, Yiannis & Sotiros, Dimitris & Despotis, Dimitris K., 2020. "Assessment of OECD Better Life Index by incorporating public opinion," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    4. Mariani, Francesca & Ciommi, Mariateresa & Recchioni, Maria Cristina, 2024. "A new class of composite indicators: The penalized power mean," European Journal of Operational Research, Elsevier, vol. 317(3), pages 1015-1035.
    5. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Vidoli, F.; & Fusco, E.; & Pignataro, G.; & Guccio, C.;, 2023. "Multi-directional Robust Benefit of the Doubt model: a comprehensive measure for the quality of health care in OECD countries," Health, Econometrics and Data Group (HEDG) Working Papers 23/14, HEDG, c/o Department of Economics, University of York.
    7. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    8. Matheus Pereira Libório & Alexandre Magno Alvez Diniz & Angélica Cidália Gouveia Santos & Cristiane Neri Nobre & Douglas Alexandre Gomes Vieira & Hasheem Mannan & Marcos Flávio Silveira Vasconcelos Da, 2024. "Benefit-of-the-Doubt in the Spatial Analysis of Child Well-Being in European Countries," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 17(4), pages 1851-1870, August.
    9. Christophe Béné & Jessica Fanzo & Steven D Prager & Harold A Achicanoy & Brendan R Mapes & Patricia Alvarez Toro & Camila Bonilla Cedrez, 2020. "Global drivers of food system (un)sustainability: A multi-country correlation analysis," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-22, April.
    10. Juan Aparicio & Magdalena Kapelko, 2019. "Enhancing the Measurement of Composite Indicators of Corporate Social Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 807-826, July.
    11. Cantone, Giulio Giacomo & Tomaselli, Venera, 2024. "On the Coherence of Composite Indexes: Multiversal Model and Specification Analysis for an Index of Well-Being," MetaArXiv d5y26, Center for Open Science.
    12. Marianela Carrillo, 2022. "Measuring Progress towards Sustainability in the European Union within the 2030 Agenda Framework," Mathematics, MDPI, vol. 10(12), pages 1-23, June.
    13. Mehmet Pinar, 2022. "Choquet-Integral Aggregation Method to Aggregate Social Indicators to Account for Interactions: An Application to the Human Development Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 159(1), pages 1-53, January.
    14. L. P. Zhang & P. Zhou, 2019. "Reassessment of global climate risk: non-compensatory or compensatory?," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 95(1), pages 271-287, January.
    15. Vidoli, F. & Fusco, E. & Pignataro, G. & Guccio, C., 2024. "Multi-directional Robust Benefit of the Doubt model: An application to the measurement of the quality of acute care services in OECD countries," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    16. Rogge, Nicky & Archer, Geoffrey, 2021. "Measuring and analyzing country change in establishing ease of doing business using a revised version of World Bank's ease of doing business index," European Journal of Operational Research, Elsevier, vol. 290(1), pages 373-385.
    17. Gong, Chengzhu & Gong, Nianjiao & Qi, Rui & Yu, Shiwei, 2020. "Assessment of natural gas supply security in Asia Pacific: Composite indicators with compromise Benefit-of-the-Doubt weights," Resources Policy, Elsevier, vol. 67(C).
    18. Janová, Jitka & Hampel, David & Nerudová, Danuše, 2019. "Design and validation of a tax sustainability index," European Journal of Operational Research, Elsevier, vol. 278(3), pages 916-926.
    19. Dircio-Palacios-Macedo, María del Carmen & Cruz-García, Paula & Hernández-Trillo, Fausto & Tortosa-Ausina, Emili, 2023. "Constructing a financial inclusion index for Mexican municipalities," Finance Research Letters, Elsevier, vol. 52(C).
    20. Enzo Barberio Mariano & Diogo Ferraz & Simone Cristina Oliveira Gobbo, 2021. "The Human Development Index with Multiple Data Envelopment Analysis Approaches: A Comparative Evaluation Using Social Network Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 443-500, September.
    21. María del Carmen Dircio Palacios Macedo & Paula Cruz-García & Fausto Hernández-Trillo & Emili Tortosa-Ausina, 2024. "On the evolution over time of Financial Inclusion: A new multivariate index for Mexican municipalities," Working Papers 2024/06, Economics Department, Universitat Jaume I, Castellón (Spain).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    2. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    3. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    4. Panagiotis Ravanos & Giannis Karagiannis, 2021. "A VEA Benefit-of-the-Doubt Model for the HDI," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 27-46, May.
    5. Diogo Ferraz & Enzo B. Mariano & Daisy Rebelatto & Dominik Hartmann, 2020. "Linking Human Development and the Financial Responsibility of Regions: Combined Index Proposals Using Methods from Data Envelopment Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 150(2), pages 439-478, July.
    6. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    7. Nicky Rogge & Ilse Nijverseel, 2019. "Quality of Life in the European Union: A Multidimensional Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(2), pages 765-789, January.
    8. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    9. Mariano, Enzo Barberio & Sobreiro, Vinicius Amorim & Rebelatto, Daisy Aparecida do Nascimento, 2015. "Human development and data envelopment analysis: A structured literature review," Omega, Elsevier, vol. 54(C), pages 33-49.
    10. Stergios Athanassoglou, 2016. "Revisiting Worst-Case DEA for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(3), pages 1259-1272, September.
    11. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    12. Athanassoglou, Stergios, 2015. "Revisiting Worst-case DEA for Composite Indicators," Climate Change and Sustainable Development 198712, Fondazione Eni Enrico Mattei (FEEM).
    13. Cantone, Giulio Giacomo & Tomaselli, Venera, 2024. "On the Coherence of Composite Indexes: Multiversal Model and Specification Analysis for an Index of Well-Being," MetaArXiv d5y26, Center for Open Science.
    14. Giménez, Víctor & Ayvar-Campos, Francisco Javier & Navarro-Chávez, José César Lenin, 2017. "Efficiency in the generation of social welfare in Mexico: A proposal in the presence of bad outputs," Omega, Elsevier, vol. 69(C), pages 43-52.
    15. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    16. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    17. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    18. Laurens CHERCHYE & Willem MOESEN & Nicky ROGGE & Tom VAN PUYENBROECK, 2009. "Constructing a knowledge economy composite indicator with imprecise data," Working Papers of Department of Economics, Leuven ces09.15, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    19. Annalina Sarra & Eugenia Nissi, 2020. "A Spatial Composite Indicator for Human and Ecosystem Well-Being in the Italian Urban Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 353-377, April.
    20. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:267:y:2018:i:1:p:381-392. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.