IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v174y2024i2d10.1007_s11205-024-03400-0.html
   My bibliography  Save this article

Pyramid-Shaped Indicators: Evaluating the Robustness of Scheme Comparisons Under Weight Uncertainty

Author

Listed:
  • Li-zhu Yue

    (Huang Shan University)

  • Jia-wei Zhang

    (Liaoning Technical University)

  • Yue Lv

    (Liaoning Technical University)

Abstract

In the digital age, not only has the scope of indicator monitoring expanded but also the indicators themselves have become increasingly multilevel. Theoretically, the greater the number of levels, the more uncertainty there is in the indicators’ weights. This necessitates the evaluation of the robustness of scheme comparisons to reduce evaluation risks. By using partial order evaluation methods as analytical tools, this study aims to delineate the principles and methods of partial order representation for single-level indicators. Based on this delineation, it then aims to analyze the representation methods for multilevel indicators. The results reveal that for a two-level indicator system, it is only necessary to clarify the order of weights between the first- and second-level indicators. Through a partial order Hasse diagram, the schemes can be ranked and the robustness of the comparison can be analyzed. Furthermore, three- and four-level indicator systems can be decomposed into several two-level indicator systems to complete the partial order evaluation. A case analysis demonstrates that the partial order uncertainty analysis method can integrate decision-makers’ preferences. The Hasse diagram not only ranks the schemes but also achieves stratified clustering, which intuitively reflects the stability of the schemes.

Suggested Citation

  • Li-zhu Yue & Jia-wei Zhang & Yue Lv, 2024. "Pyramid-Shaped Indicators: Evaluating the Robustness of Scheme Comparisons Under Weight Uncertainty," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 174(2), pages 631-656, September.
  • Handle: RePEc:spr:soinre:v:174:y:2024:i:2:d:10.1007_s11205-024-03400-0
    DOI: 10.1007/s11205-024-03400-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-024-03400-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-024-03400-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thomas L. Saaty, 1986. "Axiomatic Foundation of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 32(7), pages 841-855, July.
    2. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    3. Sugihara, Kazutomi & Ishii, Hiroaki & Tanaka, Hideo, 2004. "Interval priorities in AHP by interval regression analysis," European Journal of Operational Research, Elsevier, vol. 158(3), pages 745-754, November.
    4. Ahn, Byeong Seok, 2015. "Extreme point-based multi-attribute decision analysis with incomplete information," European Journal of Operational Research, Elsevier, vol. 240(3), pages 748-755.
    5. Siskos, Eleftherios & Tsotsolas, Nikos, 2015. "Elicitation of criteria importance weights through the Simos method: A robustness concern," European Journal of Operational Research, Elsevier, vol. 246(2), pages 543-553.
    6. Risto Lahdelma & Pekka Salminen, 2001. "SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making," Operations Research, INFORMS, vol. 49(3), pages 444-454, June.
    7. Arbel, Ami, 1989. "Approximate articulation of preference and priority derivation," European Journal of Operational Research, Elsevier, vol. 43(3), pages 317-326, December.
    8. Michael Doumpos & Chrysovalantis Gaganis & Fotios Pasiouras, 2016. "Bank Diversification and Overall Financial Strength: International Evidence," Working Papers 1602, University of Crete, Department of Economics.
    9. Greco, Salvatore & Ishizaka, Alessio & Matarazzo, Benedetto & Torrisi, Gianpiero, 2015. "Stochastic Multiattribute Acceptability Analysis: an application to the ranking of Italian regions," MPRA Paper 68508, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    2. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    3. Raffaele Lagravinese & Paolo Liberati & Giuliano Resce, 2017. "Exploring health outcomes by stochastic multi-objective acceptability analysis: an application to Italian regions," Working Papers. Collection B: Regional and sectoral economics 1703, Universidade de Vigo, GEN - Governance and Economics research Network.
    4. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    5. Kangas, Annika S. & Kangas, Jyrki, 2004. "Probability, possibility and evidence: approaches to consider risk and uncertainty in forestry decision analysis," Forest Policy and Economics, Elsevier, vol. 6(2), pages 169-188, March.
    6. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    7. Greco, Salvatore & Ishizaka, Alessio & Resce, Giuliano & Torrisi, Gianpiero, 2017. "Is the Grass Always Greener on the Other Side of the fence? Composite Index of Well-Being Taking into Account the Local Relative Appreciations in Better Life Index," MPRA Paper 82718, University Library of Munich, Germany.
    8. Gaganis, Chrysovalantis & Pasiouras, Fotios & Tasiou, Menelaos & Zopounidis, Constantin, 2021. "CISEF: A composite index of social, environmental and financial performance," European Journal of Operational Research, Elsevier, vol. 291(1), pages 394-409.
    9. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    10. Chrysovalantis Gaganis & Panagiota Papadimitri & Menelaos Tasiou, 2021. "A multicriteria decision support tool for modelling bank credit ratings," Annals of Operations Research, Springer, vol. 306(1), pages 27-56, November.
    11. Angilella, Silvia & Doumpos, Michalis & Pappalardo, Maria Rosaria & Zopounidis, Constantin, 2024. "Assessing the performance of banks through an improved sigma-mu multicriteria analysis approach," Omega, Elsevier, vol. 127(C).
    12. Jiang, Yanping & Liang, Xia & Liang, Haiming & Yang, Ningman, 2018. "Multiple criteria decision making with interval stochastic variables: A method based on interval stochastic dominance," European Journal of Operational Research, Elsevier, vol. 271(2), pages 632-643.
    13. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    14. Kadziński, MiŁosz & Greco, Salvatore & SŁowiński, Roman, 2012. "Extreme ranking analysis in robust ordinal regression," Omega, Elsevier, vol. 40(4), pages 488-501.
    15. Dias, Luis C. & Climaco, Joao N., 2005. "Dealing with imprecise information in group multicriteria decisions: a methodology and a GDSS architecture," European Journal of Operational Research, Elsevier, vol. 160(2), pages 291-307, January.
    16. Wang, Ying-Ming & Elhag, Taha M.S., 2007. "A goal programming method for obtaining interval weights from an interval comparison matrix," European Journal of Operational Research, Elsevier, vol. 177(1), pages 458-471, February.
    17. García Cáceres, Rafael Guillermo & Aráoz Durand, Julián Arturo & Gómez, Fernando Palacios, 2009. "Integral analysis method - IAM," European Journal of Operational Research, Elsevier, vol. 192(3), pages 891-903, February.
    18. Lahdelma, Risto & Miettinen, Kaisa & Salminen, Pekka, 2005. "Reference point approach for multiple decision makers," European Journal of Operational Research, Elsevier, vol. 164(3), pages 785-791, August.
    19. Zhu, Bin & Xu, Zeshui, 2014. "Stochastic preference analysis in numerical preference relations," European Journal of Operational Research, Elsevier, vol. 237(2), pages 628-633.
    20. Olivier Cailloux & Tommi Tervonen & Boris Verhaegen & François Picalausa, 2014. "A data model for algorithmic multiple criteria decision analysis," Annals of Operations Research, Springer, vol. 217(1), pages 77-94, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:174:y:2024:i:2:d:10.1007_s11205-024-03400-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.