IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v156y2021i2d10.1007_s11205-020-02318-7.html
   My bibliography  Save this article

Statistical Model-Based Composite Indicators for Tracking Coherent Policy Conclusions

Author

Listed:
  • Carlo Cavicchia

    (University of Rome La Sapienza)

  • Maurizio Vichi

    (University of Rome La Sapienza)

Abstract

In the last years, with the data revolution and the use of new technologies, phenomena are frequently described by a huge quantity of information useful for making strategic decisions. A priority for policymakers is having simple statistical tools useful to synthesize data. Such tools are represented by composite indicators (CIs). According to the glossary of statistical terms of OECD (The OECD-JRC handbook on practices for developing composite indicators. Paper presented at the OECD Committee on Statistics, 2004), OECD-JRC (Handbook on constructing composite indicators. Methodology and user guide, OECD, Paris, 2008), a CI is formed when manifest (observed) indicators are compiled into a single index, on the basis of an underlying model of the multi-dimensional concept that is being measured, and weights commonly represent the relative importance of each indicator. CIs are increasingly used for bench-marking countries’ performances and the methodological challenges raise a series of technical issues that, if not adequately addressed, can lead to CIs being misinterpreted or manipulated. Yet doubts are often raised about the robustness of the resulting countries’ rankings and about the significance of the associated policy message. In this paper, we propose a model-based approach for the construction of CIs with a hierarchical structure where the CIs (first and second order) are estimated using the Hierarchical Disjoint Non-Negative Factor Analysis (Cavicchia and Vichi in Hierarchical disjoint non-negative factor analysis. Manuscript submitted for publication, 2020) in a LS framework. In order to assess the methodology of construction of a CI, a set of properties is proposed and applied. Some well-known CIs, such as the Human Development Index and the Multidimensional Poverty index, are taken into consideration to show the importance of those properties. Therefore, we include into our proposal the most frequently used approaches in the literature of CIs, and we evaluate the model to assess their performances.

Suggested Citation

  • Carlo Cavicchia & Maurizio Vichi, 2021. "Statistical Model-Based Composite Indicators for Tracking Coherent Policy Conclusions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 449-479, August.
    • Handle: RePEc:spr:soinre:v:156:y:2021:i:2:d:10.1007_s11205-020-02318-7
    DOI: 10.1007/s11205-020-02318-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-020-02318-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-020-02318-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alkire, Sabina & Foster, James & Seth, Suman & Santos, Maria Emma & Roche, Jose Manuel & Ballon, Paola, 2015. "Multidimensional Poverty Measurement and Analysis," OUP Catalogue, Oxford University Press, number 9780199689491.
    2. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    3. Alkire, Sabina & Foster, James, 2011. "Counting and multidimensional poverty measurement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 476-487, August.
    4. Maurizio Vichi, 2017. "Disjoint factor analysis with cross-loadings," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(3), pages 563-591, September.
    5. Sabina Alkire, 2010. "Human Development: Definitions, Critiques, and Related Concepts," OPHI Working Papers 36, Queen Elizabeth House, University of Oxford.
    6. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    7. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, Jose M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 9 - Distribution and Dynamics," OPHI Working Papers ophiwp090_ch9.pdf, Queen Elizabeth House, University of Oxford.
    8. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, José M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 7 - Data and Analysis," OPHI Working Papers ophiwp088_ch7.pdf, Queen Elizabeth House, University of Oxford.
    9. John Schmid & John Leiman, 1957. "The development of hierarchical factor solutions," Psychometrika, Springer;The Psychometric Society, vol. 22(1), pages 53-61, March.
    10. Jarvis, Cheryl Burke & MacKenzie, Scott B & Podsakoff, Philip M, 2003. "A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(2), pages 199-218, September.
    11. William Revelle & Richard Zinbarg, 2009. "Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 145-154, March.
    12. Sabina Alkire & James E. Foster & Suman Seth & Maria Emma Santos & Jose M. Roche & Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 9 - Distribution and Dynamics," OPHI Working Papers 90, Queen Elizabeth House, University of Oxford.
    13. Natale Carlo Lauro & Maria Gabriella Grassia & Rosanna Cataldo, 2018. "Model Based Composite Indicators: New Developments in Partial Least Squares-Path Modeling for the Building of Different Types of Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(2), pages 421-455, January.
    14. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, José M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 2 - The Framework," OPHI Working Papers ophiwp083_ch2.pdf, Queen Elizabeth House, University of Oxford.
    15. Sabina Alkire & James E. Foster & Suman Seth & Maria Emma Santos & Jose M. Roche & Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 7 - Data and Analysis," OPHI Working Papers 88, Queen Elizabeth House, University of Oxford.
    16. Lawrence Hubert & Phipps Arabie, 1985. "Comparing partitions," Journal of Classification, Springer;The Classification Society, vol. 2(1), pages 193-218, December.
    17. Sabina Alkire & James E. Foster & Suman Seth & Maria Emma Santos & Jose M. Roche & Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 2 - The Framework," OPHI Working Papers 83, Queen Elizabeth House, University of Oxford.
    18. Farhad Noorbakhsh, 1998. "The human development index: some technical issues and alternative indices," Journal of International Development, John Wiley & Sons, Ltd., vol. 10(5), pages 589-605.
    19. Robert Wherry, 1959. "Hierarchical factor solutions without rotation," Psychometrika, Springer;The Psychometric Society, vol. 24(1), pages 45-51, March.
    20. Kenneth Bollen, 1984. "Multiple indicators: Internal consistency or no necessary relationship?," Quality & Quantity: International Journal of Methodology, Springer, vol. 18(4), pages 377-385, August.
    21. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    22. Sagar, Ambuj D. & Najam, Adil, 1998. "The human development index: a critical review," Ecological Economics, Elsevier, vol. 25(3), pages 249-264, June.
    23. D K Despotis, 2005. "A reassessment of the human development index via data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 969-980, August.
    24. Richard Zinbarg & William Revelle & Iftah Yovel & Wen Li, 2005. "Cronbach’s α, Revelle’s β, and Mcdonald’s ω H : their relations with each other and two alternative conceptualizations of reliability," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 123-133, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arvind Sharma & Aleksandar Tomic & Lawrence Fulton, 2024. "Evaluating and Improving the Metropolitan Economic Freedom Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 175(2), pages 445-466, November.
    2. Carlo Cavicchia & Pasquale Sarnacchiaro, 2024. "A new hierarchical composite indicator model for ranking the top 20 European football teams," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(5), pages 4033-4051, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paolo Liberati & Giuliano Resce & Francesca Tosi, 2023. "The probability of multidimensional poverty: A new approach and an empirical application to EU‐SILC data," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(3), pages 668-700, September.
    2. Jacob Katuva & Rob Hope & Tim Foster & Johanna Koehler & Patrick Thomson, 2020. "Modelling Welfare Transitions to Prioritise Sustainable Development Interventions in Coastal Kenya," Sustainability, MDPI, vol. 12(17), pages 1-22, August.
    3. Abre-Rehmat Qurat-ul-Ann & Faisal Mehmood Mirza, 2021. "Multidimensional Energy Poverty in Pakistan: Empirical Evidence from Household Level Micro Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 211-258, May.
    4. Pinaki Das & Bibek Paria & Shama Firdaush, 2021. "Juxtaposing Consumption Poverty and Multidimensional Poverty: A Study in Indian Context," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(2), pages 469-501, January.
    5. Tavares, Fernando Flores & Betti, Gianni, 2021. "The pandemic of poverty, vulnerability, and COVID-19: Evidence from a fuzzy multidimensional analysis of deprivations in Brazil," World Development, Elsevier, vol. 139(C).
    6. Zaira Najam & John Gibson, 2022. "Does intra‐country poverty convergence depend on spatial spillovers and the type of poverty measure? Evidence from Pakistan," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 9(3), pages 516-535, September.
    7. Gaurav Datt, 2019. "Multidimensional poverty in the Philippines, 2004–2013: How much do choices for weighting, identification and aggregation matter?," Empirical Economics, Springer, vol. 57(4), pages 1103-1128, October.
    8. Dutta, Indranil & Nogales, Ricardo & Yalonetzky, Gaston, 2021. "Endogenous weights and multidimensional poverty: A cautionary tale," Journal of Development Economics, Elsevier, vol. 151(C).
    9. Brandolini, Andrea & Micklewright, John, 2020. "Tony Atkinson's New Book, Measuring Poverty around the World: Some Further Reflections," IZA Discussion Papers 12890, Institute of Labor Economics (IZA).
    10. Zaira Najam & Susan Olivia, 2021. "Does the impact of cash transfers differ across poverty measures? Evidence from Pakistan," Working Papers in Economics 21/09, University of Waikato.
    11. Grant J. Cameron & Hai‐Anh H. Dang & Mustafa Dinc & James Foster & Michael M. Lokshin, 2021. "Measuring the Statistical Capacity of Nations," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(4), pages 870-896, August.
    12. Zaira Najam & John Gibson, 2021. "Does within-country poverty convergence depend on spatial spillovers and the type of poverty measure? Evidence from Pakistan," Working Papers in Economics 21/07, University of Waikato.
    13. Najam, Zaira, 2020. "The Sensitivity of Poverty Trends to Dimensionality and Distribution Sensitivity in Poverty Measures - District Level Analysis for Pakistan," MPRA Paper 102383, University Library of Munich, Germany.
    14. Nicolai Suppa, 2021. "Walls of glass. Measuring deprivation in social participation," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(2), pages 385-411, June.
    15. Bénédicte Apouey & David Madden, 2023. "Health poverty," Chapters, in: Jacques Silber (ed.), Research Handbook on Measuring Poverty and Deprivation, chapter 19, pages 202-211, Edward Elgar Publishing.
    16. Kahouli, Sondès & Okushima, Shinichiro, 2021. "Regional energy poverty reevaluated: A direct measurement approach applied to France and Japan," Energy Economics, Elsevier, vol. 102(C).
    17. Cecilia Njoroge & Anja Smith & Marisa von Fintel, 2024. "Inequalities in Water Insecurity in Kenya: A Multidimensional Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 175(1), pages 171-193, October.
    18. Ren, Zhiyuan & Zhu, Yuhan & Jin, Canyang & Xu, Aiting, 2023. "Social capital and energy poverty: Empirical evidence from China," Energy, Elsevier, vol. 267(C).
    19. Khaufelo Raymond Lekobane & Keetie Roelen, 2020. "Leaving No One Behind: Multidimensional Child Poverty in Botswana," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 13(6), pages 2003-2030, December.
    20. Decerf,Benoit Marie A & Ferrando,Mery & Quinn,Natalie N., 2021. "Global Income Poverty Measurement with Preference Heterogeneity : Theory and Application," Policy Research Working Paper Series 9844, The World Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:156:y:2021:i:2:d:10.1007_s11205-020-02318-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.