IDEAS home Printed from https://ideas.repec.org/p/unu/wpaper/wp-2013-068.html
   My bibliography  Save this paper

Evaluating Governance Indexes: Critical and Less Critical Questions

Author

Listed:
  • Rachel M. Gisselquist

Abstract

Recent years have seen a proliferation of 'composite indicators' or 'indexes' of governance. Such measures can be useful tools for analysing governance, making public policy, building scientific knowledge, and even influencing ruling elites, but some are better tools than others and some are better suited to certain purposes than others. This paper provides a framework of ten questions to help users and producers of governance indexes to evaluate them and consider key components of index design.

Suggested Citation

  • Rachel M. Gisselquist, 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series wp-2013-068, World Institute for Development Economic Research (UNU-WIDER).
    • Handle: RePEc:unu:wpaper:wp-2013-068
    as

    Download full text from publisher

    File URL: https://www.wider.unu.edu/sites/default/files/WP2013-068.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Knoll, Martin & Zloczysti, Petra, 2012. "The Good Governance Indicators of the Millennium Challenge Account: How Many Dimensions are Really Being Measured?," World Development, Elsevier, vol. 40(5), pages 900-915.
    3. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    4. Daniel Kaufmann & Aart Kraay, 2008. "Governance Indicators: Where Are We, Where Should We Be Going?," The World Bank Research Observer, World Bank, vol. 23(1), pages 1-30, January.
    5. repec:unu:wpaper:wp2012-93 is not listed on IDEAS
    6. Laitin, David D., 1995. "Disciplining Political Science," American Political Science Review, Cambridge University Press, vol. 89(2), pages 454-456, June.
    7. Matt Andrews, 2008. "The Good Governance Agenda: Beyond Indicators without Theory," Oxford Development Studies, Taylor & Francis Journals, vol. 36(4), pages 379-407.
    8. Sabina Alkire, 2010. "Human Development: Definitions, Critiques, and Related Concepts," OPHI Working Papers 36, Queen Elizabeth House, University of Oxford.
    9. Round, Jeffery I., 2012. "Aid and Investment in Statistics for Africa," WIDER Working Paper Series 093, World Institute for Development Economic Research (UNU-WIDER).
    10. Gisselquist, Rachel M., 2012. "Good Governance as a Concept, and Why This Matters for Development Policy," WIDER Working Paper Series 030, World Institute for Development Economic Research (UNU-WIDER).
    11. Elizabeth Stanton, 2007. "The Human Development Index: A History," Working Papers wp127, Political Economy Research Institute, University of Massachusetts at Amherst.
    12. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    13. Matt Andrews & Roger Hay & Jerrett Myers, 2010. "Can Governance Indicators Make Sense? Towards a New Approach to Sector-Specific Measures of Governance," Oxford Development Studies, Taylor & Francis Journals, vol. 38(4), pages 391-410.
    14. Gingerich, Daniel W., 2013. "Governance Indicators and the Level of Analysis Problem: Empirical Findings from South America," British Journal of Political Science, Cambridge University Press, vol. 43(3), pages 505-540, July.
    15. Jeffery I. Round, 2012. "Aid and Investment in Statistics for Africa," WIDER Working Paper Series wp-2012-093, World Institute for Development Economic Research (UNU-WIDER).
    16. Farhad Noorbakhsh, 1998. "The human development index: some technical issues and alternative indices," Journal of International Development, John Wiley & Sons, Ltd., vol. 10(5), pages 589-605.
    17. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    18. Charles P. Oman & Christiane Arndt, 2006. "Governance Indicators for Development," OECD Development Centre Policy Insights 33, OECD Publishing.
    19. repec:unu:wpaper:wp2012-30 is not listed on IDEAS
    20. Kaufmann, Daniel & Kraay, Aart & Zoido-Lobaton, Pablo, 1999. "Aggregating governance indicators," Policy Research Working Paper Series 2195, The World Bank.
    21. Charles P. Oman & Christiane Arndt, 2010. "Measuring Governance," OECD Development Centre Policy Briefs 39, OECD Publishing.
    22. Rachel M. Gisselquist, 2012. "Good Governance as a Concept, and Why This Matters for Development Policy," WIDER Working Paper Series wp-2012-030, World Institute for Development Economic Research (UNU-WIDER).
    23. Williams, Andrew, 2009. "On the release of information by governments: Causes and consequences," Journal of Development Economics, Elsevier, vol. 89(1), pages 124-138, May.
    24. repec:bla:devpol:v:25:y:2007:i:5:p:533-574 is not listed on IDEAS
    25. repec:dau:papers:123456789/4352 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michener, Gregory, 2015. "Policy Evaluation via Composite Indexes: Qualitative Lessons from International Transparency Policy Indexes," World Development, Elsevier, vol. 74(C), pages 184-196.
    2. Helmut K. Anheier & Markus Lang & Edward L. Knudsen, 2023. "Introducing the Berggruen Governance Index I: Conceptual and methodological framework," Global Policy, London School of Economics and Political Science, vol. 14(S4), pages 5-15, October.
    3. Helmut K. Anheier & Regina A. List & Edward L. Knudsen, 2023. "Advancing governance indicator systems: Lessons learned from the 2022 symposium," Global Policy, London School of Economics and Political Science, vol. 14(S4), pages 136-146, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gisselquist, Rachel M., 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series 068, World Institute for Development Economic Research (UNU-WIDER).
    2. Michener, Gregory, 2015. "Policy Evaluation via Composite Indexes: Qualitative Lessons from International Transparency Policy Indexes," World Development, Elsevier, vol. 74(C), pages 184-196.
    3. Gaoussou Diarra & Patrick Plane, 2014. "Assessing the World Bank's Influence on the Good Governance Paradigm," Oxford Development Studies, Taylor & Francis Journals, vol. 42(4), pages 473-487, December.
    4. Mireille Razafindrakoto & François Roubaud, 2018. "Responding to the SDG16 Measurement Challenge: The Governance, Peace and Security Survey Modules in Africa," Global Policy, London School of Economics and Political Science, vol. 9(3), pages 336-351, September.
    5. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    6. Muhammad Azam, 2022. "Governance and Economic Growth: Evidence from 14 Latin America and Caribbean Countries," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(2), pages 1470-1495, June.
    7. Tobin Im & Kris Hartley, 2019. "Aligning Needs and Capacities to Boost Government Competitiveness," Public Organization Review, Springer, vol. 19(1), pages 119-137, March.
    8. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    9. Daniel Kaufmann & Aart Kraay, 2008. "Governance Indicators: Where Are We, Where Should We Be Going?," The World Bank Research Observer, World Bank, vol. 23(1), pages 1-30, January.
    10. Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.
    11. Chiraag Roy, 2020. "Rethinking Australia’s aid programme to Myanmar: Good governance and “informal constraints”," Development Policy Review, Overseas Development Institute, vol. 38(5), pages 630-645, September.
    12. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    13. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    14. Cantone, Giulio Giacomo & Tomaselli, Venera, 2024. "On the Coherence of Composite Indexes: Multiversal Model and Specification Analysis for an Index of Well-Being," MetaArXiv d5y26, Center for Open Science.
    15. Qu, Guangjun & Slagter, Bob & Sylwester, Kevin & Doiron, Kyle, 2019. "Explaining the standard errors of corruption perception indices," Journal of Comparative Economics, Elsevier, vol. 47(4), pages 907-920.
    16. María del Carmen Bas & Stefano Tarantola & José Miguel Carot & Andrea Conchado, 2017. "Sensitivity Analysis: A Necessary Ingredient for Measuring the Quality of a Teaching Activity Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 131(3), pages 931-946, April.
    17. Laura Langbein & Stephen Knack, 2010. "The Worldwide Governance Indicators: Six, One, or None?," Journal of Development Studies, Taylor & Francis Journals, vol. 46(2), pages 350-370.
    18. José-Miguel Bello y Villarino, 2021. "Measuring Corruption: A Critical Analysis of the Existing Datasets and Their Suitability for Diachronic Transnational Research," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 709-747, September.
    19. Stritzke, Susann & Trotter, Philipp A. & Twesigye, Peter, 2021. "Towards responsive energy governance: Lessons from a holistic analysis of energy access in Uganda and Zambia," Energy Policy, Elsevier, vol. 148(PA).
    20. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unu:wpaper:wp-2013-068. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Siméon Rapin (email available below). General contact details of provider: https://edirc.repec.org/data/widerfi.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.