IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i3d10.1007_s11135-022-01466-x.html
   My bibliography  Save this article

Measures of state capacity: so similar, yet so different

Author

Listed:
  • Andrea Vaccaro

    (University of Insubria
    United Nations University)

Abstract

This study provides a systematic comparative analysis of seven common cross-national measures of state capacity by focusing on three measurement issues: convergent validity, interchangeability, and case-specific disagreement. The author finds that the convergent validity of the measures is high, but the interchangeability of the measures is low. This means that even highly correlated measures of state capacity can lead to completely different statistical inferences. The cause of this puzzling finding lies in strikingly large disagreements on some of the country scores. The author shows that these disagreements depend on two factors: differences in underlying components and the level of state capacity. Considering the findings of this study, users of measures of state capacity must not assume that any highly correlated indicator is appropriate. They should instead look at what the indicators actually measure and ensure that a given definition of state capacity matches the chosen indicator.

Suggested Citation

  • Andrea Vaccaro, 2023. "Measures of state capacity: so similar, yet so different," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(3), pages 2281-2302, June.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:3:d:10.1007_s11135-022-01466-x
    DOI: 10.1007/s11135-022-01466-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01466-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01466-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Adcock, Robert & Collier, David, 2001. "Measurement Validity: A Shared Standard for Qualitative and Quantitative Research," American Political Science Review, Cambridge University Press, vol. 95(3), pages 529-546, September.
    2. Grassi, Davide & Memoli, Vincenzo, 2016. "Political Determinants of State Capacity in Latin America," World Development, Elsevier, vol. 88(C), pages 94-106.
    3. Timothy Besley & Torsten Persson, 2008. "Wars and State Capacity," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 522-530, 04-05.
    4. Hiilamo, Heikki & Glantz, Stanton A., 2015. "Implementation of effective cigarette health warning labels among low and middle income countries: State capacity, path-dependency and tobacco industry activity," Social Science & Medicine, Elsevier, vol. 124(C), pages 241-245.
    5. Balzhan Serikbayeva & Kanat Abdulla & Yessengali Oskenbayev, 2021. "State Capacity in Responding to COVID-19," International Journal of Public Administration, Taylor & Francis Journals, vol. 44(11-12), pages 920-930, September.
    6. Walther, Daniel & Hellström, Johan & Bergman, Torbjörn, 2019. "Government instability and the state," Political Science Research and Methods, Cambridge University Press, vol. 7(3), pages 579-594, July.
    7. Jimenez-Ayora, Pablo & Ulubaşoğlu, Mehmet Ali, 2015. "What underlies weak states? The role of terrain ruggedness," European Journal of Political Economy, Elsevier, vol. 39(C), pages 167-183.
    8. Omar Shahabudin McDoom & Rachel M. Gisselquist, 2016. "The Measurement of Ethnic and Religious Divisions: Spatial, Temporal, and Categorical Dimensions with Evidence from Mindanao, the Philippines," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(2), pages 863-891, November.
    9. Dincecco, Mark, 2015. "The Rise of Effective States in Europe," The Journal of Economic History, Cambridge University Press, vol. 75(3), pages 901-918, September.
    10. Antonio Savoia & Kunal Sen, 2015. "Measurement, Evolution, Determinants, And Consequences Of State Capacity: A Review Of Recent Research," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 441-458, July.
    11. Jörn Grävingholt & Sebastian Ziaja & Merle Kreibaum, 2015. "Disaggregating state fragility: a method to establish a multidimensional empirical typology," Third World Quarterly, Taylor & Francis Journals, vol. 36(7), pages 1281-1298, July.
    12. Joshi, Devin K. & Hughes, Barry B. & Sisk, Timothy D., 2015. "Improving Governance for the Post-2015 Sustainable Development Goals: Scenario Forecasting the Next 50years," World Development, Elsevier, vol. 70(C), pages 286-302.
    13. Tewodaj Mogues & Alvina Erman, 2020. "Institutional arrangements to make public spending responsive to the poor: When intent meets political economy realities," Development Policy Review, Overseas Development Institute, vol. 38(1), pages 100-123, January.
    14. Casper, Gretchen & Tufis, Claudiu, 2003. "Correlation Versus Interchangeability: The Limited Robustness of Empirical Findings on Democracy Using Highly Correlated Data Sets," Political Analysis, Cambridge University Press, vol. 11(02), pages 196-203, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lola Nacke & Vadim Vinichenko & Aleh Cherp & Avi Jakhmola & Jessica Jewell, 2024. "Compensating affected parties necessary for rapid coal phase-out but expensive if extended to major emitters," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    2. Rachel M. Gisselquist & Patricia Justino & Andrea Vaccaro, 2024. "Do the principles of effective development co‐operation improve development outcomes? The case for clearer definitions and measurement," Development Policy Review, Overseas Development Institute, vol. 42(1), January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Colin O'Reilly & Ryan H. Murphy, 2022. "An Index Measuring State Capacity, 1789–2018," Economica, London School of Economics and Political Science, vol. 89(355), pages 713-745, July.
    2. Ryan H. Murphy & Colin O’Reilly, 2023. "Freedom through taxation: the effect of fiscal capacity on the rule of law," European Journal of Law and Economics, Springer, vol. 56(1), pages 69-90, August.
    3. Vanessa Alexandra Boese & Matthew Charles Wilson, 2023. "Contestation and participation: Concepts, measurement, and inference," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 26(2), pages 89-106, June.
    4. Becker, Sascha O. & Ferrara, Andreas & Melander, Eric & Pascali, Luigi, 2018. "Wars, Local Political Institutions, and Fiscal Capacity: Evidence from Six Centuries of German History," CAGE Online Working Paper Series 395, Competitive Advantage in the Global Economy (CAGE).
    5. Bernhard Reinsberg & Alexander Kentikelenis & Thomas Stubbs & Lawrence King & Centre for Business Research, 2018. "The World System & the Hollowing-out of State Capacity: How Structural Adjustment Programs Impact Bureaucratic Quality in Developing Countries," Working Papers wp503, Centre for Business Research, University of Cambridge.
    6. Marco Gallegati & Massimo Tamberi, 2022. "Long swings in the growth of government expenditure: an international historical perspective," Public Choice, Springer, vol. 192(3), pages 227-248, September.
    7. Grier, Robin & Young, Andrew T. & Grier, Kevin, 2022. "The causal effects of rule of law & property rights on fiscal capacity," European Journal of Political Economy, Elsevier, vol. 74(C).
    8. Davide Cantoni & Cathrin Mohr & Matthias Weigand, 2024. "The Rise of Fiscal Capacity: Administration and State Consolidation in the Holy Roman Empire," Econometrica, Econometric Society, vol. 92(5), pages 1439-1472, September.
    9. Ennio E. Piano, 2019. "State capacity and public choice: a critical survey," Public Choice, Springer, vol. 178(1), pages 289-309, January.
    10. Rachel M. Gisselquist & Andrea Vaccaro, 2023. "COVID‐19 and the state: Exploring a puzzling relationship in the early stages of the pandemic," Journal of International Development, John Wiley & Sons, Ltd., vol. 35(5), pages 800-819, July.
    11. Geloso, Vincent J. & Salter, Alexander W., 2020. "State capacity and economic development: Causal mechanism or correlative filter?," Journal of Economic Behavior & Organization, Elsevier, vol. 170(C), pages 372-385.
    12. Becker, Sascha O. & Ferrara, Andreas & Melander, Eric & Pascali, Luigi, 2018. "Wars, Local Political Institutions, and Fiscal Capacity: Evidence from Six Centuries of German History," CAGE Online Working Paper Series 395, Competitive Advantage in the Global Economy (CAGE).
    13. Jørgen Møller & Svend-Erik Skaaning, 2014. "Respect for Civil Liberties During the Third Wave of Democratization: Presenting a New Dataset," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(3), pages 1069-1087, July.
    14. Diana Ricciulli-Marín, 2020. "The Fiscal Cost of Conflict: Evidence from La Violencia in Colombia," Cuadernos de Historia Económica 53, Banco de la Republica de Colombia.
    15. Mark Harrison & Nikolaus Wolf, 2014. "The Frequency of Wars," World Scientific Book Chapters, in: THE ECONOMICS OF COERCION AND CONFLICT, chapter 5, pages 121-149, World Scientific Publishing Co. Pte. Ltd..
    16. Schakel, Arjan Hille, 2009. "A Postfunctionalist Theory of Regional Government," MPRA Paper 21596, University Library of Munich, Germany.
    17. Massimiliano Cal� & Sami H. Miaari, 2014. "Trade, employment and conflict: Evidence from the Second Intifada," HiCN Working Papers 186, Households in Conflict Network.
    18. Yapatake Kossele Thales Pacific, 2020. "Fragility of State in Central African Republic: An Econometric Approach to Efficiency Understanding," Global Business Review, International Management Institute, vol. 21(3), pages 681-697, June.
    19. David Martimort & Aggey Semenov & Lars Stole, 2017. "A Theory of Contracts with Limited Enforcement," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 816-852.
    20. Zim Nwokora & Riccardo Pelizzo, 2017. "Measuring Party System Change: A Systems Perspective," Research Africa Network Working Papers 17/048, Research Africa Network (RAN).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:3:d:10.1007_s11135-022-01466-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.