IDEAS home Printed from https://ideas.repec.org/a/cog/poango/v6y2018i1p92-104.html
   My bibliography  Save this article

Method Factors in Democracy Indicators

Author

Listed:
  • Martin Elff

    (Faculty of Political & Social Sciences, Zeppelin University, Germany)

  • Sebastian Ziaja

    (Research Center for Distributional Conflict and Globalization, Heidelberg University, Germany)

Abstract

Method factors represent variance common to indicators from the same data source. Detecting method factors can help uncover systematic bias in data sources. This article employs confirmatory factor analysis (CFA) to detect method factors in 23 democracy indicators from four popular data sources: The Economist Intelligence Unit (EIU), Freedom House, Polity IV, and the Varieties of Democracy (V-Dem) project. Using three different multi-dimensional concepts of democracy as starting points, we find strong evidence for method factors in all sources. Method-specific factors are strongest when yearly changes in the scores are assessed. The sources find it easier to agree on long-term average scores. We discuss the implications for applied researchers.

Suggested Citation

  • Martin Elff & Sebastian Ziaja, 2018. "Method Factors in Democracy Indicators," Politics and Governance, Cogitatio Press, vol. 6(1), pages 92-104.
    • Handle: RePEc:cog:poango:v6:y:2018:i:1:p:92-104
    DOI: 10.17645/pag.v6i1.1235
    as

    Download full text from publisher

    File URL: https://www.cogitatiopress.com/politicsandgovernance/article/view/1235
    Download Restriction: no
    File URL: https://libkey.io/10.17645/pag.v6i1.1235?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Adcock, Robert & Collier, David, 2001. "Measurement Validity: A Shared Standard for Qualitative and Quantitative Research," American Political Science Review, Cambridge University Press, vol. 95(3), pages 529-546, September.
    2. Pemstein, Daniel & Meserve, Stephen A. & Melton, James, 2010. "Democratic Compromise: A Latent Variable Analysis of Ten Measures of Regime Type," Political Analysis, Cambridge University Press, vol. 18(4), pages 426-449.
    3. Merkel, Wolfgang, 2004. "Embedded and defective democracies," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 11(5), pages 33-58.
    4. Thorsten Beck & George Clarke & Alberto Groff & Philip Keefer & Patrick Walsh, 2001. "New Tools in Comparative Political Economy: The Database of Political Institutions," The World Bank Economic Review, World Bank, vol. 15(1), pages 165-16-176.
    5. José Cheibub & Jennifer Gandhi & James Vreeland, 2010. "Democracy and dictatorship revisited," Public Choice, Springer, vol. 143(1), pages 67-101, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heiko Giebler & Saskia P. Ruth & Dag Tanneberg, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," Politics and Governance, Cogitatio Press, vol. 6(1), pages 1-10.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Elff & Sebastian Ziaja, 2018. "Method Factors in Democracy Indicators," Politics and Governance, Cogitatio Press, vol. 6(1), pages 92-104.
    2. Nuno Garoupa & Rok Spruk, 2024. "Measuring Political Institutions in the Long Run: A Latent Variable Analysis of Political Regimes, 1810–2018," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 173(3), pages 867-914, July.
    3. Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.
    4. Heiko Giebler & Saskia P. Ruth & Dag Tanneberg, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," Politics and Governance, Cogitatio Press, vol. 6(1), pages 1-10.
    5. Gründler, Klaus & Krieger, Tommy, 2022. "Should we care (more) about data aggregation?," European Economic Review, Elsevier, vol. 142(C).
    6. Giebler, Heiko & Ruth, Saskia P. & Tanneberg, Dag, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 6(1), pages 1-10.
    7. Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.
    8. Heiko Giebler & Saskia P. Ruth & Dag Tanneberg, 2018. "Why Choice Matters: Revisiting and Comparing Measures of Democracy," Politics and Governance, Cogitatio Press, vol. 6(1), pages 1-10.
    9. Michal Madr, 2016. "Economic Development as a Factor of Democratisation: Evidence from Post-Socialist Economies," MENDELU Working Papers in Business and Economics 2016-70, Mendel University in Brno, Faculty of Business and Economics.
    10. Vanessa Alexandra Boese & Matthew Charles Wilson, 2023. "Contestation and participation: Concepts, measurement, and inference," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 26(2), pages 89-106, June.
    11. Mariam Mufti, 2018. "What Do We Know about Hybrid Regimes after Two Decades of Scholarship?," Politics and Governance, Cogitatio Press, vol. 6(2), pages 112-119.
    12. Alberto Batinti & Joan Costa‐Font & Timothy J. Hatton, 2022. "Voting Up? The Effects of Democracy and Franchise Extension on Human Stature," Economica, London School of Economics and Political Science, vol. 89(353), pages 161-190, January.
    13. Espen Geelmuyden Rød & Carl Henrik Knutsen & Håvard Hegre, 2020. "The determinants of democracy: a sensitivity analysis," Public Choice, Springer, vol. 185(1), pages 87-111, October.
    14. Christopher J Fariss & James Lo, 2020. "Innovations in concepts and measurement for the study of peace and conflict," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(6), pages 669-678, November.
    15. Maerz, Seraphine F. & Edgell, Amanda B. & Wilson, Matthew C. & Hellmeier, Sebastian & Lindberg, Staffan I., 2024. "Episodes of regime transformation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 61(6), pages 967-984.
    16. Klaus Gründler & Tommy Krieger, 2019. "Should We Care (More) About Data Aggregation? Evidence from Democracy Indices," CESifo Working Paper Series 7480, CESifo.
    17. Kerner, Andrew & Crabtree, Charles, 2018. "The Political Economy of Data Production," SocArXiv qsxae, Center for Open Science.
    18. Vanessa A Boese, 2019. "How (not) to measure democracy," International Area Studies Review, Center for International Area Studies, Hankuk University of Foreign Studies, vol. 22(2), pages 95-127, June.
    19. Gründler, Klaus & Krieger, Tommy, 2016. "Democracy and growth: Evidence from a machine learning indicator," European Journal of Political Economy, Elsevier, vol. 45(S), pages 85-107.
    20. Nikolova, Elena & Polansky, Jakub, 2020. "Conversionary Protestants do not cause democracy," GLO Discussion Paper Series 480, Global Labor Organization (GLO).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cog:poango:v6:y:2018:i:1:p:92-104. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: António Vieira or IT Department (email available below). General contact details of provider: https://www.cogitatiopress.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.