IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/syzbr.html
   My bibliography  Save this paper

How to Measure Agreement, Consensus, and Polarization in Ordinal Data

Author

Listed:
  • Aeppli, Clem
  • Ruedin, Didier

    (University of Neuchâtel)

Abstract

Different measures exist to capture agreement, consensus, concentration, dispersion, and polarization in ordinal data. We compare consensus scores across specific situations for a better understanding of how different measures work in practice: constructed cases, simulated data where we know the underlying distribution, and empirical data. Although researchers have solved the ‘problem’ of measuring agreement, consensus, and polarization several times, we highlight similarities and equivalence across some existing approaches, while others differ substantially. The choice of method can lead to substantively different conclusions, and we recommend that researchers use a combination of measures and use graphics to examine the distribution qualitatively.

Suggested Citation

  • Aeppli, Clem & Ruedin, Didier, 2022. "How to Measure Agreement, Consensus, and Polarization in Ordinal Data," SocArXiv syzbr, Center for Open Science.
    • Handle: RePEc:osf:socarx:syzbr
    DOI: 10.31219/osf.io/syzbr
    as

    Download full text from publisher

    File URL: https://osf.io/download/635798e80ecb4222512ebc86/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/syzbr?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Cees Van Der Eijk, 2001. "Measuring Agreement in Ordered Rating Scales," Quality & Quantity: International Journal of Methodology, Springer, vol. 35(3), pages 325-341, August.
    2. João Carvalho & Mariana Carmo Duarte, 2020. "The Politicization of Immigration in Portugal between 1995 and 2014: A European Exception?," Journal of Common Market Studies, Wiley Blackwell, vol. 58(6), pages 1469-1487, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vasiliki Tsagkroni, 2024. "Shaping and Branding Migration Policy: A Retrospective Analysis of Portugal’s Contemporary Model," Media and Communication, Cogitatio Press, vol. 12.
    2. Kyriaki Nanou & Galina Zapryanova & Fanni Toth, 2017. "An ever-closer union? Measuring the expansion and ideological content of European Union policy-making through an expert survey," European Union Politics, , vol. 18(4), pages 678-693, December.
    3. Lindgren, Charlie, 2021. "Discontinuities: What is the value of having the lowest price or highest consumer rating on a price comparison website?," HFI Working Papers 19, Institute of Retail Economics (Handelns Forskningsinstitut).
    4. Joep Burger & Jacqueline Beuningen, 2020. "Measuring well-being dispersion on discrete rating scales," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(3), pages 749-773, June.
    5. Caroline Close & Lidia Nunez Lopez, 2016. "At the root of parliamentary party cohesion: the role of intraparty heterogeneity and party ideology," CEVIPOL Working Papers 1/2016, ULB -- Universite Libre de Bruxelles.
    6. Catherine E. de Vries, 2007. "Sleeping Giant: Fact or Fairytale?," European Union Politics, , vol. 8(3), pages 363-385, September.
    7. Kroh, Martin, 2007. "Measuring Left-Right Political Orientation: The Choice of Response Format," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 71(2), pages 204-220.
    8. Fiachra Kennedy & Pat Lyons & Peter Fitzgerald, 2006. "Pragmatists, Ideologues and the General Law of Curvilinear Disparity: The Case of the Irish Labour Party," Political Studies, Political Studies Association, vol. 54(4), pages 786-805, December.
    9. Martin Kroh, 2005. "Surveying the Left-Right Dimension: The Choice of a Response Format," Discussion Papers of DIW Berlin 491, DIW Berlin, German Institute for Economic Research.
    10. Till Weber, 2007. "Campaign Effects and Second-Order Cycles," European Union Politics, , vol. 8(4), pages 509-536, December.
    11. Joeri Hofmans & Peter Theuns & Frederik Acker, 2009. "Combining quality and quantity. A psychometric evaluation of the self-anchoring scale," Quality & Quantity: International Journal of Methodology, Springer, vol. 43(5), pages 703-716, September.
    12. Dolnicar, Sara & Grün, Bettina, 2009. "Does one size fit all? The suitability of answer formats for different constructs measured," Australasian marketing journal, Elsevier, vol. 17(1), pages 58-64.
    13. Davide Angelucci & Pierangelo Isernia, 2020. "Politicization and security policy: Parties, voters and the European Common Security and Defense Policy," European Union Politics, , vol. 21(1), pages 64-86, March.
    14. Agnieszka Walczak & Wouter van der Brug, 2013. "Representation in the European Parliament: Factors affecting the attitude congruence of voters and candidates in the EP elections," European Union Politics, , vol. 14(1), pages 3-22, March.
    15. Feng Mao & Joshua D. Miller & Sera L. Young & Stefan Krause & David M. Hannah, 2022. "Inequality of household water security follows a Development Kuznets Curve," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    16. Jonathan Reese & Ana Sofia Santos & Tomás A. Palma & Magda Sofia Roberto, 2023. "Triggering competence may protect multiple minority members from hiring discrimination," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-14, December.
    17. Valérie Bérenger & Jacques Silber, 2022. "On the Measurement of Happiness and of its Inequality," Journal of Happiness Studies, Springer, vol. 23(3), pages 861-902, March.
    18. Prakash Kumar Paudel & Rabin Bastola & Sanford D. Eigenbrode & Amaël Borzée & Santosh Thapa & Dana Rad & Jayaraj Vijaya Kumaran & Suganthi Appalasamy & Mohammad Mosharraf Hossain & Anirban Ash & Raju , 2022. "Perspectives of scholars on the origin, spread and consequences of COVID-19 are diverse but not polarized," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-11, December.
    19. Joseph Deutsch & Jacques Silber, 2024. "A summary measure of answers to statements (SMAS) in the case of ordered rating scales," Economics Bulletin, AccessEcon, vol. 44(1), pages 283-294.
    20. Nicolae Tarbă & Mihai-Lucian Voncilă & Costin-Anton Boiangiu, 2022. "On Generalizing Sarle’s Bimodality Coefficient as a Path towards a Newly Composite Bimodality Coefficient," Mathematics, MDPI, vol. 10(7), pages 1-17, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:syzbr. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.