IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v140y2018i3d10.1007_s11205-017-1799-6.html
   My bibliography  Save this article

Examining Measurement Isomorphism of Multilevel Constructs: The Case of Political Trust

Author

Listed:
  • Anna Ruelens

    (University of Leuven)

  • Bart Meuleman

    (University of Leuven)

  • Ides Nicaise

    (University of Leuven)

Abstract

There is a growing recognition of the importance of testing for measurement equivalence when comparing latent constructs—such as political trust—across countries and over time. Indeed, equivalence of measurements across countries and time points is a precondition for making meaningful and valid comparisons of means, scores, and relationships between constructs. Until recently, most efforts in this area of comparative research have focused on establishing measurement equivalence across groups, such as countries or cultural regions. In contrast, scarce attention has been paid to examining the measurement equivalence of constructs across levels of data. Rather, most empirical studies that use cross-national survey data assume that the factorial structure of a given construct is isomorphic, in other words, similar in measurement and meaning at the individual and country level. This assumption is not always justified, as the dimensions found at the individual level of data do not always generalize to the country level. In such cases, the results and substantive conclusions based on the assumption of measurement isomorphism may be misleading. In this article, we emphasize the importance of examining measurement isomorphism when working with cross-national survey data and describe a testing procedure using multilevel confirmatory factor analysis. We illustrate the procedure by examining cross-level equivalence of the political trust scale included in the European Social Survey (2008–2009). The results of the analysis indicate that the structure of political trust factor can be considered configurally isomorphic across individual and country levels. In addition, the measurement scale across the two levels is found to be partially isomorphic. These findings could be regarded as an encouraging result for the applied researchers who use the aggregated individual scores of political trust. At the same time, we demonstrate that measurement isomorphism cannot be simply assumed and hence should be examined prior to analysis to ensure valid and meaningful results.

Suggested Citation

  • Anna Ruelens & Bart Meuleman & Ides Nicaise, 2018. "Examining Measurement Isomorphism of Multilevel Constructs: The Case of Political Trust," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 140(3), pages 907-927, December.
  • Handle: RePEc:spr:soinre:v:140:y:2018:i:3:d:10.1007_s11205-017-1799-6
    DOI: 10.1007/s11205-017-1799-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-017-1799-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-017-1799-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Harvey Goldstein & Roderick McDonald, 1988. "A general model for the analysis of multilevel data," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 455-467, December.
    2. William Meredith, 1993. "Measurement invariance, factor analysis and factorial invariance," Psychometrika, Springer;The Psychometric Society, vol. 58(4), pages 525-543, December.
    3. Kenneth A. Bollen, 1989. "A New Incremental Fit Index for General Structural Equation Models," Sociological Methods & Research, , vol. 17(3), pages 303-316, February.
    4. Michael W. Browne & Robert Cudeck, 1992. "Alternative Ways of Assessing Model Fit," Sociological Methods & Research, , vol. 21(2), pages 230-258, November.
    5. Daniel Stegmueller, 2013. "How Many Countries for Multilevel Modeling? A Comparison of Frequentist and Bayesian Approaches," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 748-761, July.
    6. Sedef Turper & Kees Aarts, 2017. "Political Trust and Sophistication: Taking Measurement Seriously," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 130(1), pages 415-434, January.
    7. Steenkamp, Jan-Benedict E M & Baumgartner, Hans, 1998. "Assessing Measurement Invariance in Cross-National Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(1), pages 78-90, June.
    8. Sibylle Puntscher & Christoph Hauser & Janette Walde & Gottfried Tappeiner, 2016. "Measuring Social Capital with Aggregated Indicators: A Case of Ecological Fallacy?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 125(2), pages 431-449, January.
    9. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. T. W. G. Meer & E. Ouattara, 2019. "Putting ‘political’ back in political trust: an IRT test of the unidimensionality and cross-national equivalence of political trust measures," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(6), pages 2983-3002, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Janina Isabel Steinert & Lucie Dale Cluver & G. J. Melendez-Torres & Sebastian Vollmer, 2018. "One Size Fits All? The Validity of a Composite Poverty Index Across Urban and Rural Households in South Africa," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(1), pages 51-72, February.
    2. Kroh, Julia & Globocnik, Dietfried & Schultz, Carsten & Holdhof, Frederike & Salomo, Søren, 2024. "Micro-foundations of digital innovation capability – A mixed method approach to develop and validate a multi-dimensional measurement instrument," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    3. Eldad Davidov & Stefan Thörner & Peter Schmidt & Stefanie Gosen & Carina Wolf, 2011. "Level and change of group-focused enmity in Germany: unconditional and conditional latent growth curve models with four panel waves," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 481-500, December.
    4. P. Couper, Mick & Cernat, Alexandru & Beth Ofstedal, Mary, 2015. "Estimation of mode effects in the Health and Retirement Study using measurement models," ISER Working Paper Series 2015-19, Institute for Social and Economic Research.
    5. Carlos Miguel Lemos & Ross Joseph Gore & Ivan Puga-Gonzalez & F LeRon Shults, 2019. "Dimensionality and factorial invariance of religiosity among Christians and the religiously unaffiliated: A cross-cultural analysis based on the International Social Survey Programme," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-36, May.
    6. Eva Padrosa & Mireia Bolíbar & Mireia Julià & Joan Benach, 2021. "Comparing Precarious Employment Across Countries: Measurement Invariance of the Employment Precariousness Scale for Europe (EPRES-E)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 154(3), pages 893-915, April.
    7. Willem E. Saris & André Pirralha & Diana Zavala-Rojas, 2018. "Testing the Comparability of Different Types of Social Indicators Across Groups," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(3), pages 927-939, February.
    8. Yoo, Boonghee & Donthu, Naveen, 2001. "Developing and validating a multidimensional consumer-based brand equity scale," Journal of Business Research, Elsevier, vol. 52(1), pages 1-14, April.
    9. Dmitriy Poznyak & Bart Meuleman & Koen Abts & George Bishop, 2014. "Trust in American Government: Longitudinal Measurement Equivalence in the ANES, 1964–2008," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 118(2), pages 741-758, September.
    10. Alexander Robitzsch, 2020. "L p Loss Functions in Invariance Alignment and Haberman Linking with Few or Many Groups," Stats, MDPI, vol. 3(3), pages 1-38, August.
    11. Rivera, Liliana & Sheffi, Yossi & Knoppen, Desirée, 2016. "Logistics clusters: The impact of further agglomeration, training and firm size on collaboration and value added services," International Journal of Production Economics, Elsevier, vol. 179(C), pages 285-294.
    12. Guido Alessandri & Michele Vecchione & Brent Donnellan & John Tisak, 2013. "An Application of the LC-LSTM Framework to the Self-esteem Instability Case," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 769-792, October.
    13. Nicholas J. Rockwood, 2020. "Maximum Likelihood Estimation of Multilevel Structural Equation Models with Random Slopes for Latent Covariates," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 275-300, June.
    14. Diana Zavala-Rojas & Willem E. Saris, 2018. "Measurement Invariance in Multilingual Survey Research: The Role of the Language of the Questionnaire," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 140(2), pages 485-510, November.
    15. André Pirralha & Wiebke Weber, 2020. "Correction for measurement error in invariance testing: An illustration using SQP," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-18, October.
    16. Yaël Drunen & Bram Spruyt & Filip Droogenbroeck, 2021. "The Salience of Perceived Societal Conflict in Europe: A 27 Country Study on the Development of a Measure for Generalized Conflict Thinking," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 158(2), pages 595-635, December.
    17. Dylan Molenaar, 2015. "Heteroscedastic Latent Trait Models for Dichotomous Data," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 625-644, September.
    18. Leslier Valenzuela-Fernández & Manuel Escobar-Farfán & Mauricio Guerra-Velásquez & Elizabeth Emperatriz García-Salirrosas, 2023. "COVID-19 Effects on Environmentally Responsible Behavior: A Social Impact Perspective from Latin American Countries," IJERPH, MDPI, vol. 20(4), pages 1-21, February.
    19. Dirk Temme & Lutz Hildebrandt, 2009. "Gruppenvergleiche bei hypothetischen Konstrukten — Die Prüfung der Übereinstimmung von Messmodellen mit der Strukturgleichungsmethodik," Schmalenbach Journal of Business Research, Springer, vol. 61(2), pages 138-185, March.
    20. Silvia Platania & Martina Morando & Giuseppe Santisi, 2020. "Psychometric Properties, Measurement Invariance, and Construct Validity of the Italian Version of the Brand Hate Short Scale (BHS)," Sustainability, MDPI, vol. 12(5), pages 1-13, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:140:y:2018:i:3:d:10.1007_s11205-017-1799-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.