IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i4d10.1007_s11135-023-01801-w.html
   My bibliography  Save this article

Assessing conceptual comparability of single-item survey instruments with a mixed-methods approach

Author

Listed:
  • Ranjit Konrad Singh

    (GESIS – Leibniz Institute for the Social Sciences)

  • Cornelia Eva Neuert

    (GESIS – Leibniz Institute for the Social Sciences)

  • Tenko Raykov

    (Michigan State University)

Abstract

An increasing number of research projects and infrastructure services involve pooling data across different survey programs. Creating a homogenous integrated dataset from heterogeneous source data is the domain of ex-post harmonization. The harmonization process involves various considerations. However, chief among them is whether two survey measurement instruments have captured the same concept. This issue of conceptual comparability is a fundamental precondition for pooling different source variables to form a harmonized target variable. Our paper explores this issue with a mixed-methods approach. On the one hand, we use psychometric latent variable modeling by presenting several single-item wordings for social trust to respondents and then performing factor analytic procedures. On the other hand, we complement and contrast these quantitative findings with qualitative findings gained with an open-ended web probe. The combined approach gave valuable insights into the conceptual comparability of the eleven social-trust-related single-item wordings. For example, we find that negative, distrust-related wordings and positive, trust-related wordings should not be pooled into an integrated variable. However, the paper will also illustrate and discuss why it is easier to disprove conceptual comparability than fully prove it.

Suggested Citation

  • Ranjit Konrad Singh & Cornelia Eva Neuert & Tenko Raykov, 2024. "Assessing conceptual comparability of single-item survey instruments with a mixed-methods approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(4), pages 3303-3329, August.
    • Handle: RePEc:spr:qualqt:v:58:y:2024:i:4:d:10.1007_s11135-023-01801-w
    DOI: 10.1007/s11135-023-01801-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01801-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-023-01801-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giovanni Maria Giorgi & Chiara Gigliarano, 2017. "The Gini Concentration Index: A Review Of The Inference Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 31(4), pages 1130-1148, September.
    2. Patti Tamara Lenard, 2008. "Trust Your Compatriots, but Count Your Change: The Roles of Trust, Mistrust and Distrust in Democracy," Political Studies, Political Studies Association, vol. 56, pages 312-332, June.
    3. Michael Naef & Jürgen Schupp, 2009. "Measuring Trust: Experiments and Surveys in Contrast and Combination," SOEPpapers on Multidisciplinary Panel Data Research 167, DIW Berlin, The German Socio-Economic Panel (SOEP).
    4. Patti Tamara Lenard, 2008. "Trust Your Compatriots, but Count Your Change: The Roles of Trust, Mistrust and Distrust in Democracy," Political Studies, Political Studies Association, vol. 56(2), pages 312-332, June.
    5. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grande, Edgar & Gonzatti, Daniel Saldivia, 2024. "A revolt of the distrustful? Political trust, political protest and the democratic deficit," Discussion Papers, Research Unit: Center for Civil Society Research ZZ 2024-603, WZB Berlin Social Science Center.
    2. Robert F. Kane & Ching-Yang Lin, 2019. "Up(and down)-skilling and directed technical change," Working Papers EMS_2019_03, Research Institute, International University of Japan.
    3. Barak Hermesh & Anat Rosenthal & Nadav Davidovitch, 2020. "The cycle of distrust in health policy and behavior: Lessons learned from the Negev Bedouin," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-20, August.
    4. Nina Wiesehomeier & Saskia P. Ruth-Lovell, 2024. "Trust the People? Populism, Trust, and Support for Direct Democracy," Politics and Governance, Cogitatio Press, vol. 12.
    5. Nurmi, Johanna & Jaakola, Joni, 2023. "Losing trust: Processes of vaccine hesitancy in parents’ narratives," Social Science & Medicine, Elsevier, vol. 331(C).
    6. Sonia Nawrocka & Hans De Witte & Margherita Pasini & Margherita Brondino, 2023. "A Person-Centered Approach to Job Insecurity: Is There a Reciprocal Relationship between the Quantitative and Qualitative Dimensions of Job Insecurity?," IJERPH, MDPI, vol. 20(7), pages 1-27, March.
    7. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    8. Masashi Soga & Kevin J. Gaston & Yuichi Yamaura & Kiyo Kurisu & Keisuke Hanaki, 2016. "Both Direct and Vicarious Experiences of Nature Affect Children’s Willingness to Conserve Biodiversity," IJERPH, MDPI, vol. 13(6), pages 1-12, May.
    9. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    10. Nathaniel Oliver Iotti & Damiano Menin & Tomas Jungert, 2022. "Early Adolescents’ Motivations to Defend Victims of Cyberbullying," IJERPH, MDPI, vol. 19(14), pages 1-9, July.
    11. AJ Golio, 2024. "Whose Neighborhood Now? Gentrification and Community Life in Low-Income Urban Neighborhoods," Working Papers 24-29, Center for Economic Studies, U.S. Census Bureau.
    12. Peter Tavel & Bibiana Jozefiakova & Peter Telicak & Jana Furstova & Michal Puza & Natalia Kascakova, 2022. "Psychometric Analysis of the Shortened Version of the Spiritual Well-Being Scale on the Slovak Population (SWBS-Sk)," IJERPH, MDPI, vol. 19(1), pages 1-12, January.
    13. Allen, Jaime & Eboli, Laura & Forciniti, Carmen & Mazzulla, Gabriella & Ortúzar, Juan de Dios, 2019. "The role of critical incidents and involvement in transit satisfaction and loyalty," Transport Policy, Elsevier, vol. 75(C), pages 57-69.
    14. Christoph Dworschak, 2024. "Bias mitigation in empirical peace and conflict studies: A short primer on posttreatment variables," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(3), pages 462-476, May.
    15. Andreea-Ionela Puiu & Anca Monica Ardeleanu & Camelia Cojocaru & Anca Bratu, 2021. "Exploring the Effect of Status Quo, Innovativeness, and Involvement Tendencies on Luxury Fashion Innovations: The Mediation Role of Status Consumption," Mathematics, MDPI, vol. 9(9), pages 1-18, May.
    16. Slupphaug, KJell & Mehmetoglu, Mehmet & Mittner, Matthias, 2024. "modsem: An R package for estimating latent interactions and quadratic effects," OSF Preprints h3rpw, Center for Open Science.
    17. Andres Trujillo-Barrera & Joost M. E. Pennings & Dianne Hofenk, 2016. "Understanding producers' motives for adopting sustainable practices: the role of expected rewards, risk perception and risk tolerance," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 43(3), pages 359-382.
    18. Daria J. Kuss & Lydia Harkin & Eiman Kanjo & Joel Billieux, 2018. "Problematic Smartphone Use: Investigating Contemporary Experiences Using a Convergent Design," IJERPH, MDPI, vol. 15(1), pages 1-16, January.
    19. Allen, Jaime & Muñoz, Juan Carlos & Ortúzar, Juan de Dios, 2019. "On evasion behaviour in public transport: Dissatisfaction or contagion?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 626-651.
    20. Cloarec, Julien, 2022. "Privacy controls as an information source to reduce data poisoning in artificial intelligence-powered personalization," Journal of Business Research, Elsevier, vol. 152(C), pages 144-153.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:4:d:10.1007_s11135-023-01801-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.