IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v78y2010i1p3-20.html
   My bibliography  Save this article

Assessing the Effect of Data Collection Mode on Measurement

Author

Listed:
  • Annette Jäckle
  • Caroline Roberts
  • Peter Lynn

Abstract

This paper discusses the challenges in assessing the effects of mixed modes on measurement. We briefly review theories about why different modes of data collection can lead to differences in survey responses and statistical methods typically used to assess mode effects. We then discuss the challenges, including which mode effects are identified, how to test for mode effects, and whether these would affect substantive conclusions. The issues raised are illustrated with examples from the European Social Survey, which is conducting a programme of experimental research to inform decisions about whether to use mixed modes of data collection. The paper concludes with general implications for mixed modes research. Cet article passe en revue les défis relatifs à l'évaluation de l'effet sur l'erreur mesure, de l'utilisation de plusieurs modes de collecte des données. Nous débutons par une revue succincte des théories sur la façon dont différents modes peuvent produire des réponses divergentes pour ensuite traiter des méthodes statistiques généralement utilisées afin d'évaluer l'effet du mode de collecte. Ensuite nous discutons les défis, y compris quels effets du mode de collecte sur l'erreur mesure sont identifiés, comment tester l'effet du mode et si les différences entre modes impactent sur les conclusions de fond. Les considérations sont illustrées avec des examples de l'Enquête Sociale Européenne où un programme de recherche est présentement en cours afin d'évaluer la faisabilité d'utiliser plusieurs modes de collecte des données. L'article se termine par des recommandations générales pertinentes pour la poursuite de la recherche sur les modes de collecte multiples.

Suggested Citation

  • Annette Jäckle & Caroline Roberts & Peter Lynn, 2010. "Assessing the Effect of Data Collection Mode on Measurement," International Statistical Review, International Statistical Institute, vol. 78(1), pages 3-20, April.
    • Handle: RePEc:bla:istatr:v:78:y:2010:i:1:p:3-20
    DOI: 10.1111/j.1751-5823.2010.00102.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1751-5823.2010.00102.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1751-5823.2010.00102.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard Williams, 2006. "Generalized ordered logit/partial proportional odds models for ordinal dependent variables," Stata Journal, StataCorp LP, vol. 6(1), pages 58-82, March.
    2. J. W. James, 1964. "Comparing Regression and Correlation Coefficients," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 13(2), pages 127-132, June.
    3. Lynn, Peter & Jäckle, Annette & Roberts, Caroline, 2006. "Telephone versus face-to-face interviewing: mode effects on data quality and likely causes: report on phase II of the ESS-Gallup mixed mode methodology project," ISER Working Paper Series 2006-41, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    2. Yuri Reina-Aranza, 2015. "Violencia de pareja y estado de salud de la mujer en Colombia," Documentos de Trabajo Sobre Economía Regional y Urbana 13964, Banco de la República, Economía Regional.
    3. Cristina Chaminade & Monica Plechero, 2015. "Do Regions Make a Difference? Regional Innovation Systems and Global Innovation Networks in the ICT Industry," European Planning Studies, Taylor & Francis Journals, vol. 23(2), pages 215-237, February.
    4. Bruno Amable, 2009. "The Differentiation of Social Demands in Europe. The Social Basis of the European Models of Capitalism," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 91(3), pages 391-426, May.
    5. Giuseppina Guagnano & Elisabetta Santarelli & Isabella Santini, 2016. "Can Social Capital Affect Subjective Poverty in Europe? An Empirical Analysis Based on a Generalized Ordered Logit Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 881-907, September.
    6. Hanna Dudek & Joanna Landmesser, 2012. "Income satisfaction and relative deprivation," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 13(2), pages 321-334, June.
    7. Yahui Wang, 2019. "What Affects Participation in the Farmland Rental Market in Rural China? Evidence from CHARLS," Sustainability, MDPI, vol. 11(24), pages 1-15, December.
    8. Joachim Wagner, 2009. "Exporte und Firmenerfolg: Welche Firmen profitieren wie vom internationalen Handel?," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 3(2), pages 109-122, October.
    9. Charlie Tchinda & Marcus Dejardin, 2021. "Are Business Policy Measures in Response to the COVID-19 Pandemic to Be Equally Valued? An Exploration According to SMEs Owners’ Business Expectations," Sustainability, MDPI, vol. 13(21), pages 1-42, October.
    10. Woo, C.K. & Zarnikau, J. & Moore, J. & Horowitz, I., 2011. "Wind generation and zonal-market price divergence: Evidence from Texas," Energy Policy, Elsevier, vol. 39(7), pages 3928-3938, July.
    11. Wixe, Sofia & Nilsson, Pia & Naldi, Lucia & Westlund, Hans, 2017. "Disentangling Innovation in Small Food Firms: The role of External Knowledge, Support, and Collaboration," Working Paper Series in Economics and Institutions of Innovation 446, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
    12. Hong Leng & Bingbing Han, 2022. "Effect of Environmental Planning on Elderly Individual Quality of Life in Severe Cold Regions: A Case Study in Northeastern China," Sustainability, MDPI, vol. 14(6), pages 1-17, March.
    13. Devillanova, Carlo & Raitano, Michele & Struffolino, Emanuela, 2019. "Longitudinal employment trajectories and health in middle life: Insights from linked administrative and survey data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 40, pages 1375-1412.
    14. Dusanee Kesavayuth & Robert Rosenman & Vasileios Zikos, 2013. "Does Personality Affect how People Perceive their Health?," Working Papers 2013-13, School of Economic Sciences, Washington State University.
    15. Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
    16. Brancati, Emanuele, 2013. "Innovation, financial constraints and relationship lending: evidence from Italy during the recent crises," MPRA Paper 50329, University Library of Munich, Germany.
    17. Catalina Martínez & Laura Cruz-Castro & Luis Sanz-Menéndez, 2016. "Innovation capabilities in the private sector: evaluating subsidies for hiring S&T workers in Spain," Research Evaluation, Oxford University Press, vol. 25(2), pages 196-208.
    18. Sarah Brown & Jennifer Roberts & Karl Taylor, 2010. "Reservation wages, labour market participation and health," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(3), pages 501-529, July.
    19. Tamm, Marcus, 2008. "Does money buy higher schooling?: Evidence from secondary school track choice in Germany," Economics of Education Review, Elsevier, vol. 27(5), pages 536-545, October.
    20. Prudence Dato, 2018. "Investment in Energy Efficiency, Adoption of Renewable Energy and Household Behavior: Evidence from OECD Countries," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:78:y:2010:i:1:p:3-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.