IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v78y2010i1p3-20.html
   My bibliography  Save this article

Assessing the Effect of Data Collection Mode on Measurement

Author

Listed:
  • Annette Jäckle
  • Caroline Roberts
  • Peter Lynn

Abstract

This paper discusses the challenges in assessing the effects of mixed modes on measurement. We briefly review theories about why different modes of data collection can lead to differences in survey responses and statistical methods typically used to assess mode effects. We then discuss the challenges, including which mode effects are identified, how to test for mode effects, and whether these would affect substantive conclusions. The issues raised are illustrated with examples from the European Social Survey, which is conducting a programme of experimental research to inform decisions about whether to use mixed modes of data collection. The paper concludes with general implications for mixed modes research. Cet article passe en revue les défis relatifs à l'évaluation de l'effet sur l'erreur mesure, de l'utilisation de plusieurs modes de collecte des données. Nous débutons par une revue succincte des théories sur la façon dont différents modes peuvent produire des réponses divergentes pour ensuite traiter des méthodes statistiques généralement utilisées afin d'évaluer l'effet du mode de collecte. Ensuite nous discutons les défis, y compris quels effets du mode de collecte sur l'erreur mesure sont identifiés, comment tester l'effet du mode et si les différences entre modes impactent sur les conclusions de fond. Les considérations sont illustrées avec des examples de l'Enquête Sociale Européenne où un programme de recherche est présentement en cours afin d'évaluer la faisabilité d'utiliser plusieurs modes de collecte des données. L'article se termine par des recommandations générales pertinentes pour la poursuite de la recherche sur les modes de collecte multiples.

Suggested Citation

  • Annette Jäckle & Caroline Roberts & Peter Lynn, 2010. "Assessing the Effect of Data Collection Mode on Measurement," International Statistical Review, International Statistical Institute, vol. 78(1), pages 3-20, April.
    • Handle: RePEc:bla:istatr:v:78:y:2010:i:1:p:3-20
    DOI: 10.1111/j.1751-5823.2010.00102.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1751-5823.2010.00102.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1751-5823.2010.00102.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. J. W. James, 1964. "Comparing Regression and Correlation Coefficients," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 13(2), pages 127-132, June.
    2. Richard Williams, 2006. "Generalized ordered logit/partial proportional odds models for ordinal dependent variables," Stata Journal, StataCorp LP, vol. 6(1), pages 58-82, March.
    3. Lynn, Peter & Jäckle, Annette & Roberts, Caroline, 2006. "Telephone versus face-to-face interviewing: mode effects on data quality and likely causes: report on phase II of the ESS-Gallup mixed mode methodology project," ISER Working Paper Series 2006-41, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    2. Yuri Reina-Aranza, 2015. "Violencia de pareja y estado de salud de la mujer en Colombia," Documentos de Trabajo Sobre Economía Regional y Urbana 13964, Banco de la República, Economía Regional.
    3. Peter A. Savelyev, 2014. "Psychological Skills, Education, and Longevity of High-Ability Individuals," Vanderbilt University Department of Economics Working Papers 14-00007, Vanderbilt University Department of Economics.
    4. Mengyuan Zhou, 2019. "The Effect of the Source of Inheritance on Bequest Attitudes: Evidence from Japan," Keio-IES Discussion Paper Series 2019-018, Institute for Economics Studies, Keio University.
    5. William Magee, 2023. "Earnings, Intersectional Earnings Inequality, Disappointment in One’s Life Achievements and Life (Dis)satisfaction," Journal of Happiness Studies, Springer, vol. 24(1), pages 373-396, January.
    6. Cristina Chaminade & Monica Plechero, 2015. "Do Regions Make a Difference? Regional Innovation Systems and Global Innovation Networks in the ICT Industry," European Planning Studies, Taylor & Francis Journals, vol. 23(2), pages 215-237, February.
    7. Chonnikarn Fern Jira & Michael W. Toffel, 2011. "Engaging Supply Chains in Climate Change," Harvard Business School Working Papers 12-026, Harvard Business School, revised Oct 2012.
    8. Jeannette Rüge & Anja Broda & Sabina Ulbricht & Gudrun Klein & Hans-Jürgen Rumpf & Ulrich John & Christian Meyer, 2010. "Workplace smoking restrictions: smoking behavior and the intention to change among continuing smokers," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 55(6), pages 599-608, December.
    9. Md. Akhtarul Islam & Mst. Tanmin Nahar & Md. Nafiul Alam Khan & Zahid Ahmad Butt & A. S. M. Monjur-Al-Hossain & Sutapa Dey Barna & Md. Mostafizur Rahman & Henry Ratul Halder & Mohammed Zaber Hossain &, 2022. "Knowledge, Attitudes, and Practices concerning Black Fungus during COVID-19 Pandemic among Students of Bangladesh: An Online-Based Cross-Sectional Survey," IJERPH, MDPI, vol. 19(15), pages 1-19, July.
    10. Dirk Crass & Franz Schwiebacher, 2017. "The importance of trademark protection for product differentiation and innovation," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 44(2), pages 199-220, June.
    11. Bruno Amable, 2009. "The Differentiation of Social Demands in Europe. The Social Basis of the European Models of Capitalism," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 91(3), pages 391-426, May.
    12. Tinggui Chen & Hui Wang, 2022. "Consumers' purchase intention of wild freshwater fish during the COVID‐19 pandemic," Agribusiness, John Wiley & Sons, Ltd., vol. 38(4), pages 832-849, October.
    13. Aisbett, Emma & McAusland, Carol, 2013. "Firm characteristics and influence on government rule-making: Theory and evidence," European Journal of Political Economy, Elsevier, vol. 29(C), pages 214-235.
    14. Giuseppina Guagnano & Elisabetta Santarelli & Isabella Santini, 2016. "Can Social Capital Affect Subjective Poverty in Europe? An Empirical Analysis Based on a Generalized Ordered Logit Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 881-907, September.
    15. Jäckle, Annette & Roberts, Caroline, 2012. "Causes of mode effects: separating out interviewer and stimulus effects in comparisons of face-to-face and telephone surveys," ISER Working Paper Series 2012-27, Institute for Social and Economic Research.
    16. Isphording, Ingo E. & Otten, Sebastian, 2014. "Linguistic barriers in the destination language acquisition of immigrants," Journal of Economic Behavior & Organization, Elsevier, vol. 105(C), pages 30-50.
    17. Necker, Sarah & Ziegelmeyer, Michael, 2016. "Household risk taking after the financial crisis," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 141-160.
    18. Richard Williams, 2009. "Using Heterogeneous Choice Models to Compare Logit and Probit Coefficients Across Groups," Sociological Methods & Research, , vol. 37(4), pages 531-559, May.
    19. Nagel, Stefan & Malmendier, Ulrike M. & Yan, Zhen, 2017. "The Making of Hawks and Doves: Inflation Experiences on the FOMC," CEPR Discussion Papers 11902, C.E.P.R. Discussion Papers.
    20. Hanna Dudek & Joanna Landmesser, 2012. "Income satisfaction and relative deprivation," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 13(2), pages 321-334, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:78:y:2010:i:1:p:3-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.