IDEAS home Printed from https://ideas.repec.org/p/ese/iserwp/2012-27.html
   My bibliography  Save this paper

Causes of mode effects: separating out interviewer and stimulus effects in comparisons of face-to-face and telephone surveys

Author

Listed:
  • Jäckle, Annette
  • Roberts, Caroline

Abstract

We attempt to isolate the causes of mode effects on measurement in a comparison of face-to-face and telephone interviewing, distinguishing between effects caused by differences in the type of question stimulus used in each mode (audio vs. visual) and effects caused by other differences between the modes, notably, the presence or absence of the interviewer. We use data from an experiment conducted in the context of the European Social Survey. Differences in the stimulus did not lead to differential measurement error, but the presence or absence of the interviewer did. Telephone respondents were far more likely to give socially desirable responses than face-to-face respondents.

Suggested Citation

  • Jäckle, Annette & Roberts, Caroline, 2012. "Causes of mode effects: separating out interviewer and stimulus effects in comparisons of face-to-face and telephone surveys," ISER Working Paper Series 2012-27, Institute for Social and Economic Research.
    • Handle: RePEc:ese:iserwp:2012-27
    as

    Download full text from publisher

    File URL: https://www.iser.essex.ac.uk/wp-content/uploads/files/working-papers/iser/2012-27.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Annette Jäckle & Caroline Roberts & Peter Lynn, 2010. "Assessing the Effect of Data Collection Mode on Measurement," International Statistical Review, International Statistical Institute, vol. 78(1), pages 3-20, April.
    2. Anders Wikman & Bo Wärneryd, 1990. "Measurement errors in survey questions: Explaining response variability," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 22(2), pages 199-212, March.
    3. Andy Peytchev & Lisa R. Carley-Baxter & Michele C. Black, 2011. "Multiple Sources of Nonobservation Error in Telephone Surveys: Coverage and Nonresponse," Sociological Methods & Research, , vol. 40(1), pages 138-168, February.
    4. Lynn, Peter & Jäckle, Annette & Roberts, Caroline, 2006. "Telephone versus face-to-face interviewing: mode effects on data quality and likely causes: report on phase II of the ESS-Gallup mixed mode methodology project," ISER Working Paper Series 2006-41, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zawojska, Ewa & Czajkowski, Mikotaj, 2017. "Are preferences stated in web vs. personal interviews different? A comparison of willingness to pay results for a large multi-country study of the Baltic Sea eutrophication reduction," Annual Meeting, 2017, June 18-21, Montreal, Canada 258604, Canadian Agricultural Economics Society.
    2. Debra Wright & Matt Sloan & Kirsten Barrett, 2012. "Is There a Trade-off Between Quality and Cost? Telephone Versus Face-to-Face Interviewing of Persons with Disabilities," Mathematica Policy Research Reports cb6067df035641e99a913d534, Mathematica Policy Research.
    3. P. Couper, Mick & Cernat, Alexandru & Beth Ofstedal, Mary, 2015. "Estimation of mode effects in the Health and Retirement Study using measurement models," ISER Working Paper Series 2015-19, Institute for Social and Economic Research.
    4. Jorre T. A. Vannieuwenhuyze & Geert Loosveldt, 2013. "Evaluating Relative Mode Effects in Mixed-Mode Surveys:," Sociological Methods & Research, , vol. 42(1), pages 82-104, February.
    5. Mackeben, Jan, 2020. "Mode Effects in the Fourth Wave of the Linked Personnel Panel (LPP) Employee Survey," FDZ Methodenreport 202005_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    6. Lynn, Peter & Roberts, Caroline & Allum, Nick & Eva, Gillian, 2010. "Data quality in telephone surveys and the effect of questionnaire length: a cross- national experiment," ISER Working Paper Series 2010-36, Institute for Social and Economic Research.
    7. Grewenig, Elisabeth & Lergetporer, Philipp & Simon, Lisa & Werner, Katharina & Woessmann, Ludger, 2018. "Can Online Surveys Represent the Entire Population?," IZA Discussion Papers 11799, Institute of Labor Economics (IZA).
    8. Bart Buelens & Jan A. van den Brakel, 2015. "Measurement Error Calibration in Mixed-mode Sample Surveys," Sociological Methods & Research, , vol. 44(3), pages 391-426, August.
    9. Cernat, Alexandru, 2013. "The impact of mixing modes on reliability in longitudinal studies," ISER Working Paper Series 2013-09, Institute for Social and Economic Research.
    10. Lindhjem, Henrik & Navrud, Ståle, 2010. "Can cheap panel-based internet surveys substitute costly in-person interviews in CV surveys?," MPRA Paper 24069, University Library of Munich, Germany.
    11. Alexandru Cernat, 2015. "The Impact of Mixing Modes on Reliability in Longitudinal Studies," Sociological Methods & Research, , vol. 44(3), pages 427-457, August.
    12. Wenz, Alexander, 2017. "Completing web surveys on mobile devices: does screen size affect data quality?," ISER Working Paper Series 2017-05, Institute for Social and Economic Research.
    13. de Leeuw, E.D. & Hox, J.J.C.M. & Scherpenzeel, A.C., 2011. "Mode effect or question wording? Measurement error in mixed mode surveys," Other publications TiSEM 4218c762-6d80-4dfc-97ee-8, Tilburg University, School of Economics and Management.
    14. Bernhard Schimpl-Neimanns, 2013. "Methodische Herausforderungen bei der Erfassung von Bildung und Ausbildung im Mikrozensus," RatSWD Working Papers 221, German Data Forum (RatSWD).
    15. Giorgio Piccitto & Aart C. Liefbroer & Tom Emery, 2022. "Does the Survey Mode Affect the Association Between Subjective Well-being and its Determinants? An Experimental Comparison Between Face-to-Face and Web Mode," Journal of Happiness Studies, Springer, vol. 23(7), pages 3441-3461, October.
    16. Pirmin Fessler & Maximilian Kasy & Peter Lindner, 2018. "Survey mode effects on measured income inequality," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 16(4), pages 487-505, December.
    17. Daniela Rohrbach-Schmidt & Michael Tiemann, 2013. "Changes in workplace tasks in Germany—evaluating skill and task measures [Wandel der Tätigkeiten am Arbeitsplatz in Deutschland – Analysen von Skill und Task-Maßen]," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 46(3), pages 215-237, September.
    18. Alissa Goodman & Matt Brown & Richard J. Silverwood & Joseph W. Sakshaug & Lisa Calderwood & Joel Williams & George B. Ploubidis, 2022. "The impact of using the Web in a mixed‐mode follow‐up of a longitudinal birth cohort study: Evidence from the National Child Development Study," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 822-850, July.
    19. Grewenig, Elisabeth & Lergetporer, Philipp & Simon, Lisa & Werner, Katharina & Woessmann, Ludger, 2023. "Can internet surveys represent the entire population? A practitioners’ analysis," European Journal of Political Economy, Elsevier, vol. 78(C).
    20. Sala, Emanuela & Lillini, Roberto, 2014. "The impact of unlisted and no-landline respondents on non-coverage bias. The Italian case," ISER Working Paper Series 2014-16, Institute for Social and Economic Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ese:iserwp:2012-27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jonathan Nears (email available below). General contact details of provider: https://edirc.repec.org/data/rcessuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.