IDEAS home Printed from https://ideas.repec.org/p/ese/iserwp/2012-27.html
   My bibliography  Save this paper

Causes of mode effects: separating out interviewer and stimulus effects in comparisons of face-to-face and telephone surveys

Author

Listed:
  • Jäckle, Annette
  • Roberts, Caroline

Abstract

We attempt to isolate the causes of mode effects on measurement in a comparison of face-to-face and telephone interviewing, distinguishing between effects caused by differences in the type of question stimulus used in each mode (audio vs. visual) and effects caused by other differences between the modes, notably, the presence or absence of the interviewer. We use data from an experiment conducted in the context of the European Social Survey. Differences in the stimulus did not lead to differential measurement error, but the presence or absence of the interviewer did. Telephone respondents were far more likely to give socially desirable responses than face-to-face respondents.

Suggested Citation

  • Jäckle, Annette & Roberts, Caroline, 2012. "Causes of mode effects: separating out interviewer and stimulus effects in comparisons of face-to-face and telephone surveys," ISER Working Paper Series 2012-27, Institute for Social and Economic Research.
    • Handle: RePEc:ese:iserwp:2012-27
    as

    Download full text from publisher

    File URL: https://www.iser.essex.ac.uk/wp-content/uploads/files/working-papers/iser/2012-27.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Annette Jäckle & Caroline Roberts & Peter Lynn, 2010. "Assessing the Effect of Data Collection Mode on Measurement," International Statistical Review, International Statistical Institute, vol. 78(1), pages 3-20, April.
    2. Anders Wikman & Bo Wärneryd, 1990. "Measurement errors in survey questions: Explaining response variability," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 22(2), pages 199-212, March.
    3. Andy Peytchev & Lisa R. Carley-Baxter & Michele C. Black, 2011. "Multiple Sources of Nonobservation Error in Telephone Surveys: Coverage and Nonresponse," Sociological Methods & Research, , vol. 40(1), pages 138-168, February.
    4. Lynn, Peter & Jäckle, Annette & Roberts, Caroline, 2006. "Telephone versus face-to-face interviewing: mode effects on data quality and likely causes: report on phase II of the ESS-Gallup mixed mode methodology project," ISER Working Paper Series 2006-41, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zawojska, Ewa & Czajkowski, Mikotaj, 2017. "Are preferences stated in web vs. personal interviews different? A comparison of willingness to pay results for a large multi-country study of the Baltic Sea eutrophication reduction," Annual Meeting, 2017, June 18-21, Montreal, Canada 258604, Canadian Agricultural Economics Society.
    2. Debra Wright & Matt Sloan & Kirsten Barrett, 2012. "Is There a Trade-off Between Quality and Cost? Telephone Versus Face-to-Face Interviewing of Persons with Disabilities," Mathematica Policy Research Reports cb6067df035641e99a913d534, Mathematica Policy Research.
    3. Sala, Emanuela & Lillini, Roberto, 2014. "The impact of unlisted and no-landline respondents on non-coverage bias. The Italian case," ISER Working Paper Series 2014-16, Institute for Social and Economic Research.
    4. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    5. P. Couper, Mick & Cernat, Alexandru & Beth Ofstedal, Mary, 2015. "Estimation of mode effects in the Health and Retirement Study using measurement models," ISER Working Paper Series 2015-19, Institute for Social and Economic Research.
    6. Jorre T. A. Vannieuwenhuyze & Geert Loosveldt, 2013. "Evaluating Relative Mode Effects in Mixed-Mode Surveys:," Sociological Methods & Research, , vol. 42(1), pages 82-104, February.
    7. Guimarães, Maria Helena & Nunes, Luís Catela & Madureira, Lívia & Santos, José Lima & Boski, Tomasz & Dentinho, Tomaz, 2015. "Measuring birdwatchers preferences: A case for using online networks and mixed-mode surveys," Tourism Management, Elsevier, vol. 46(C), pages 102-113.
    8. Mackeben, Jan, 2020. "Mode Effects in the Fourth Wave of the Linked Personnel Panel (LPP) Employee Survey," FDZ Methodenreport 202005_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    9. Lynn, Peter & Roberts, Caroline & Allum, Nick & Eva, Gillian, 2010. "Data quality in telephone surveys and the effect of questionnaire length: a cross- national experiment," ISER Working Paper Series 2010-36, Institute for Social and Economic Research.
    10. Vidal Díaz de Rada, 2011. "Face-to-face versus telephone surveys on political attitudes: a comparative analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(4), pages 817-827, June.
    11. Grewenig, Elisabeth & Lergetporer, Philipp & Simon, Lisa & Werner, Katharina & Woessmann, Ludger, 2018. "Can Online Surveys Represent the Entire Population?," IZA Discussion Papers 11799, Institute of Labor Economics (IZA).
    12. repec:iab:iabfme:202005(en is not listed on IDEAS
    13. Stefania Capecchi & Romina Gambacorta & Rosaria Simone & Domenico Piccolo, 2024. "Modelling cognitive response patterns to survey questions using the class of CUB models," Questioni di Economia e Finanza (Occasional Papers) 885, Bank of Italy, Economic Research and International Relations Area.
    14. Annette Jäckle & Caroline Roberts & Peter Lynn, 2010. "Assessing the Effect of Data Collection Mode on Measurement," International Statistical Review, International Statistical Institute, vol. 78(1), pages 3-20, April.
    15. Czajkowski, Mikołaj & Zawojska, Ewa & Meade, Norman & da Motta, Ronaldo Seroa & Welsh, Mike & Ortiz, Ramon Arigoni, 2024. "On the inference about a willingness-to-pay distribution using contingent valuation data," Ecological Economics, Elsevier, vol. 222(C).
    16. Cernat, Alexandru, 2014. "Impact of mixed modes on measurement errors and estimates of change in panel data," Understanding Society Working Paper Series 2014-05, Understanding Society at the Institute for Social and Economic Research.
    17. repec:mpr:mprres:7332 is not listed on IDEAS
    18. Bart Buelens & Jan A. van den Brakel, 2015. "Measurement Error Calibration in Mixed-mode Sample Surveys," Sociological Methods & Research, , vol. 44(3), pages 391-426, August.
    19. Cernat, Alexandru, 2013. "The impact of mixing modes on reliability in longitudinal studies," ISER Working Paper Series 2013-09, Institute for Social and Economic Research.
    20. Lynn, Peter & Kaminska, Olena, 2011. "The impact of mobile phones on survey measurement error," ISER Working Paper Series 2011-07, Institute for Social and Economic Research.
    21. Pirmin Fessler & Maximilian Kasy & Peter Lindner, 2018. "Survey mode effects on measured income inequality," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 16(4), pages 487-505, December.
    22. Lindhjem, Henrik & Navrud, Ståle, 2010. "Can cheap panel-based internet surveys substitute costly in-person interviews in CV surveys?," MPRA Paper 24069, University Library of Munich, Germany.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ese:iserwp:2012-27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jonathan Nears (email available below). General contact details of provider: https://edirc.repec.org/data/rcessuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.