IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v29y2013i2p277-297n6.html
   My bibliography  Save this article

“Interviewer” Effects in Face-to-Face Surveys: A Function of Sampling, Measurement Error, or Nonresponse?

Author

Listed:
  • West Brady T.

    (Survey Methodology Program (SMP), Survey Research Center (SRC), Institute for Social Research, University of Michigan, 426 Thompson Street, Ann Arbor, MI 48106, U.S.A.)

  • Kreuter Frauke

    (Joint Program in Survey Methodology (JPSM), Ludwig Maximilian University of Munich, Institute for Employment Research (IAB), Nuremberg, Germany)

  • Jaenichen Ursula

    (Institute for Employment Research (IAB), Nuremberg, Germany)

Abstract

Recent research has attempted to examine the proportion of interviewer variance that is due to interviewers systematically varying in their success in obtaining cooperation from respondents with varying characteristics (i.e., nonresponse error variance), rather than variance among interviewers in systematic measurement difficulties (i.e., measurement error variance) - that is, whether correlated responses within interviewers arise due to variance among interviewers in the pools of respondents recruited, or variance in interviewer-specific mean response biases. Unfortunately, work to date has only considered data from a CATI survey, and thus suffers from two limitations: Interviewer effects are commonly much smaller in CATI surveys, and, more importantly, sample units are often contacted by several CATI interviewers before a final outcome (response or final refusal) is achieved. The latter introduces difficulties in assigning nonrespondents to interviewers, and thus interviewer variance components are only estimable under strong assumptions. This study aims to replicate this initial work, analyzing data from a national CAPI survey in Germany where CAPI interviewers were responsible for working a fixed subset of cases.

Suggested Citation

  • West Brady T. & Kreuter Frauke & Jaenichen Ursula, 2013. "“Interviewer” Effects in Face-to-Face Surveys: A Function of Sampling, Measurement Error, or Nonresponse?," Journal of Official Statistics, Sciendo, vol. 29(2), pages 277-297, September.
  • Handle: RePEc:vrs:offsta:v:29:y:2013:i:2:p:277-297:n:6
    DOI: 10.2478/jos-2013-0023
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2013-0023
    Download Restriction: no

    File URL: https://libkey.io/10.2478/jos-2013-0023?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:iab:iabfme:201107(en is not listed on IDEAS
    2. Eduardo A. Haddad & Jaime Bonet & Geoffrey J. D. Hewings, 2023. "Introduction and Overview," Advances in Spatial Science, in: Eduardo A. Haddad & Jaime Bonet & Geoffrey J. D. Hewings (ed.), The Colombian Economy and Its Regional Structural Challenges, chapter 0, pages 1-16, Springer.
    3. Thomas K. Bauer & Regina Flake & Mathias G. Sinning, 2013. "Labor Market Effects of Immigration: Evidence from Neighborhood Data," Review of International Economics, Wiley Blackwell, vol. 21(2), pages 370-385, May.
    4. Büngeler, Kathrin & Gensicke, Miriam & Hartmann, Josef & Jäckle, Robert & Tschersich, Nikolai, 2010. "IAB-Haushaltspanel im Niedrigeinkommensbereich Welle 3 (2008/09) : Methoden- und Feldbericht," FDZ Methodenreport 201010_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. Christoph, Bernhard & Müller, Gerrit & Gebhardt, Daniel & Wenzig, Claudia & Trappmann, Mark & Achatz, Juliane & Tisch, Anita & Gayer, Christine, 2008. "Codebook and documentation of the panel study 'Labour Market and Social Security' (PASS) : vol. 1: Introduction and overview, wave 1 (2006/2007)," FDZ Datenreport. Documentation on Labour Market Data 200805_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    6. Jan Pickery & Geert Loosveldt, 2002. "A Multilevel Multinomial Analysis of Interviewer Effects on Various Components of Unit Nonresponse," Quality & Quantity: International Journal of Methodology, Springer, vol. 36(4), pages 427-437, November.
    7. Promberger, Markus & Achatz, Juliane & Hirseland, Andreas & Schnell, Rainer & Rudolph, Helmut & Trappmann, Mark & Wenzel, Ulrich & Promberger, Markus, 2007. "Neue Daten für die Sozialstaatsforschung : zur Konzeption der IAB-Panelerhebung "Arbeitsmarkt und Soziale Sicherung"," IAB-Forschungsbericht 200712, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    8. Bender, Stefan & Heining, Jörg, 2011. "The Research-Data-Centre in Research-Data-Centre approach : a first step towards decentralised international data sharing," FDZ Methodenreport 201107_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    9. Pamela Campanelli & Colm O'Muircheartaigh, 1999. "Interviewers, Interviewer Continuity, and Panel Survey Nonresponse," Quality & Quantity: International Journal of Methodology, Springer, vol. 33(1), pages 59-76, February.
    10. repec:zbw:rwirep:0257 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernhard Christoph, 2010. "The Relation Between Life Satisfaction and the Material Situation: A Re-Evaluation Using Alternative Measures," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 98(3), pages 475-499, September.
    2. repec:iab:iabfda:201307(en is not listed on IDEAS
    3. Bethmann, Arne (Hrsg.) & Fuchs, Benjamin (Hrsg.) & Wurdack, Anja (Hrsg.) & Beste, Jonas (Mitarb.) & Trappmann, Mark (Mitarb.) & Müller, Gerrit (Mitarb.) & Eggs, Johannes (Mitarb.) & Gundert, Stefanie , 2013. "User guide "Panel Study Labour Market and Social Security" (PASS) : wave 6," FDZ Datenreport. Documentation on Labour Market Data 201307_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    4. Rebecca Vassallo & Gabriele Durrant & Peter Smith, 2017. "Separating interviewer and area effects by using a cross-classified multilevel logistic model: simulation findings and implications for survey designs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 531-550, February.
    5. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Schwarz, Stefan & Trappmann, Mark & Bäh, 2020. "Codebook and documentation of the Panel Study 'Labour Market and Social Security' (PASS) : Datenreport Wave 12," FDZ Datenreport. Documentation on Labour Market Data 201909_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    6. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Bethmann, Arne & Fuchs, Benjamin & Trappmann, Mark & Wurdack, Anja, 2013. "Codebuch und Dokumentation des 'Panel Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 6," FDZ Datenreport. Documentation on Labour Market Data 201306_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    7. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Fuchs, Benjamin & Schwarz, Stefan & Tra, 2018. "Codebuch und Dokumentation des Panel 'Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 11," FDZ Datenreport. Documentation on Labour Market Data 201806_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    8. repec:iab:iabfda:201506(de is not listed on IDEAS
    9. repec:iab:iabfme:201211(de is not listed on IDEAS
    10. Bach, Ruben L. & Eckman, Stephanie, 2017. "Does participating in a panel survey change respondents' labor market behavior?," IAB-Discussion Paper 201715, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    11. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Fuchs, Benjamin & Schwarz, Stefan & Tra, 2017. "Codebuch und Dokumentation des Panel 'Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 10," FDZ Datenreport. Documentation on Labour Market Data 201707_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Geert Loosveldt & Koen Beullens, 2014. "A Procedure to Assess Interviewer Effects on Nonresponse Bias," SAGE Open, , vol. 4(1), pages 21582440145, February.
    13. repec:iab:iabfda:202012(de is not listed on IDEAS
    14. Veronika Hecht & Nicole Litzel & Johannes Schäffler, 2019. "Unit nonresponse at the firm level: a cross-border analysis using the IAB-ReLOC data," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 53(1), pages 1-18, December.
    15. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Schwarz, Stefan & Trappmann, Mark & Bäh, 2020. "Codebuch und Dokumentation des Panel 'Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 13," FDZ Datenreport. Documentation on Labour Market Data 202012_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    16. Blien, Uwe & Messmann, Susanne & Trappmann, Mark, 2012. "Do reservation wages react to regional unemployment?," IAB-Discussion Paper 201222, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    17. repec:iab:iabfda:201206(en is not listed on IDEAS
    18. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Bethmann, Arne & Fuchs, Benjamin & Huber, Martina & Trappmann, Mark, 2015. "Codebuch und Dokumentation des 'Panel Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 8," FDZ Datenreport. Documentation on Labour Market Data 201506_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    19. Hillmann, Katja & Hohenleitner, Ingrid, 2015. "Impact of welfare sanctions on employment entry and exit from labor force: Evidence from German survey data," HWWI Research Papers 168, Hamburg Institute of International Economics (HWWI).
    20. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Bethmann, Arne & Fuchs, Benjamin & Trappmann, Mark & Wurdack, Anja, 2012. "Codebuch und Dokumentation des 'Panel Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 5," FDZ Datenreport. Documentation on Labour Market Data 201206_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    21. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Schwarz, Stefan & Trappmann, Mark & Bäh, 2019. "Codebuch und Dokumentation des Panel 'Arbeitsmarkt und soziale Sicherung' (PASS) : Datenreport Welle 12," FDZ Datenreport. Documentation on Labour Market Data 201909_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    22. Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Fuchs, Benjamin & Schwarz, Stefan & Trappmann, Mark & Trenkle, Simon & Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jess, 2018. "Codebook and documentation of the panel Study 'Labour Market and Social Security' (PASS) : Datenreport wave 10," FDZ Datenreport. Documentation on Labour Market Data 201707_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    23. repec:iab:iabfda:202012(en is not listed on IDEAS
    24. repec:iab:iabfda:201306(de is not listed on IDEAS
    25. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Marwinski, Karen & Gebhardt, Daniel & Wenzig, Claudia & Wetzel, Martin, 2011. "Codebook and documentation of the panel study ‘Labour Market and Social Security’ (PASS) : Datenreport wave 3," FDZ Datenreport. Documentation on Labour Market Data 201006_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    26. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Beste, Jonas & Dummert, Sandra & Frodermann, Corinna & Schwarz, Stefan & Trappmann, Mark & Bäh, 2021. "Codebook and Documentation of the Panel Study "Labour Market and Social Security" (PASS) : Datenreport Wave 13," FDZ Datenreport. Documentation on Labour Market Data 202012_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    27. repec:iab:iabfda:201206(de is not listed on IDEAS
    28. repec:iab:iabfda:201306(en is not listed on IDEAS
    29. repec:iab:iabfda:201806(de is not listed on IDEAS
    30. Claire Durand, 2005. "Measuring Interviewer Performance in Telephone Surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 39(6), pages 763-778, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:29:y:2013:i:2:p:277-297:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.