IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v34y2018i3p649-670n4.html
   My bibliography  Save this article

A Study of Interviewer Compliance in 2013 and 2014 Census Test Adaptive Designs

Author

Listed:
  • Walejko Gina

    (U.S. Census Bureau, 4600 Silver Hill Road, Suitland, Maryland 20746, U.S.A.)

  • Wagner James

    (University of Michigan, Institute for Social Research, 426 Thompson Street, Ann Arbor, MI 48105, U.S.A.)

Abstract

Researchers are interested in the effectiveness of adaptive and responsive survey designs that monitor and respond to data using tailored or targeted interventions. These designs often require adherence to protocols, which can be difficult when surveys allow in-person interviewers flexibility in managing cases. This article describes examples of interviewer noncompliance and compliance in adaptive design experiments that occurred in two United States decennial census tests. The two studies tested adaptive procedures including having interviewers work prioritized cases and substitute face-to-face attempts with telephone calls. When to perform such procedures was communicated to interviewers via case management systems that necessitated twice-daily transmissions of data. We discuss reasons when noncompliance may occur and ways to improve compliance.

Suggested Citation

  • Walejko Gina & Wagner James, 2018. "A Study of Interviewer Compliance in 2013 and 2014 Census Test Adaptive Designs," Journal of Official Statistics, Sciendo, vol. 34(3), pages 649-670, September.
    • Handle: RePEc:vrs:offsta:v:34:y:2018:i:3:p:649-670:n:4
    DOI: 10.2478/jos-2018-0031
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2018-0031
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2018-0031?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Durrant, Gabriele B. & Steele, Fiona, 2009. "Multilevel modelling of refusal and non-contact in household surveys: evidence from six UK Government surveys," LSE Research Online Documents on Economics 50112, London School of Economics and Political Science, LSE Library.
    2. Gabriele B. Durrant & Fiona Steele, 2009. "Multilevel modelling of refusal and non‐contact in household surveys: evidence from six UK Government surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(2), pages 361-381, April.
    3. Jan Pickery & Geert Loosveldt, 2002. "A Multilevel Multinomial Analysis of Interviewer Effects on Various Components of Unit Nonresponse," Quality & Quantity: International Journal of Methodology, Springer, vol. 36(4), pages 427-437, November.
    4. Paul P. Biemer & Patrick Chen & Kevin Wang, 2013. "Using level-of-effort paradata in non-response adjustments with application to field surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 147-168, January.
    5. C. O'Muircheartaigh & P. Campanelli, 1999. "A multilevel exploration of the role of interviewers in survey non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 162(3), pages 437-446.
    6. Robert M. Groves & Steven G. Heeringa, 2006. "Responsive design for household surveys: tools for actively controlling survey errors and costs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 439-457, July.
    7. Annemieke Luiten & Barry Schouten, 2013. "Tailored fieldwork design to increase representative household survey response: an experiment in the Survey of Consumer Satisfaction," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 169-189, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roger Tourangeau & J. Michael Brick & Sharon Lohr & Jane Li, 2017. "Adaptive and responsive survey designs: a review and assessment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 203-223, January.
    2. Wagner James & Olson Kristen, 2018. "An Analysis of Interviewer Travel and Field Outcomes in Two Field Surveys," Journal of Official Statistics, Sciendo, vol. 34(1), pages 211-237, March.
    3. Geert Loosveldt & Koen Beullens, 2014. "A Procedure to Assess Interviewer Effects on Nonresponse Bias," SAGE Open, , vol. 4(1), pages 21582440145, February.
    4. Kristen Olson, 2013. "Paradata for Nonresponse Adjustment," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 142-170, January.
    5. Rebecca Vassallo & Gabriele Durrant & Peter Smith, 2017. "Separating interviewer and area effects by using a cross-classified multilevel logistic model: simulation findings and implications for survey designs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 531-550, February.
    6. Durrant Gabriele B. & Maslovskaya Olga & Smith Peter W. F., 2017. "Using Prior Wave Information and Paradata: Can They Help to Predict Response Outcomes and Call Sequence Length in a Longitudinal Study?," Journal of Official Statistics, Sciendo, vol. 33(3), pages 801-833, September.
    7. Steele, Fiona & Durrant, Gabriele B., 2011. "Alternative approaches to multilevel modelling of survey non-contact and refusal," LSE Research Online Documents on Economics 50113, London School of Economics and Political Science, LSE Library.
    8. Ashmead Robert & Slud Eric & Hughes Todd, 2017. "Adaptive Intervention Methodology for Reduction of Respondent Contact Burden in the American Community Survey," Journal of Official Statistics, Sciendo, vol. 33(4), pages 901-919, December.
    9. Gabriele B. Durrant & Sylke V. Schnepf, 2018. "Which schools and pupils respond to educational achievement surveys?: a focus on the English Programme for International Student Assessment sample," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1057-1075, October.
    10. Alireza Rezaee & Mojtaba Ganjali & Ehsan Bahrami Samani, 2022. "Sample selection bias with multiple dependent selection rules: an application to survey data analysis with multilevel nonresponse," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 158(1), pages 1-15, December.
    11. Roberts Caroline & Vandenplas Caroline & Herzing Jessica M.E., 2020. "A Validation of R-Indicators as a Measure of the Risk of Bias using Data from a Nonresponse Follow-Up Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 675-701, September.
    12. Adriana Ana Maria Davidescu & Monica Roman & Vasile Alecsandru Strat & Mihaela Mosora, 2019. "Regional Sustainability, Individual Expectations and Work Motivation: A Multilevel Analysis," Sustainability, MDPI, vol. 11(12), pages 1-23, June.
    13. Plewis Ian & Shlomo Natalie, 2017. "Using Response Propensity Models to Improve the Quality of Response Data in Longitudinal Studies," Journal of Official Statistics, Sciendo, vol. 33(3), pages 753-779, September.
    14. van Berkel Kees & van der Doef Suzanne & Schouten Barry, 2020. "Implementing Adaptive Survey Design with an Application to the Dutch Health Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 609-629, September.
    15. Michele Lalla & Maddalena Cavicchioli, 2020. "Nonresponse and measurement errors in income: matching individual survey data with administrative tax data," Department of Economics 0170, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    16. Durrant, Gabriele B. & D'Arrigo, Julia & Steele, Fiona, 2011. "Using field process data to predict best times of contact conditioning on household and interviewer influences," LSE Research Online Documents on Economics 52201, London School of Economics and Political Science, LSE Library.
    17. Mark Amos, 2018. "Interviewer effects on patterns of nonresponse: Evaluating the impact on the reasons for contraceptive nonuse in the Indonesia and the Philippines DHS," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 39(14), pages 415-430.
    18. Wagner James & West Brady T. & Elliott Michael R. & Coffey Stephanie, 2020. "Comparing the Ability of Regression Modeling and Bayesian Additive Regression Trees to Predict Costs in a Responsive Survey Design Context," Journal of Official Statistics, Sciendo, vol. 36(4), pages 907-931, December.
    19. Peeters Laurie & De Coninck David & Wuyts Celine & Loosveldt Geert, 2020. "Assessing Interviewer Performance in Approaching Reissued Initial Nonrespondents," Journal of Official Statistics, Sciendo, vol. 36(3), pages 589-607, September.
    20. Durrant, Gabriele B. & Steele, Fiona, 2009. "Multilevel modelling of refusal and non-contact in household surveys: evidence from six UK Government surveys," LSE Research Online Documents on Economics 50112, London School of Economics and Political Science, LSE Library.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:34:y:2018:i:3:p:649-670:n:4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.