IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v36y2020i3p469-487n2.html
   My bibliography  Save this article

Survey Nonresponse Trends and Fieldwork Effort in the 21st Century: Results of an International Study across Countries and Surveys

Author

Listed:
  • Luiten Annemieke

    (Statistics Netherlands, P.O. Box 4481, 6401 CZ Heerlen. theNetherlands.)

  • Hox Joop

    (Department of Methodology and Statistics, Utrecht University, P.O. Box 80140, 3508 TC, Utrecht, theNetherlands.)

  • de Leeuw Edith

    (Department of Methodology and Statistics, Utrecht University, P.O. Box 80140, 3508 TC, Utrecht, theNetherlands.)

Abstract

For more than three decades, declining response rates have been of concern to both survey methodologists and practitioners. Still, international comparative studies have been scarce. In one of the first international trend analyses for the period 1980–1997, De Leeuw and De Heer (2002) describe that response rates declined over the years and that countries differed in response rates and nonresponse trends. In this article, we continued where De Leeuw and De Heer (2002) stopped, and present trend data for the next period 1998–2015 from National Statistical Institutes. When we looked at trends over time in this new data set, we found that response rates are still declining over the years. Furthermore, nonresponse trends do differ over countries, but not over surveys. Some countries show a steeper decline in response than others, but all types of surveys show the same downward trend. The differences in (non)response trends over countries can be partly explained by differences in survey design between the countries. Finally, for some countries cost indicators were available, these showed that costs increased over the years and are negatively correlated with noncontact rates.

Suggested Citation

  • Luiten Annemieke & Hox Joop & de Leeuw Edith, 2020. "Survey Nonresponse Trends and Fieldwork Effort in the 21st Century: Results of an International Study across Countries and Surveys," Journal of Official Statistics, Sciendo, vol. 36(3), pages 469-487, September.
    • Handle: RePEc:vrs:offsta:v:36:y:2020:i:3:p:469-487:n:2
    DOI: 10.2478/jos-2020-0025
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2020-0025
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2020-0025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joop Hox & Edith Leeuw, 1994. "A comparison of nonresponse in mail, telephone, and face-to-face surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(4), pages 329-344, November.
    2. Larsen Luke J. & Lineback Joanna Fane & Reist Benjamin M., 2020. "Continuing to Explore the Relation between Economic and Political Factors and Government Survey Refusal Rates: 1960–2015," Journal of Official Statistics, Sciendo, vol. 36(3), pages 489-505, September.
    3. Schouten, Barry & Shlomo, Natalie & Skinner, Chris J., 2011. "Indicators for monitoring and improving representativeness of response," LSE Research Online Documents on Economics 39121, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martin Ravallion, 2022. "Missing Top Income Recipients," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 20(1), pages 205-222, March.
    2. Bergh, Andreas & Bjørnskov, Christian & Öhrvall, Richard, 2023. "Nonresponse Bias in Trust Surveys," Working Paper Series 1455, Research Institute of Industrial Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wießner, Frank, 1998. "Das Überbrückungsgeld als Instrument der Arbeitsmarktpolitik : eine Zwischenbilanz (Bridging allowance as an instrument of labour market policy : a provisional appraisal)," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 31(1), pages 123-142.
    2. Wießner, Frank, 2003. "Nonresponse bei Verbleibsuntersuchungen : Korrekturverfahren zu Antwortausfällen am Beispiel ehemals arbeitsloser Existenzgründer, die mit dem Überbrückungsgeld (§ 57 SGB III) gefördert wurden (Non-re," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 36(1), pages 77-96.
    3. Carl-Erik Särndal & Imbi Traat & Kaur Lumiste, 2018. "Interaction Between Data Collection And Estimation Phases In Surveys With Nonresponse," Statistics in Transition New Series, Polish Statistical Association, vol. 19(2), pages 183-200, June.
    4. Roberts Caroline & Vandenplas Caroline & Herzing Jessica M.E., 2020. "A Validation of R-Indicators as a Measure of the Risk of Bias using Data from a Nonresponse Follow-Up Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 675-701, September.
    5. Henk Van Goor & Sonja Rispens, 2004. "A Middle Class Image of Society," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(1), pages 35-49, February.
    6. Plewis Ian & Shlomo Natalie, 2017. "Using Response Propensity Models to Improve the Quality of Response Data in Longitudinal Studies," Journal of Official Statistics, Sciendo, vol. 33(3), pages 753-779, September.
    7. Stephanie Coffey, PhD. & Jaya Damineni & John Eltinge, PhD. & Anup Mathur, PhD. & Kayla Varela & Allison Zotti, 2023. "Some Open Questions on Multiple-Source Extensions of Adaptive-Survey Design Concepts and Methods," Working Papers 23-03, Center for Economic Studies, U.S. Census Bureau.
    8. Li-Chun Zhang & Ib Thomsen & Øyvin Kleven, 2013. "On the Use of Auxiliary and Paradata for Dealing With Non-sampling Errors in Household Surveys," International Statistical Review, International Statistical Institute, vol. 81(2), pages 270-288, August.
    9. Bryan L. Williams & Sylvia Brown & Michael Greenberg & Mokbul A. Kahn, 1999. "Risk Perception in Context: The Savannah River Site Stakeholder Study," Risk Analysis, John Wiley & Sons, vol. 19(6), pages 1019-1035, December.
    10. Wießner, Frank, 1998. "Das Überbrückungsgeld als Instrument der Arbeitsmarktpolitik : eine Zwischenbilanz (Bridging allowance as an instrument of labour market policy : a provisional appraisal)," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 31(1), pages 123-142.
    11. Lundquist Peter & Särndal Carl-Erik, 2013. "Aspects of Responsive Design with Applications to the Swedish Living Conditions Survey," Journal of Official Statistics, Sciendo, vol. 29(4), pages 557-582, December.
    12. Aneta Chmielewska & Małgorzata Renigier-Biłozor & Artur Janowski, 2022. "Representative Residential Property Model—Soft Computing Solution," IJERPH, MDPI, vol. 19(22), pages 1-24, November.
    13. Silvia Biffignandi & Alessandro Zeli, 2021. "Longitudinal business data construction and quality: Two different approaches," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 75(2), pages 92-114, May.
    14. Olga Maslovskaya & Peter Lugtig, 2022. "Representativeness in six waves of CROss‐National Online Survey (CRONOS) panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 851-871, July.
    15. Sjöberg, Lennart, 2004. "Gene Technology in the eyes of the public and experts. Moral opinions, attitudes and risk perception," SSE/EFI Working Paper Series in Business Administration 2004:7, Stockholm School of Economics, revised 11 May 2005.
    16. Jamie C. Moore & Gabriele B. Durrant & Peter W. F. Smith, 2021. "Do coefficients of variation of response propensities approximate non‐response biases during survey data collection?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 301-323, January.
    17. Casola, William R. & Peterson, M. Nils & Pacifici, Krishna & Sills, Erin O. & Moorman, Christopher E., 2023. "Conservation motivations and willingness to pay for wildlife management areas among recreational user groups," Land Use Policy, Elsevier, vol. 132(C).
    18. Sorin George Toma & Oana Simona Hudea, 2024. "Generation Z Students’ Perceptions on the Abilities, Skills and Competencies Required in the Age of Artificial Intelligence Systems," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 26(65), pages 162-162, February.
    19. Särndal Carl-Erik & Traat Imbi & Lumiste Kaur, 2018. "Interaction Between Data Collection And Estimation Phases In Surveys With Nonresponse," Statistics in Transition New Series, Statistics Poland, vol. 19(2), pages 183-200, June.
    20. Wießner, Frank, 2003. "Nonresponse bei Verbleibsuntersuchungen : Korrekturverfahren zu Antwortausfällen am Beispiel ehemals arbeitsloser Existenzgründer, die mit dem Überbrückungsgeld (§ 57 SGB III) gefördert wurden (Non-re," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 36(1), pages 77-96.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:36:y:2020:i:3:p:469-487:n:2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.