IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i4d10.1007_s11135-023-01828-z.html
   My bibliography  Save this article

Does respondent motivation affect item-nonresponse for split-ballot designed survey data? Comparative evidence from the European Social Survey

Author

Listed:
  • Melike Saraç

    (Hacettepe University)

Abstract

Survey quality would be enhanced if respondents willingly and accurately provided their responses. This seems feasible in ideal interview settings where respondents fully understand questions and provide truthful responses. Therefore, survey outcomes may be impacted by respondents’ feelings during the interview. The purpose of this study is to determine whether there is any relationship between respondent motivation, as operationalized by willingness and ability, and the item-nonresponse level for split-ballot designed questions. The 9th round of the European Social Survey (ESS9), a cross-national survey conducted across Europe, is the source of the data. This study assesses item-nonresponse using “don’t know” and “no answer” response choices for a set of questions designed with the split-ballot technique, which has not been dealt with much. In addition to the percentage distribution of item-nonresponse levels, the correlation analysis is used to understand the relationship between respondent motivation and item-nonresponse descriptively. Multivariable analyses use multiple linear regression modeling to explore the impact of respondent motivation on item-nonresponse, controlling for respondent and interviewer characteristics. Furthermore, bivariate relationships between outcome variable and covariates in the models were assessed using design-adjusted Wald-F tests. The findings pointed out that respondent motivation and item-nonresponse have a significant, negative, and moderate association. According to the complex sample design adjusted estimates of the statistical models, it may be able to reduce item-nonresponse with the increased motivation of respondents. This study offers several recommendations for questionnaire design, interviewing techniques, and interviewer evaluations for each respondent at the end.

Suggested Citation

  • Melike Saraç, 2024. "Does respondent motivation affect item-nonresponse for split-ballot designed survey data? Comparative evidence from the European Social Survey," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(4), pages 3791-3809, August.
    • Handle: RePEc:spr:qualqt:v:58:y:2024:i:4:d:10.1007_s11135-023-01828-z
    DOI: 10.1007/s11135-023-01828-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01828-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-023-01828-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henning Silber & Joss Roßmann & Tobias Gummer & Stefan Zins & Kai Willem Weyandt, 2021. "The effects of question, respondent and interviewer characteristics on two types of item nonresponse," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 1052-1069, July.
    2. Brady T. West, 2013. "An examination of the quality and utility of interviewer observations in the National Survey of Family Growth," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 211-225, January.
    3. Michael Wagner & Matthias Kuppler & Christian Rietz & Roman Kaspar, 2019. "Non-response in surveys of very old people," European Journal of Ageing, Springer, vol. 16(2), pages 249-258, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roger Tourangeau & J. Michael Brick & Sharon Lohr & Jane Li, 2017. "Adaptive and responsive survey designs: a review and assessment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 203-223, January.
    2. Durrant Gabriele B. & Maslovskaya Olga & Smith Peter W. F., 2017. "Using Prior Wave Information and Paradata: Can They Help to Predict Response Outcomes and Call Sequence Length in a Longitudinal Study?," Journal of Official Statistics, Sciendo, vol. 33(3), pages 801-833, September.
    3. German Data Forum RatSWD (ed.), 2020. "Data collection using new information technology," RatSWD Output Series, German Data Forum (RatSWD), volume 6, number 6-6en.
    4. Pankaj Tiwari, 2022. "Bank affection and customer retention: an empirical investigation of customer trust, satisfaction, loyalty," SN Business & Economics, Springer, vol. 2(6), pages 1-27, June.
    5. Matthias Kliegel & Susanne Iwarsson & Morten Wahrendorf & Nadia Minicuci & Marja J. Aartsen, 2020. "The European Journal of Ageing at the beginning of the Decade of Healthy Ageing," European Journal of Ageing, Springer, vol. 17(1), pages 1-2, March.
    6. Guizzo Altube, Matías & Scartascini, Carlos, 2024. "Gender-Based Research and Interviewer Effects: Evidence for Latin America and the Caribbean," IDB Publications (Working Papers) 13475, Inter-American Development Bank.
    7. Mirel Lisa B. & Chowdhury Sadeq R., 2017. "Using Linked Survey Paradata to Improve Sampling Strategies in the Medical Expenditure Panel Survey," Journal of Official Statistics, Sciendo, vol. 33(2), pages 367-383, June.
    8. Erwin Stolz & Anna Schultz & Julia Zuschnegg & Franziska Großschädl & Thomas E. Dorner & Regina Roller-Wirnsberger & Wolfgang Freidl, 2024. "Disability during the last ten years of life: evidence from a register-based study in Austria," European Journal of Ageing, Springer, vol. 21(1), pages 1-13, December.
    9. Ronald R. Rindfuss & Minja K. Choe & Noriko O. Tsuya & Larry L. Bumpass & Emi Tamaki, 2015. "Do low survey response rates bias results? Evidence from Japan," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 32(26), pages 797-828.
    10. Gabriele B. Durrant & Julia D’Arrigo, 2014. "Doorstep Interactions and Interviewer Effects on the Process Leading to Cooperation or Refusal," Sociological Methods & Research, , vol. 43(3), pages 490-518, August.
    11. Melanie Zirves & Holger Pfaff, 2020. "Nursing Home Residents Aged over 80—A Cross-Sectional Analysis on Which Activity Traits Correlate to Positive Affect," IJERPH, MDPI, vol. 17(24), pages 1-13, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:4:d:10.1007_s11135-023-01828-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.