IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/10456.html
   My bibliography  Save this paper

Using Paradata to Assess Respondent Burden and Interviewer Effects in HouseholdSurveys : Evidence from Low- and Middle-Income Countries

Author

Listed:
  • Hasanbasri,Ardina Roosiany
  • Kilic,Talip
  • Koolwal,Gayatri B.
  • Moylan,Heather G.

Abstract

Over the past decade, national statistical offices in low- and middle-income countries haveincreasingly transitioned to computer-assisted personal interviewing and computer-assisted telephone interviewingfor the implementation of household surveys. The byproducts of these types of data collection are survey paradata, whichcan unlock objective, module- and question-specific, actionable insights on respondent burden, survey costs, andinterviewer effects. This study does precisely that, using paradata generated by the Survey Solutions computer-assistedpersonal interviewing platform in recent national household surveys implemented by the national statistical offices inCambodia, Ethiopia, and Tanzania. Across countries, the average household interview, based on a socioeconomichousehold questionnaire, ranges from 82 to 120 minutes,while the average interview with an adult household member, based on a multi-topic individual questionnaire, takesbetween 13 to 25 minutes. Using a multilevel model that is estimated for each household and individual questionnairemodule, the paper shows that interviewer effects on module duration are significantly larger than the estimates fromhigh-income contexts. Food consumption, household roster, and non-farm enterprises consistently emerge among the topfive household questionnaire modules in terms of total variance in duration, with 5 to 50 percent of thevariability being attributable to interviewers. Similarly, labor, health, and land ownership appear among the top fiveindividual questionnaire modules in terms of total variance in duration, with 6 to 50 percent of the variability beingattributable to interviewers. These findings, particularly by module, point to where additional interviewer training,fieldwork supervision, and data quality monitoring may be needed in future surveys.

Suggested Citation

  • Hasanbasri,Ardina Roosiany & Kilic,Talip & Koolwal,Gayatri B. & Moylan,Heather G., 2023. "Using Paradata to Assess Respondent Burden and Interviewer Effects in HouseholdSurveys : Evidence from Low- and Middle-Income Countries," Policy Research Working Paper Series 10456, The World Bank.
  • Handle: RePEc:wbk:wbrwps:10456
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/099824005242320076/pdf/IDU0910ce2cc031db048f2098490a3eac266bd76.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kilic, Talip & Moylan, Heather & Koolwal, Gayatri, 2021. "Getting the (Gender-Disaggregated) lay of the land: Impact of survey respondent selection on measuring land ownership and rights," World Development, Elsevier, vol. 146(C).
    2. Mick P. Couper & Frauke Kreuter, 2013. "Using paradata to explore item level response times in surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 271-286, January.
    3. Johanna Choumert‐Nkolo & Henry Cust & Callum Taylor, 2019. "Using paradata to collect better survey data: Evidence from a household survey in Tanzania," Review of Development Economics, Wiley Blackwell, vol. 23(2), pages 598-618, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.
    2. Goel, Deepti & Abraham, Rosa & Lahoti, Rahul, 2022. "Improving Survey Quality using Paradata: Lessons from the India Working Survey," GLO Discussion Paper Series 1035, Global Labor Organization (GLO).
    3. Jochen Mayerl & Thorsten Faas, 2018. "Campaign dynamics of cognitive accessibility of political judgments: measuring the impact of campaigns and campaign events using response latencies in two German rolling cross section studies," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1575-1592, July.
    4. Yan Ting & Williams Douglas, 2022. "Response Burden – Review and Conceptual Framework," Journal of Official Statistics, Sciendo, vol. 38(4), pages 939-961, December.
    5. Genicot, Garance & Hernandez-de-Benito, Maria, 2022. "Women’s land rights and village institutions in Tanzania," World Development, Elsevier, vol. 153(C).
    6. Talip Kilic & Goedele Van den & Gayatri Koolwal & Heather Moylan, 2023. "Are You Being Asked? Impacts of Respondent Selection on Measuring Employment in Malawi," Journal of African Economies, Centre for the Study of African Economies, vol. 32(5), pages 495-522.
    7. Maria Coelho & Aieshwarya Davis & Alexander Klemm & Carolina Osorio-Buitron, 2024. "Gendered taxes: the interaction of tax policy with gender equality," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 31(5), pages 1413-1460, October.
    8. Deininger, Klaus & Xia, Fang & Kilic, Talip & Moylan, Heather, 2021. "Investment impacts of gendered land rights in customary tenure systems: Substantive and methodological insights from Malawi," World Development, Elsevier, vol. 147(C).
    9. Rao, Lakshman Nagraj & Gentile, Elisabetta & Pipon, Dave & Roque, Jude David & Thuy, Vu Thi Thu, 2020. "The impact of computer-assisted personal interviewing on survey duration, quality, and cost: Evidence from the Viet Nam Labor Force Survey," GLO Discussion Paper Series 605, Global Labor Organization (GLO).
    10. Maleva, Tatyana Mikhailovna (Малева, Татьяна Михайловна) & Avraamova, Elena (Авраамова, Елена) & Kirillova, M. K. (Кириллова, М. К.) & Burdyak, Alexandra (Бурдяк, Александра) & Tyndik, Alla (Тындик, А, 2014. "Sociological Monitoring Survey of Wages, Income, Poverty and Social Inequality [Социологическое Мониторинговое Обследование Заработных Плат, Доходов, Бедности И Социального Неравенства]," Published Papers om27, Russian Presidential Academy of National Economy and Public Administration.
    11. Raphael Studer & Rainer Winkelmann, 2014. "Reported Happiness, Fast and Slow," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(3), pages 1055-1067, July.
    12. Carstensen Johann & Lang Sebastian & Cordua Fine, 2022. "The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey," Journal of Official Statistics, Sciendo, vol. 38(4), pages 1069-1095, December.
    13. Johanna Choumert-Nkolo & Pascale Phelinas, 2018. "New paradigms for household surveys in low and middle income countries [Nouveaux paradigmes d'élaboration des enquêtes ménages dans les pays du Sud]," CERDI Working papers halshs-01888609, HAL.
    14. Calogero Carletto, 2021. "Better data, higher impact: improving agricultural data systems for societal change [Correlated non-classical measurement errors, ‘second best’ policy inference, and the inverse size-productivity r," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 48(4), pages 719-740.
    15. Julien, Jacques C. & Bravo-Ureta, Boris E. & Rada, Nicholas E., 2023. "Gender and agricultural Productivity: Econometric evidence from Malawi, Tanzania, and Uganda," World Development, Elsevier, vol. 171(C).
    16. Joshua Brubaker & Talip Kilic & Philip Wollburg, 2021. "Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-27, November.
    17. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    18. Brooks, Mark & Lippe, Rattiya S. & Waibel, Hermann, 2021. "PAPI is gone, but errors remain: Non-sampling errors in household surveys," 2021 Conference, August 17-31, 2021, Virtual 315277, International Association of Agricultural Economists.
    19. Hasanbasri,Ardina Roosiany & Kilic,Talip & Koolwal,Gayatri B. & Moylan,Heather G., 2022. "Individual Wealth Inequality : Measurement and Evidence from Low- and Middle-Income Countries," Policy Research Working Paper Series 9987, The World Bank.
    20. Ardina Hasanbasri & Talip Kilic & Gayatri Koolwal & Heather Moylan, 2023. "Multidimensionality of Landownership among Men and Women in Sub-Saharan Africa," Journal of Law and Economics, University of Chicago Press, vol. 66(3), pages 581-608.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:10456. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.