IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v153y2021ics0304387821001073.html
   My bibliography  Save this article

Are we done yet? Response fatigue and rural livelihoods

Author

Listed:
  • Ambler, Kate
  • Herskowitz, Sylvan
  • Maredia, Mywish K.

Abstract

Effective policy requires an accurate understanding of peoples’ livelihoods activities. The data for this evidence is often generated via lengthy surveys where designated respondents provide information about their household members. This burden on respondents may lead to both losses and biases as they grow fatigued during the interview. We test these hypotheses with an experiment in rural Ghana where we randomize individual household members’ position in the labor module. We find that moving a household member back by one position reduces their reported number of productive activities by 2.2% with average aggregate losses of 7.9%, or approximately one out of every twelve activities. Losses for women and youth are closer to one in nine. These biases result from both differential exposure to response fatigue (being positioned later in rosters) and differential vulnerability (greater impacts conditional on position). These results have important implications for data quality across many settings and topics.

Suggested Citation

  • Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Are we done yet? Response fatigue and rural livelihoods," Journal of Development Economics, Elsevier, vol. 153(C).
  • Handle: RePEc:eee:deveco:v:153:y:2021:i:c:s0304387821001073
    DOI: 10.1016/j.jdeveco.2021.102736
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387821001073
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2021.102736?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Beaman, Lori & Dillon, Andrew, 2012. "Do household definitions matter in survey design? Results from a randomized survey experiment in Mali," Journal of Development Economics, Elsevier, vol. 98(1), pages 124-135.
    2. Frank Ellis & H Ade Freeman, 2004. "Rural Livelihoods and Poverty Reduction Strategies in Four African Countries," Journal of Development Studies, Taylor & Francis Journals, vol. 40(4), pages 1-30.
    3. Peter Lanjouw & Rinku Murgai & Nicholas Stern, 2013. "Nonfarm diversification, poverty, economic mobility, and income inequality: a case study in village India," Agricultural Economics, International Association of Agricultural Economists, vol. 44(4-5), pages 461-473, July.
    4. Andersson Djurfeldt, Agnes, 2013. "African Re-Agrarianization? Accumulation or Pro-Poor Agricultural Growth?," World Development, Elsevier, vol. 41(C), pages 217-231.
    5. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    6. Van den Broeck, Goedele & Kilic, Talip, 2019. "Dynamics of off-farm employment in Sub-Saharan Africa: A gender perspective," World Development, Elsevier, vol. 119(C), pages 81-99.
    7. Felix Kwame Yeboah & Thomas S. Jayne, 2018. "Africa’s Evolving Employment Trends," Journal of Development Studies, Taylor & Francis Journals, vol. 54(5), pages 803-832, May.
    8. Haggblade, Steven & Hazell, Peter & Reardon, Thomas, 2010. "The Rural Non-farm Economy: Prospects for Growth and Poverty Reduction," World Development, Elsevier, vol. 38(10), pages 1429-1441, October.
    9. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    10. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    11. Frank Ellis, 1998. "Household strategies and rural livelihood diversification," Journal of Development Studies, Taylor & Francis Journals, vol. 35(1), pages 1-38.
    12. Fox, Louise & Pimhidzai, Obert, 2013. "Different dreams, same bed : collecting, using, and interpreting employment statistics in Sub-Saharan Africa -- the case of Uganda," Policy Research Working Paper Series 6436, The World Bank.
    13. Fafchamps, Marcel & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2012. "Using PDA consistency checks to increase the precision of profits and sales measurement in panels," Journal of Development Economics, Elsevier, vol. 98(1), pages 51-57.
    14. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    15. Serneels, Pieter & Beegle, Kathleen & Dillon, Andrew, 2017. "Do returns to education depend on how and whom you ask?," Economics of Education Review, Elsevier, vol. 60(C), pages 5-19.
    16. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    17. Abay, Kibrom A. & Berhane, Guush & Hoddinott, John F. & Tafere, Kibrom, 2021. "Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia," IFPRI discussion papers 2017, International Food Policy Research Institute (IFPRI).
    18. Lynn, Peter & Roberts, Caroline & Allum, Nick & Eva, Gillian, 2010. "Data quality in telephone surveys and the effect of questionnaire length: a cross- national experiment," ISER Working Paper Series 2010-36, Institute for Social and Economic Research.
    19. Michele Di Maio & Nathan Fiala, 0. "Be Wary of Those Who Ask: A Randomized Experiment on the Size and Determinants of the Enumerator Effect," The World Bank Economic Review, World Bank, vol. 34(3), pages 654-669.
    20. Ambler, Kate & de Brauw, Alan & Murphy, Mike, 2020. "Increasing the adoption of conservation agriculture: A framed field experiment in Northern Ghana," IFPRI discussion papers 1932, International Food Policy Research Institute (IFPRI).
    21. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338.
    22. Sarah Bridges & David Lawson & Sharifa Begum, 2011. "Labour Market Outcomes in Bangladesh: The Role of Poverty and Gender Norms," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 23(3), pages 459-487, July.
    23. Imai, Katsushi S. & Gaiha, Raghav & Thapa, Ganesh, 2015. "Does non-farm sector employment reduce rural poverty and vulnerability? Evidence from Vietnam and India," Journal of Asian Economics, Elsevier, vol. 36(C), pages 47-61.
    24. Das, Jishnu & Hammer, Jeffrey & Sánchez-Paramo, Carolina, 2012. "The impact of recall periods on reported morbidity and health seeking behavior," Journal of Development Economics, Elsevier, vol. 98(1), pages 76-88.
    25. Fred Mawunyo Dzanku, 2020. "Poverty Reduction And Economic Livelihood Mobility In Rural Sub‐Saharan Africa," Journal of International Development, John Wiley & Sons, Ltd., vol. 32(5), pages 636-683, July.
    26. Hess, Stephane & Hensher, David A. & Daly, Andrew, 2012. "Not bored yet – Revisiting respondent fatigue in stated choice experiments," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(3), pages 626-644.
    27. Ray Langsten & Rania Salen, 2008. "Two Approaches to Measuring Women's Work in Developing Countries: A Comparison of Survey Data from Egypt," Population and Development Review, The Population Council, Inc., vol. 34(2), pages 283-305, June.
    28. Desiere,Sam & Costa,Valentina, 2019. "Employment Data in Household Surveys : Taking Stock, Looking Ahead," Policy Research Working Paper Series 8882, The World Bank.
    29. Davis, Benjamin & Winters, Paul & Carletto, Gero & Covarrubias, Katia & Quiñones, Esteban J. & Zezza, Alberto & Stamoulis, Kostas & Azzarri, Carlo & DiGiuseppe, Stefania, 2010. "A Cross-Country Comparison of Rural Income Generating Activities," World Development, Elsevier, vol. 38(1), pages 48-63, January.
    30. Stephan Klasen & Francesca Lamanna, 2009. "The Impact of Gender Inequality in Education and Employment on Economic Growth: New Evidence for a Panel of Countries," Feminist Economics, Taylor & Francis Journals, vol. 15(3), pages 91-132.
    31. Gordon Betcherman & Themrise Khan, 2018. "Jobs for Africa’s expanding youth cohort: a stocktaking of employment prospects and policy interventions," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-20, December.
    32. Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
    33. Deininger, Klaus & Carletto, Calogero & Savastano, Sara & Muwonge, James, 2012. "Can diaries help in improving agricultural production statistics? Evidence from Uganda," Journal of Development Economics, Elsevier, vol. 98(1), pages 42-50.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gourlay,Sydney & Maggio,Giuseppe & Safyan,Anahit & Zezza,Alberto, 2022. "Measuring Land Tenure at the Individual Level : Lessons from Methodological Research in Armenia," Policy Research Working Paper Series 10140, The World Bank.
    2. Delavallade, Clara & Godlonton, Susan, 2023. "Locking crops to unlock investment: Experimental evidence on warrantage in Burkina Faso," Journal of Development Economics, Elsevier, vol. 160(C).
    3. Talip Kilic & Goedele Van den & Gayatri Koolwal & Heather Moylan, 2023. "Are You Being Asked? Impacts of Respondent Selection on Measuring Employment in Malawi," Journal of African Economies, Centre for the Study of African Economies, vol. 32(5), pages 495-522.
    4. Abay, Kibrom A. & Berhane, Guush & Hoddinott, John F. & Tafere, Kibrom, 2021. "Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia," IFPRI discussion papers 2017, International Food Policy Research Institute (IFPRI).
    5. Adzawla, William & Setsoafia, Edinam D. & Setsoafia, Eugene D. & Amoabeng-Nimako, Solomon & Atakora, Williams K. & Bindraban, Prem D., 2024. "Accuracy of agricultural data and implications for policy: Evidence from maize farmer recall surveys and crop cuts in the Guinea Savannah zone of Ghana," Agricultural Systems, Elsevier, vol. 214(C).
    6. Jeong, Dahyeon & Aggarwal, Shilpa & Robinson, Jonathan & Kumar, Naresh & Spearot, Alan & Park, David Sungho, 2023. "Exhaustive or exhausting? Evidence on respondent fatigue in long surveys," Journal of Development Economics, Elsevier, vol. 161(C).
    7. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    8. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    9. Nakamura, Nobuyuki & Suzuki, Aya, 2022. "How Altruism Works during a Pandemic: Examining the Roles of Financial Support and Degrees of Individual Altruism on International Remittance," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322073, Agricultural and Applied Economics Association.
    10. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    11. Tilman Brück & Mekdim D. Regassa, 2023. "Usefulness and misrepresentation of phone surveys on COVID-19 and food security in Africa," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 15(2), pages 423-453, April.
    12. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    13. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    14. Akramov, Kamiljon & Carrillo, Lucia & Kosec, Katrina, 2021. "Covid-19, Rural Poverty, and Women’s Role in Decision-Making: Evidence from Khatlon Province in Tajikistan," OSF Preprints j7vrm, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Rural Labor and Long Recall Loss," Staff Paper Series 316616, Michigan State University, Department of Agricultural, Food, and Resource Economics.
    2. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    3. repec:lic:licosd:41819 is not listed on IDEAS
    4. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    5. Kilic,Talip & Van den Broeck,Goedele & Koolwal,Gayatri B. & Moylan,Heather G., 2020. "Are You Being Asked ? Impacts of Respondent Selection on Measuring Employment," Policy Research Working Paper Series 9152, The World Bank.
    6. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    7. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    8. Zezza,Alberto & Mcgee,Kevin Robert & Wollburg,Philip Randolph & Assefa,Thomas Woldu & Gourlay,Sydney, 2022. "From Necessity to Opportunity : Lessons for Integrating Phone and In-Person Data Collectionfor Agricultural Statistics in a Post-Pandemic World," Policy Research Working Paper Series 10168, The World Bank.
    9. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    10. Zeeshan & Geetilaxmi Mohapatra & Arun Kumar Giri, 2022. "How Farm Household Spends Their Non-farm Incomes in Rural India? Evidence from Longitudinal Data," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(4), pages 1967-1996, August.
    11. Dang, Hai-Anh H & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    12. Chaoran Chen & Diego Restuccia & Raül Santaeulàlia-Llopis, 2023. "Land Misallocation and Productivity," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 441-465, April.
    13. Vaiknoras, Kate & Larochelle, Catherine & Alwang, Jeffrey, 2020. "IFAD RESERACH SERIES 64 - How the adoption of drought-tolerant rice varieties impacts households in a non-drought year: Evidence from Nepal," IFAD Research Series 308809, International Fund for Agricultural Development (IFAD).
    14. Zezza, Alberto & Federighi, Giovanni & Kalilou, Amadou Adamou & Hiernaux, Pierre, 2016. "Milking the data: Measuring milk off-take in extensive livestock systems. Experimental evidence from Niger," Food Policy, Elsevier, vol. 59(C), pages 174-186.
    15. De Magalhães, Leandro & Santaeulàlia-Llopis, Raül, 2018. "The consumption, income, and wealth of the poorest: An empirical analysis of economic inequality in rural and urban Sub-Saharan Africa for macroeconomists," Journal of Development Economics, Elsevier, vol. 134(C), pages 350-371.
    16. Jose Galdo & Ana C Dammert & Degnet Abebaw, 2021. "Gender Bias in Agricultural Child Labor: Evidence from Survey Design Experiments," The World Bank Economic Review, World Bank, vol. 35(4), pages 872-891.
    17. Ugo Pica-Ciamarra & Derek Baker & Nancy Morgan & Alberto Zezza & Carlo Azzarri & Cheikh Ly & Longin Nsiima & Simplice Nouala & Patrick Okello & Joseph Sserugga, 2014. "Investing in the Livestock Sector : Why Good Numbers Matter, A Sourcebook for Decision Makers on How to Improve Livestock Data," World Bank Publications - Reports 17830, The World Bank Group.
    18. Calogero Carletto & Dean Jolliffe & Raka Banerjee, 2015. "From Tragedy to Renaissance: Improving Agricultural Data for Better Policies," Journal of Development Studies, Taylor & Francis Journals, vol. 51(2), pages 133-148, February.
    19. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    20. Vaiknoras, Kate A. & Larochelle, Catherine & Alwang, Jeffrey, 2021. "How the adoption of drought-tolerant rice varieties impacts households in a non-drought year: Evidence from Nepal," 2021 Annual Meeting, August 1-3, Austin, Texas 313877, Agricultural and Applied Economics Association.
    21. Koolwal, Gayatri B., 2021. "Improving the measurement of rural women's employment: Global momentum and survey priorities," World Development, Elsevier, vol. 147(C).

    More about this item

    Keywords

    Labor; Response fatigue; Gender; Youth; Survey methods; Proxy reporting;
    All these keywords.

    JEL classification:

    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • Q1 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:153:y:2021:i:c:s0304387821001073. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.