IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/10029.html
   My bibliography  Save this paper

Effects of Data Collection Methods on Estimated Household Consumption and Survey Costs : Evidence from an Experiment in the Marshall Islands

Author

Listed:
  • Sharp,Michael K.
  • Buffière,Bertrand
  • Himelein,Kristen
  • Troubat,Nathalie
  • Gibson,John

Abstract

In the Pacific, multitopic household surveys have historically gathered expenditure data using open form diaries completed on paper. This methodology is costly to governments, is burdensome for respondents, and takes substantial time to process the results. Noncompliance and partial compliance in diary keeping can artificially inflate poverty measures, biasing economic statistics. This paper reports findings from an experiment in the Marshall Islands comparing the cost and accuracy of several collection methodologies. Variable costs for the status quo diary survey design are between 2.8 and 4.4 times more expensive than a single-visit seven-day recall survey, with the tablet-based diary being even more costly. The highly monitored diaries give similar results to recall but at much greater cost; the status quo yields data of worse quality as effective completion rates with low monitored diaries are only two-thirds the completion rates of recall-based options. Finally, the paper discusses the implementation challenges associated with the different methods in a capacity-constrained environment.

Suggested Citation

  • Sharp,Michael K. & Buffière,Bertrand & Himelein,Kristen & Troubat,Nathalie & Gibson,John, 2022. "Effects of Data Collection Methods on Estimated Household Consumption and Survey Costs : Evidence from an Experiment in the Marshall Islands," Policy Research Working Paper Series 10029, The World Bank.
    • Handle: RePEc:wbk:wbrwps:10029
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/099834004282216747/pdf/IDU014657f420d00e042a30a68903563423f5b37.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alan de Brauw & Sylvan Herskowitz, 2021. "Income Variability, Evolving Diets, and Elasticity Estimation of Demand for Processed Foods in Nigeria," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(4), pages 1294-1313, August.
    2. Borlizzi, Andrea & Delgrossi, Mauro Eduardo & Cafiero, Carlo, 2017. "National food security assessment through the analysis of food consumption data from Household Consumption and Expenditure Surveys: The case of Brazil’s Pesquisa de Orçamento Familiares 2008/09," Food Policy, Elsevier, vol. 72(C), pages 20-26.
    3. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    4. Brzozowski, Matthew & Crossley, Thomas F. & Winter, Joachim K., 2017. "A comparison of recall and diary food expenditure data," Food Policy, Elsevier, vol. 72(C), pages 53-61.
    5. Joachim De Weerdt & Kathleen Beegle & Jed Friedman & John Gibson, 2016. "The Challenge of Measuring Hunger through Survey," Economic Development and Cultural Change, University of Chicago Press, vol. 64(4), pages 727-758.
    6. Fiedler, John L. & Yadav, Suryakant, 2017. "How can we better capture food away from Home? Lessons from India’s linking person-level meal and household-level food data," Food Policy, Elsevier, vol. 72(C), pages 81-93.
    7. Backiny-Yetna,Prospere R. & Yacoubou Djima,Ismael & Steele,Diane E. & Backiny-Yetna,Prospere R. & Yacoubou Djima,Ismael & Steele,Diane E., 2014. "The impact of household food consumption data collection methods on poverty and inequality measures in Niger," Policy Research Working Paper Series 7090, The World Bank.
    8. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    9. Zezza, Alberto & Carletto, Calogero & Fiedler, John L. & Gennari, Pietro & Jolliffe, Dean, 2017. "Food counts. Measuring food consumption and expenditures in household consumption and expenditure surveys (HCES). Introduction to the special issue," Food Policy, Elsevier, vol. 72(C), pages 1-6.
    10. Farfán, Gabriela & Genoni, María Eugenia & Vakis, Renos, 2017. "You are what (and where) you eat: Capturing food away from home in welfare measures," Food Policy, Elsevier, vol. 72(C), pages 146-156.
    11. Zezza, Alberto & Carletto, Gero & Fiedler, John L & Gennari, Pietro & Jolliffe, Dean M, 2017. "Food Counts. Measuring Food Consumption And Expenditures In Household Consumption And Expenditure Surveys (HCES)," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 260886, European Association of Agricultural Economists.
    12. John Gibson & Bonggeun Kim, 2012. "Testing the Infrequent Purchases Model Using Direct Measurement of Hidden Consumption from Food Stocks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(1), pages 257-270.
    13. Friedman, Jed & Beegle, Kathleen & De Weerdt, Joachim & Gibson, John, 2017. "Decomposing response error in food consumption measurement: Implications for survey design from a randomized survey experiment in Tanzania," Food Policy, Elsevier, vol. 72(C), pages 94-111.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zezza, Alberto & Carletto, Calogero & Fiedler, John L. & Gennari, Pietro & Jolliffe, Dean, 2017. "Food counts. Measuring food consumption and expenditures in household consumption and expenditure surveys (HCES). Introduction to the special issue," Food Policy, Elsevier, vol. 72(C), pages 1-6.
    2. Ameye, Hannah & De Weerdt, Joachim & Gibson, John, 2021. "Measuring macro- and micronutrient consumption in multi-purpose surveys: Evidence from a survey experiment in Tanzania," Food Policy, Elsevier, vol. 102(C).
    3. Zezza, Alberto & Carletto, Gero & Fiedler, John L & Gennari, Pietro & Jolliffe, Dean M, 2017. "Food Counts. Measuring Food Consumption And Expenditures In Household Consumption And Expenditure Surveys (HCES)," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 260886, European Association of Agricultural Economists.
    4. repec:lic:licosd:42120 is not listed on IDEAS
    5. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    6. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    7. repec:lic:licosd:41819 is not listed on IDEAS
    8. Andi Syah Putra & Guangji Tong & Didit Okta Pribadi, 2020. "Spatial Analysis of Socio-Economic Driving Factors of Food Expenditure Variation between Provinces in Indonesia," Sustainability, MDPI, vol. 12(4), pages 1-18, February.
    9. Kilic, Talip & Moylan, Heather & Ilukor, John & Mtengula, Clement & Pangapanga-Phiri, Innocent, 2021. "Root for the tubers: Extended-harvest crop production and productivity measurement in surveys," Food Policy, Elsevier, vol. 102(C).
    10. Laura E. McCann & Jeffrey D. Michler & Maybin Mwangala & Osaretin Olurotimi & Natalia Estrada Carmona, 2024. "Food Without Fire: Nutritional and Environmental Impacts from a Solar Stove Field Experiment," Papers 2410.02075, arXiv.org.
    11. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    12. Pape,Utz Johann & Wollburg,Philip Randolph, 2019. "Estimation of Poverty in Somalia Using Innovative Methodologies," Policy Research Working Paper Series 8735, The World Bank.
    13. Monteiro Amaral,Sofia Fernando & Dinarte Diaz,Lelys Ileana & Dominguez,Patricio & Perez-Vincent,Santiago M. & Romero,Steffanny, 2022. "Talk or Text ? Evaluating Response Rates by Remote Survey Method during COVID-19," Policy Research Working Paper Series 9999, The World Bank.
    14. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    15. Friedman, Jed & Beegle, Kathleen & De Weerdt, Joachim & Gibson, John, 2017. "Decomposing response error in food consumption measurement: Implications for survey design from a randomized survey experiment in Tanzania," Food Policy, Elsevier, vol. 72(C), pages 94-111.
    16. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    17. Battistin, Erich & De Nadai, Michele & Krishnan, Nandini, 2020. "The Insights and Illusions of Consumption Measurements," IZA Discussion Papers 13222, Institute of Labor Economics (IZA).
    18. Gashaw T Abate & Alan de Brauw & John Gibson & Kalle Hirvonen & Abdulazize Wolle, 2022. "Telescoping Error in Recalled Food Consumption: Evidence from a Survey Experiment in Ethiopia [Video-Based Behavioral Change Communication to Change Consumption Patterns: Experimental Evidence from," The World Bank Economic Review, World Bank, vol. 36(4), pages 889-908.
    19. Himelein,Kristen, 2022. "Determining the Caloric Content of Food Consumed away from Home : An Application to theConstruction of a Cost-of-Basic-Needs Poverty Line," Policy Research Working Paper Series 10018, The World Bank.
    20. Cockx, Lara & Colen, Liesbeth & De Weerdt, Joachim, 2018. "From corn to popcorn? Urbanization and dietary change: Evidence from rural-urban migrants in Tanzania," World Development, Elsevier, vol. 110(C), pages 140-159.
    21. Nguyen, Thanh-Tung & Nguyen, Trung Thanh & Grote, Ulrike, 2020. "Multiple shocks and households' choice of coping strategies in rural Cambodia," Ecological Economics, Elsevier, vol. 167(C).
    22. Aseres Mamo Eshetie & Eunice Matafwali & Gershom Endelani Mwalupaso & Jie Li & Aijun Liu, 2022. "Nexus of Cash Crop Production Using Improved Varieties and Household Food Security," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(4), pages 1803-1830, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:10029. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.