IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/10585.html
   My bibliography  Save this paper

Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?

Author

Listed:
  • Brunckhorst,Ben James
  • Kim,Yeon Soo
  • Cojocaru,Alexandru

Abstract

The World Bank’s High-Frequency Phone Surveys were deployed to support the monitoring of household welfare during the COVID-19 pandemic, when most of the regular household survey data collection was suspended. This paper reviews the analytical insights gained from the High-Frequency Phone Survey data, including uneven dynamics of household welfare during the pandemic across and within countries, as well as novel applications to simulate estimates of poverty and intergenerational mobility following the pandemic. The paper further derives lessons from the data collection experience. First, phone surveys, while inexpensive and quick, require reliable sampling frames. The predominant sampling strategies—previous household survey and random digit dialing—each have pros and cons in terms of representativeness, non-response, and post-survey adjustments. Second, on questionnaire design, country customization needs to be carefully balanced against standardization when cross-country comparisons are likely to be important. Finally, baseline metrics are critical for crisis monitoring; this requires more frequent welfare monitoring and better alignment of questions in phone surveys and existing data sources. While phone surveys can be a reliable toolkit for researchers and governments, more research is needed on key questions related to the survey mode effect, and the implications of different sampling frames and questionnaire design.

Suggested Citation

  • Brunckhorst,Ben James & Kim,Yeon Soo & Cojocaru,Alexandru, 2023. "Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?," Policy Research Working Paper Series 10585, The World Bank.
  • Handle: RePEc:wbk:wbrwps:10585
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/099352110062338328/pdf/IDU07af731dc0211104efa080d603d304efa4b54.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    2. Miles Corak, 2013. "Income Inequality, Equality of Opportunity, and Intergenerational Mobility," Journal of Economic Perspectives, American Economic Association, vol. 27(3), pages 79-102, Summer.
    3. Jeong, Dahyeon & Aggarwal, Shilpa & Robinson, Jonathan & Kumar, Naresh & Spearot, Alan & Park, David Sungho, 2023. "Exhaustive or exhausting? Evidence on respondent fatigue in long surveys," Journal of Development Economics, Elsevier, vol. 161(C).
    4. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    5. Kibrom A. Abay & Guush Berhane & John Hoddinott & Kibrom Tafere, 2023. "COVID-19 and Food Security in Ethiopia: Do Social Protection Programs Protect?," Economic Development and Cultural Change, University of Chicago Press, vol. 71(2), pages 373-402.
    6. Tilman Brück & Mekdim D. Regassa, 2023. "Usefulness and misrepresentation of phone surveys on COVID-19 and food security in Africa," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 15(2), pages 423-453, April.
    7. Davide Furceri & Prakash Loungani & Jonathan D. Ostry & Pietro Pizzuto, 2022. "Will COVID-19 Have Long-Lasting Effects on Inequality? Evidence from Past Pandemics," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 20(4), pages 811-839, December.
    8. Anna Josephson & Talip Kilic & Jeffrey D. Michler, 2021. "Socioeconomic impacts of COVID-19 in low-income countries," Nature Human Behaviour, Nature, vol. 5(5), pages 557-565, May.
    9. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    10. Johannes G. Hoogeveen & Gladys Lopez-Acevedo, 2021. "Distributional Impacts of COVID-19 in the Middle East and North Africa Region," World Bank Publications - Books, The World Bank Group, number 36618.
    11. Brian Dillon, 2012. "Using mobile phones to collect panel data in developing countries," Journal of International Development, John Wiley & Sons, Ltd., vol. 24(4), pages 518-527, May.
    12. Egger, Dennis & Miguel, Edward & Warren, Shana S. & Shenoy, Ashish & Collins, Elliott & Karlan, Dean & Parkerson, Doug & Mobarak, A. Mushfiq & Fink, Günther & Udry, Christopher & Walker, Michael & Hau, 2021. "Falling living standards during the COVID-19 crisis: Quantitative evidence from nine developing countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(6), pages 1-1.
    13. Glazerman, Steven & Grépin, Karen A. & Mueller, Valerie & Rosenbaum, Michael & Wu, Nicole, 2023. "Do referrals improve the representation of women in mobile phone surveys?," Journal of Development Economics, Elsevier, vol. 162(C).
    14. Ahmed Mushfiq Mobarak & Edward Miguel, 2022. "The Economics of the COVID-19 Pandemic in Poor Countries," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 253-285, August.
    15. William Msemburi & Ariel Karlinsky & Victoria Knutson & Serge Aleshin-Guendel & Somnath Chatterji & Jon Wakefield, 2023. "The WHO estimates of excess mortality associated with the COVID-19 pandemic," Nature, Nature, vol. 613(7942), pages 130-137, January.
    16. Alberto Zezza & Kevin McGee & Philip Wollburg & Thomas Assefa & Sydney Gourlay, 2023. "From necessity to opportunity: lessons for integrating phone and in-person data collection," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(4), pages 1364-1400.
    17. World Bank, 2023. "Latin America and the Caribbean Macro Poverty Outlook," World Bank Publications - Reports 40516, The World Bank Group.
    18. Robert Garlick & Kate Orkin & Simon Quinn, 2020. "Call Me Maybe: Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys," The World Bank Economic Review, World Bank, vol. 34(2), pages 418-443.
    19. Nolte, Kerstin & Sipangule, Kacana & Wendt, Niels, 2022. "Agricultural households in times of crisis. The COVID-19 pandemic, livelihoods and land-use decisions," Open Access Publications from Kiel Institute for the World Economy 261843, Kiel Institute for the World Economy (IfW Kiel).
    20. Nolte, Kerstin & Sipangule, Kacana & Wendt, Niels, 2022. "Agricultural households in times of crisis. The COVID-19 pandemic, livelihoods and land-use decisions," Open Access Publications from Kiel Institute for the World Economy 266633, Kiel Institute for the World Economy (IfW Kiel).
    21. World Bank, 2023. "Digital Economy for Latin America and the Caribbean - Country Diagnostic [Economía Digital para América Latina y el Caribe - Diagnóstico de país]," World Bank Publications - Reports 39906, The World Bank Group.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    2. Brunckhorst, Ben & Cojocaru, Alexandru & Kim, Yeon Soo & Kugler, Maurice, 2024. "Long COVID: The evolution of household welfare in developing countries during the pandemic," World Development, Elsevier, vol. 175(C).
    3. Abay, Kibrom A. & Tafere, Kibrom & Berhane, Guush & Chamberlin, Jordan & Abay, Mehari H., 2023. "Near-real-time welfare and livelihood impacts of an active war: Evidence from Ethiopia," Food Policy, Elsevier, vol. 119(C).
    4. Elena Serfilippi & Daniele Giovannucci & David Ameyaw & Ankur Bansal & Thomas Asafua Nketsia Wobill & Roberta Blankson & Rashi Mishra, 2022. "Benefits and Challenges of Making Data More Agile: A Review of Recent Key Approaches in Agriculture," Sustainability, MDPI, vol. 14(24), pages 1-18, December.
    5. Dang, Hai-Anh H. & Oseni, Gbemisola & Abanokova, Kseniya, 2025. "Educational inequalities during COVID-19: Results from longitudinal surveys in Sub-Saharan Africa," International Journal of Educational Development, Elsevier, vol. 112(C).
    6. Peterson-Wilhelm, Bailey & Schwab, Benjamin, 2024. "How does recall bias in farm labor impact separability tests?," Food Policy, Elsevier, vol. 128(C).
    7. Beegle, Kathleen & Dillon, Andrew & Karlan, Dean & Udry, Christopher, 2024. "Introduction to the journal of development economics special issue on methods and measurement," Journal of Development Economics, Elsevier, vol. 170(C).
    8. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    9. Hammond, James & Siegal, Kim & Milner, Daniel & Elimu, Emmanuel & Vail, Taylor & Cathala, Paul & Gatera, Arsene & Karim, Azfar & Lee, Ja-Eun & Douxchamps, Sabine & Tu, Mai Thanh & Ouma, Emily & Lukuyu, 2022. "Perceived effects of COVID-19 restrictions on smallholder farmers: Evidence from seven lower- and middle-income countries," Agricultural Systems, Elsevier, vol. 198(C).
    10. Gourlay, Sydney & Kilic, Talip & Martuscelli, Antonio & Wollburg, Philip & Zezza, Alberto, 2021. "Viewpoint: High-frequency phone surveys on COVID-19: Good practices, open questions," Food Policy, Elsevier, vol. 105(C).
    11. Hai-Anh H. Dang & Cuong Viet Nguyen, 2024. "Agricultural Production as a Coping Strategy during the Covid-19 Pandemic? Evidence from Rural Viet Nam," Working Papers DP-2023-23, Economic Research Institute for ASEAN and East Asia (ERIA).
    12. Rebecca Walcott & Isabelle Cohen & Denise Ferris, 2024. "When Who Matters: Interviewer Effects and Survey Modality," Evaluation Review, , vol. 48(6), pages 1024-1049, December.
    13. Barker, Nathan & Davis, C. Austin & López-Peña, Paula & Mitchell, Harrison & Mobarak, Ahmed Mushfiq & Naguib, Karim & Reimão, Maira Emy & Shenoy, Ashish & Vernot, Corey, 2023. "Migration and resilience during a global crisis," European Economic Review, Elsevier, vol. 158(C).
    14. Dang, Hai-Anh H. & Salehi-Isfahani, Djavad & Do, Minh N. N., 2024. "The impacts of COVID-19 on female labor force participation in Iran," GLO Discussion Paper Series 1440, Global Labor Organization (GLO).
    15. Rudin-Rush, Lorin & Michler, Jeffrey D. & Josephson, Anna & Bloem, Jeffrey R., 2022. "Food insecurity during the first year of the COVID-19 pandemic in four African countries," Food Policy, Elsevier, vol. 111(C).
    16. Guillermo Zambrano & Lina M. Tennhardt & Moritz Egger & Karen Ramírez & Adriana Santos & Byron Moyano & Michael Curran, 2024. "Differing impacts of the COVID-19 pandemic on farmers and intermediaries: insights into the Ecuadorian cocoa value chain," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 12(1), pages 1-23, December.
    17. Chakravorty, Bhaskar & Bhatiya, Apurav Yash & Imbert, Clément & Lohnert, Maximilian & Panda, Poonam & Rathelot, Roland, 2023. "Impact of the COVID-19 crisis on India’s rural youth: Evidence from a panel survey and an experiment," World Development, Elsevier, vol. 168(C).
    18. Dang, Hai-Anh H. & Nguyen, Cuong Viet & Carletto, Calogero, 2023. "Did a successful fight against COVID-19 come at a cost? Impacts of the pandemic on employment outcomes in Vietnam," World Development, Elsevier, vol. 161(C).
    19. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    20. Bloem, Jeffrey & Michler, Jeffrey & Josephson, Anna & Rudin-Rush, Lorin, 2022. "COVID-19 Working Paper: Food Insecurity During the First Year of the COVID-19 Pandemic in Four African Countries," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, vol. 2022(Administr), July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:10585. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.