IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/16385.html
   My bibliography  Save this paper

Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance

Author

Listed:
  • Blumenstock, Joshua
  • Aiken, Emily
  • Bellue, Suzanne
  • Udry, Christopher
  • Karlan, Dean

Abstract

The COVID-19 pandemic has devastated many low- and middle-income countries (LMICs), causing widespread food insecurity and a sharp decline in living standards. In response to this crisis, governments and humanitarian organizations worldwide have mobilized targeted social assistance programs. Targeting is a central challenge in the administration of these programs: given available data, how does one rapidly identify the individuals and families with the greatest need? This challenge is particularly acute in the large number of LMICs that lack recent and comprehensive data on household income and wealth. Here we show that non-traditional “big†data from satellites and mobile phone networks can improve the targeting of anti-poverty programs. Our approach uses traditional survey-based measures of consumption and wealth to train machine learning algorithms that recognize patterns of poverty in non-traditional data; the trained algorithms are then used to prioritize aid to the poorest regions and mobile subscribers. We evaluate this approach by studying Novissi, Togo’s flagship emergency cash transfer program, which used these algorithms to determine eligibility for a rural assistance program that disbursed millions of dollars in COVID-19 relief aid. Our analysis compares outcomes – including exclusion errors, total social welfare, and measures of fairness – under different targeting regimes. Relative to the geographic targeting options considered by the Government of Togo at the time, the machine learning approach reduces errors of exclusion by 4-21%. Relative to methods that require a comprehensive social registry (a hypothetical exercise; no such registry exists in Togo), the machine learning approach increases exclusion errors by 9-35%. These results highlight the potential for new data sources to contribute to humanitarian response efforts, particularly in crisis settings when traditional data are missing or out of date.

Suggested Citation

  • Blumenstock, Joshua & Aiken, Emily & Bellue, Suzanne & Udry, Christopher & Karlan, Dean, 2021. "Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance," CEPR Discussion Papers 16385, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:16385
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP16385
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Skoufias, Emmanuel & Diamond, Alexis & Vinha, Katja & Gill, Michael & Dellepiane, Miguel Rebolledo, 2020. "Estimating poverty rates in subnational populations of interest: An assessment of the Simple Poverty Scorecard," World Development, Elsevier, vol. 129(C).
    2. Guanghua Chi & Han Fang & Sourav Chatterjee & Joshua E. Blumenstock, 2022. "Microestimates of wealth for all low- and middle-income countries," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(3), pages 2113658119-, January.
    3. Rema Hanna & Benjamin A. Olken, 2018. "Universal Basic Incomes versus Targeted Transfers: Anti-Poverty Programs in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 32(4), pages 201-226, Fall.
    4. Brown, Caitlin & Ravallion, Martin & van de Walle, Dominique, 2018. "A poor means test? Econometric targeting in Africa," Journal of Development Economics, Elsevier, vol. 134(C), pages 109-124.
    5. Joshua E. Blumenstock, 2018. "Estimating Economic Characteristics with Phone Data," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 72-76, May.
    6. Desiere, Sam & Vellema, Wytse & D’Haese, Marijke, 2015. "A validity assessment of the Progress out of Poverty Index (PPI)™," Evaluation and Program Planning, Elsevier, vol. 49(C), pages 10-18.
    7. César Martinelli & Susan Wendy Parker, 2009. "Deception and Misreporting in a Social Program," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 886-908, June.
    8. Joshua Blumenstock, 2018. "Don’t forget people in the use of big data for development," Nature, Nature, vol. 561(7722), pages 170-172, September.
    9. Grosh, M.E. & Baker, J.L., 1995. "Proxy Means Tests for Targetting Social Programs. Simulations and Speculation," Papers 118, World Bank - Living Standards Measurement.
    10. Henrik Jacobsen Kleven & Wojciech Kopczuk, 2011. "Transfer Program Complexity and the Take-Up of Social Benefits," American Economic Journal: Economic Policy, American Economic Association, vol. 3(1), pages 54-90, February.
    11. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    12. Banerjee, Abhijit & Hanna, Rema & Olken, Benjamin A. & Sumarto, Sudarno, 2018. "The (Lack of) Distortionary Effects of Proxy-Means Tests: Results from a Nationwide Experiment in Indonesia," Working Paper Series rwp18-041, Harvard University, John F. Kennedy School of Government.
    13. Nichols, Albert L & Zeckhauser, Richard J, 1982. "Targeting Transfers through Restrictions on Recipients," American Economic Review, American Economic Association, vol. 72(2), pages 372-377, May.
    14. David Coady, 2004. "Targeting Outcomes Redux," The World Bank Research Observer, World Bank, vol. 19(1), pages 61-85.
    15. David Coady, 2006. "The Welfare Returns to Finer Targeting: The Case of The Progresa Program in Mexico," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 13(2), pages 217-239, May.
    16. Deon Filmer & Lant Pritchett, 2001. "Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India," Demography, Springer;Population Association of America (PAA), vol. 38(1), pages 115-132, February.
    17. Egger, Dennis & Miguel, Edward & Warren, Shana S. & Shenoy, Ashish & Collins, Elliott & Karlan, Dean & Parkerson, Doug & Mobarak, A. Mushfiq & Fink, Günther & Udry, Christopher & Walker, Michael & Hau, 2021. "Falling living standards during the COVID-19 crisis: Quantitative evidence from nine developing countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(6), pages 1-1.
    18. Daniel Bjorkegren & Joshua E. Blumenstock & Samsun Knight, 2020. "Manipulation-Proof Machine Learning," Papers 2004.03865, arXiv.org.
    19. Serajuddin,Umar & Uematsu,Hiroki & Wieser,Christina & Yoshida,Nobuo & Dabalen,Andrew L., 2015. "Data deprivation : another deprivation to end," Policy Research Working Paper Series 7252, The World Bank.
    20. Ugo Gentilini & Mohamed Almenfi & Ian Orton & Pamela Dale, 2020. "Social Protection and Jobs Responses to COVID-19," World Bank Publications - Reports 33635, The World Bank Group.
    21. Baker, Judy L. & Grosh, Margaret E., 1994. "Poverty reduction through geographic targeting: How well does it work?," World Development, Elsevier, vol. 22(7), pages 983-995, July.
    22. Amy Finkelstein, 2009. "E-ztax: Tax Salience and Tax Rates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(3), pages 969-1010.
    23. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Ririn Purnamasari & Matthew Wai-Poi, 2016. "Self-Targeting: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 371-427.
    24. Elbers, Chris & Fujii, Tomoki & Lanjouw, Peter & Ozler, Berk & Yin, Wesley, 2007. "Poverty alleviation through geographic targeting: How much does disaggregation help?," Journal of Development Economics, Elsevier, vol. 83(1), pages 198-213, May.
    25. Mann, Laura, 2018. "Left to other peoples’ devices? A political economy perspective on the big data revolution in development," LSE Research Online Documents on Economics 85057, London School of Economics and Political Science, LSE Library.
    26. Norbert R. Schady, 2002. "Picking the Poor: Indicators for Geographic Targeting in Peru," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 48(3), pages 417-433, September.
    27. J. A. Mirrlees, 1971. "An Exploration in the Theory of Optimum Income Taxation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 38(2), pages 175-208.
    28. Galasso, Emanuela & Ravallion, Martin, 2005. "Decentralized targeting of an antipoverty program," Journal of Public Economics, Elsevier, vol. 89(4), pages 705-727, April.
    29. Linden McBride & Austin Nichols, 2018. "Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning," The World Bank Economic Review, World Bank, vol. 32(3), pages 531-550.
    30. Alderman, Harold, 2002. "Do local officials know something we don't? Decentralization of targeted transfers in Albania," Journal of Public Economics, Elsevier, vol. 83(3), pages 375-404, March.
    31. Kathy Lindert & Tina George Karippacheril & Inés Rodriguez Caillava & Kenichi Nishikawa Chavez, 2020. "Sourcebook on the Foundations of Social Protection Delivery Systems," World Bank Publications - Books, The World Bank Group, number 34044.
    32. Adriana Camacho & Emily Conover, 2011. "Manipulation of Social Program Eligibility," American Economic Journal: Economic Policy, American Economic Association, vol. 3(2), pages 41-65, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Di Maio, Michele & Fasani, Francesco & Leone Sciabolazza, Valerio & Molini, Vasco, 2022. "Facing Displacement and a Global Pandemic: Evidence from a Fragile State," CEPR Discussion Papers 17104, C.E.P.R. Discussion Papers.
    2. Ola Hall & Francis Dompae & Ibrahim Wahab & Fred Mawunyo Dzanku, 2023. "A review of machine learning and satellite imagery for poverty prediction: Implications for development research and applications," Journal of International Development, John Wiley & Sons, Ltd., vol. 35(7), pages 1753-1768, October.
    3. Christensen, Peter & Francisco, Paul & Myers, Erica & Shao, Hansen & Souza, Mateus, 2024. "Energy efficiency can deliver for climate policy: Evidence from machine learning-based targeting," Journal of Public Economics, Elsevier, vol. 234(C).
    4. Ahmed Mushfiq Mobarak & Edward Miguel, 2022. "The Economics of the COVID-19 Pandemic in Poor Countries," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 253-285, August.
    5. Vu, Khoa & Vuong, Nguyen Dinh Tuan & Vu-Thanh, Tu-Anh & Nguyen, Anh Ngoc, 2022. "Income shock and food insecurity prediction Vietnam under the pandemic," World Development, Elsevier, vol. 153(C).
    6. Anders Christensen & Joel Ferguson & Sim'on Ram'irez Amaya, 2022. "Incorporating High-Frequency Weather Data into Consumption Expenditure Predictions," Papers 2211.01406, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aiken, Emily L. & Bedoya, Guadalupe & Blumenstock, Joshua E. & Coville, Aidan, 2023. "Program targeting with machine learning and mobile phone data: Evidence from an anti-poverty intervention in Afghanistan," Journal of Development Economics, Elsevier, vol. 161(C).
    2. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
    3. Alix-Garcia, Jennifer M. & Sims, Katharine R.E. & Costica, Laura, 2021. "Better to be indirect? Testing the accuracy and cost-savings of indirect surveys," World Development, Elsevier, vol. 142(C).
    4. Benjamin A Olken & Abhijit Banerjee & Rema Hanna & Sudarno Sumarto, . "The (Lack of) Distortionary Effects of Proxy-Means Tests: Results from a Nationwide Experiment in Indonesia," Journal Article, Publications Department.
    5. Chikako Yamauchi, 2010. "Community-Based Targeting and Initial Local Conditions: Evidence from Indonesia's IDT Program," Economic Development and Cultural Change, University of Chicago Press, vol. 59(1), pages 95-147, October.
    6. Sudarno Sumarto & Benjamin A Olken & Abhijit Banerjee & Rema Hanna, . "(Ketiadaan) Efek Distorsi dari Proxy-Means Test: Hasil dari Eksperimen Berskala Nasional di Indonesia," Journal Article, Publications Department.
    7. Henderson, Heath & Follett, Lendie, 2022. "Targeting social safety net programs on human capabilities," World Development, Elsevier, vol. 151(C).
    8. Rema Hanna & Benjamin A. Olken, 2018. "Universal Basic Incomes vs. Targeted Transfers: Anti-Poverty Programs in Developing Countries," NBER Working Papers 24939, National Bureau of Economic Research, Inc.
    9. Daniel Bjorkegren & Joshua E. Blumenstock & Samsun Knight, 2020. "Manipulation-Proof Machine Learning," Papers 2004.03865, arXiv.org.
    10. Baird, Sarah & McIntosh, Craig & Özler, Berk, 2013. "The regressive demands of demand-driven development," Journal of Public Economics, Elsevier, vol. 106(C), pages 27-41.
    11. Schnitzer,Pascale & Stoeffler,Quentin, 2021. "Targeting for Social Safety Nets : Evidence from Nine Programs in the Sahel," Policy Research Working Paper Series 9816, The World Bank.
    12. Emily Aiken & Guadalupe Bedoya & Joshua Blumenstock & Aidan Coville, 2022. "Program Targeting with Machine Learning and Mobile Phone Data: Evidence from an Anti-Poverty Intervention in Afghanistan," Papers 2206.11400, arXiv.org.
    13. Altındağ, Onur & O'Connell, Stephen D. & Şaşmaz, Aytuğ & Balcıoğlu, Zeynep & Cadoni, Paola & Jerneck, Matilda & Foong, Aimee Kunze, 2021. "Targeting humanitarian aid using administrative data: Model design and validation," Journal of Development Economics, Elsevier, vol. 148(C).
    14. Follett, Lendie & Henderson, Heath, 2023. "A hybrid approach to targeting social assistance," Journal of Development Economics, Elsevier, vol. 160(C).
    15. Stoeffler, Quentin & Mills, Bradford & del Ninno, Carlo, 2016. "Reaching the Poor: Cash Transfer Program Targeting in Cameroon," World Development, Elsevier, vol. 83(C), pages 244-263.
    16. Guanghua Chi & Han Fang & Sourav Chatterjee & Joshua E. Blumenstock, 2022. "Microestimates of wealth for all low- and middle-income countries," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(3), pages 2113658119-, January.
    17. Christophe Muller & Sami Bibi, 2006. "Focused Targeting Against Poverty Evidence From Tunisia," Working Papers. Serie AD 2006-01, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    18. Schleicher, Michael & Souares, Aurélia & Pacere, Athanase Narangoro & Sauerborn, Rainer & Klonner, Stefan, 2016. "Decentralized versus Statistical Targeting of Anti-Poverty Programs: Evidence from Burkina Faso," Working Papers 0623, University of Heidelberg, Department of Economics.
    19. Stephan Klasen & Simon Lange, 2015. "Targeting Performance and Poverty Effects of Proxy Means-Tested Transfers: Trade-offs and Challenges," Ibero America Institute for Econ. Research (IAI) Discussion Papers 231, Ibero-America Institute for Economic Research.
    20. Christophe Muller, 2007. "Anti-Poverty Transfers without Riots in Tunisia," Working Papers DT/2007/08, DIAL (Développement, Institutions et Mondialisation).

    More about this item

    Keywords

    Targeting; Machine learning; Poverty; Mobile phone data;
    All these keywords.

    JEL classification:

    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:16385. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.