IDEAS home Printed from https://ideas.repec.org/a/dem/demres/v51y2024i46.html
   My bibliography  Save this article

Interrogating the quality and completion of mortality mobile phone interviews conducted in Malawi during COVID-19: An examination of interviewer–respondent interactions

Author

Listed:
  • Emmanuel Souza

    (University of Malawi)

  • Funny Muthema

    (Institute of Public Opinion and Research, Zomba)

  • Georges Reniers

    (London School of Hygiene and Tropical Medicine)

  • Stephane Helleringer

    (New York University, Abu Dhabi)

  • Monica Jamali

    (University of Malawi)

  • Michael Chasukwa

    (University of Malawi)

  • Julio Romero-Prieto

    (London School of Hygiene and Tropical Medicine)

  • Jethro Banda

    (Malawi Epidemiological and Intervention Research Unit)

  • Malebogo Tlhajoane

    (London School of Hygiene and Tropical Medicine)

  • Jacob Saikolo

    (Institute of Public Opinion and Research, Zomba)

  • Boniface Dulani

    (University of Malawi)

Abstract

Background: Mobile phone surveys (MPSs) have gained traction as a tool for gathering survey data, especially following the emergency of COVID-19. However, our understanding of MPS data quality in contexts with limited mobile phone penetration is still modest. Objective: This study evaluates (1) the circumstances under which mobile phone survey interviews were conducted and how these might influence the completion and quality of interviews, and (2) whether mortality-related questions upset respondents. Methods: We present descriptive statistics on respondents’ locations and a few debriefing questions, complemented by an analysis of audio recordings from a selection of interviews. Results: Findings indicate that interviews conducted while respondents are in public places are more likely to be interrupted or take longer compared to interviews conducted when respondents are at home. Furthermore, mortality questions only rarely trigger emotional distress among respondents. We observed no discernible shifts in respondents’ tone when answering mortality questions relative to other questions. Conclusions: It is less desirable to conduct MPS interviews when respondents are in public places, especially on topics that require privacy. Additionally, although sensitive, mortality questions should be treated like any other, as they are largely not as upsetting as commonly perceived. Contribution: As MPSs continue to gain ground in low- and middle-income countries, establishing good practices related to the circumstances wherein respondents take interviews is crucial. Aside from being sensitive and respectful when asking survey questions, enumerators should treat mortality questions like any other. Only in a few instances do these questions typically trigger negative emotional reactions.

Suggested Citation

  • Emmanuel Souza & Funny Muthema & Georges Reniers & Stephane Helleringer & Monica Jamali & Michael Chasukwa & Julio Romero-Prieto & Jethro Banda & Malebogo Tlhajoane & Jacob Saikolo & Boniface Dulani, 2024. "Interrogating the quality and completion of mortality mobile phone interviews conducted in Malawi during COVID-19: An examination of interviewer–respondent interactions," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 51(46), pages 1471-1490.
  • Handle: RePEc:dem:demres:v:51:y:2024:i:46
    DOI: 10.4054/DemRes.2024.51.46
    as

    Download full text from publisher

    File URL: https://www.demographic-research.org/volumes/vol51/46/51-46.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.4054/DemRes.2024.51.46?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brian Dillon, 2012. "Using mobile phones to collect panel data in developing countries," Journal of International Development, John Wiley & Sons, Ltd., vol. 24(4), pages 518-527, May.
    2. Kelly L’Engle & Eunice Sefa & Edward Akolgo Adimazoya & Emmanuel Yartey & Rachel Lenzi & Cindy Tarpo & Nii Lante Heward-Mills & Katherine Lew & Yvonne Ampeh, 2018. "Survey research with a random digit dial national mobile phone sample in Ghana: Methods and sample quality," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-11, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gourlay, Sydney & Kilic, Talip & Martuscelli, Antonio & Wollburg, Philip & Zezza, Alberto, 2021. "Viewpoint: High-frequency phone surveys on COVID-19: Good practices, open questions," Food Policy, Elsevier, vol. 105(C).
    2. Monteiro Amaral,Sofia Fernando & Dinarte Diaz,Lelys Ileana & Dominguez,Patricio & Perez-Vincent,Santiago M. & Romero,Steffanny, 2022. "Talk or Text ? Evaluating Response Rates by Remote Survey Method during COVID-19," Policy Research Working Paper Series 9999, The World Bank.
    3. Elisa M. Maffioli, 2020. "Collecting Data During an Epidemic: A Novel Mobile Phone Research Method," Journal of International Development, John Wiley & Sons, Ltd., vol. 32(8), pages 1231-1255, November.
    4. Joshua Brubaker & Talip Kilic & Philip Wollburg, 2021. "Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-27, November.
    5. Johannes Hoogeveen & Andrew Dabalen & Elvis Mushi & Alvin Etang & Youdi Schipper & Johannes von Engelhardt, 2016. "Mobile Phone Panel Surveys in Developing Countries," World Bank Publications - Books, The World Bank Group, number 24595.
    6. Pamina Firchow & Roger Mac Ginty, 2020. "Including Hard-to-Access Populations Using Mobile Phone Surveys and Participatory Indicators," Sociological Methods & Research, , vol. 49(1), pages 133-160, February.
    7. Baumüller, Heike & Kornher, Lukas, 2024. "Inside the crowd: Assessing the suitability of SMSbased surveys to monitor the food security situation in Uganda," IAAE 2024 Conference, August 2-7, 2024, New Delhi, India 344389, International Association of Agricultural Economists (IAAE).
    8. Sahar Ahmed & Georges Reniers & Bruno Masquelier & David A. Sánchez-Páez & Julio Romero-Prieto & Tom Pullum, 2024. "Sample selection bias in adult mortality estimates from mobile phone surveys: Evidence from 25 low- and middle-income countries," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 51(37), pages 1167-1182.
    9. Pape,Utz Johann & Wollburg,Philip Randolph, 2019. "Estimation of Poverty in Somalia Using Innovative Methodologies," Policy Research Working Paper Series 8735, The World Bank.
    10. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    11. Christopher Ksoll & Kristine Bos & Sarah Hughes & Anthony Harris & Arif Mamun, "undated". "Evaluation Design Report for the Benin Power Compact's Electricity Generation Project and Electricity Distribution Project," Mathematica Policy Research Reports 9f8974513ee745aaac3b5c62e, Mathematica Policy Research.
    12. Fan, Shenggen & Brzeska, Joanna, 2011. "The nexus between agriculture and nutrition: Do growth patterns and conditional factors matter?," 2020 conference briefs 1, International Food Policy Research Institute (IFPRI).
    13. Beam, Emily A., 2023. "Social media as a recruitment and data collection tool: Experimental evidence on the relative effectiveness of web surveys and chatbots," Journal of Development Economics, Elsevier, vol. 162(C).
    14. Blumenstock, Joshua & Dillon, Brian & Aker, Jenny, 2020. "How Important is the Yellow Pages? Experimental Evidence from Tanzania," CEPR Discussion Papers 14489, C.E.P.R. Discussion Papers.
    15. Calogero Carletto & Dean Jolliffe & Raka Banerjee, 2015. "From Tragedy to Renaissance: Improving Agricultural Data for Better Policies," Journal of Development Studies, Taylor & Francis Journals, vol. 51(2), pages 133-148, February.
    16. Norton, Benjamin P. & Hoel, Jessica B. & Michelson, Hope, 2020. "The demand for (fake?) fertilizer: Using an experimental auction to examine the role of beliefs on agricultural input demand in Tanzania," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304444, Agricultural and Applied Economics Association.
    17. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    18. Abay, Kibrom A. & Berhane, Guush & Hoddinott, John F. & Tafere, Kibrom, 2021. "Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia," IFPRI discussion papers 2017, International Food Policy Research Institute (IFPRI).
    19. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    20. Tilman Brück & Mekdim D. Regassa, 2023. "Usefulness and misrepresentation of phone surveys on COVID-19 and food security in Africa," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 15(2), pages 423-453, April.

    More about this item

    Keywords

    Malawi; mortality; LMICs; mobile phone survey; RaMMPS; audio-recording;
    All these keywords.

    JEL classification:

    • J1 - Labor and Demographic Economics - - Demographic Economics
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dem:demres:v:51:y:2024:i:46. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Editorial Office (email available below). General contact details of provider: https://www.demogr.mpg.de/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.