IDEAS home Printed from https://ideas.repec.org/a/oup/jafrec/v32y2023i5p495-522..html
   My bibliography  Save this article

Are You Being Asked? Impacts of Respondent Selection on Measuring Employment in Malawi

Author

Listed:
  • Talip Kilic
  • Goedele Van den
  • Gayatri Koolwal
  • Heather Moylan

Abstract

Accurate estimates of men's and women's employment are necessary for understanding sources of productivity and growth and designing well-targeted, gender-sensitive labour policies. This paper aims to address a key question—how respondent selection in household and labour force surveys affects these estimates—by leveraging two concurrent national surveys in Malawi that relied on the same questionnaire and field teams but differed in their approach to respondent selection. As compared with direct and private interviews with respondents, the ‘business-as-usual’ approach that allows for proxy reporting when targeted respondents are not available, as well as a mix of other standard survey approaches often used under time and resource constraints, is associated with significantly lower reporting of employment across a range of wage and self-employment activities. Although the effects are seemingly limited in absolute terms, they are quite large in relative terms, vis-à-vis the average participation rates and they tend to be more pronounced for women respondents and concerning questions with longer/12-month recall periods. The analysis also examines how household wealth, proxy reporting and difficulties associated with interpreting questions may be linked to lower reporting in the business-as-usual approach, and which can be examined in future methodological experimentation.

Suggested Citation

  • Talip Kilic & Goedele Van den & Gayatri Koolwal & Heather Moylan, 2023. "Are You Being Asked? Impacts of Respondent Selection on Measuring Employment in Malawi," Journal of African Economies, Centre for the Study of African Economies, vol. 32(5), pages 495-522.
  • Handle: RePEc:oup:jafrec:v:32:y:2023:i:5:p:495-522.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/jae/ejac025
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kilic, Talip & Moylan, Heather & Koolwal, Gayatri, 2021. "Getting the (Gender-Disaggregated) lay of the land: Impact of survey respondent selection on measuring land ownership and rights," World Development, Elsevier, vol. 146(C).
    2. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    3. Serneels, Pieter & Beegle, Kathleen & Dillon, Andrew, 2017. "Do returns to education depend on how and whom you ask?," Economics of Education Review, Elsevier, vol. 60(C), pages 5-19.
    4. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Are we done yet? Response fatigue and rural livelihoods," Journal of Development Economics, Elsevier, vol. 153(C).
    5. John M. Abowd & Martha H. Stinson, 2013. "Estimating Measurement Error in Annual Job Earnings: A Comparison of Survey and Administrative Data," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1451-1467, December.
    6. Beegle, Kathleen & Galasso, Emanuela & Goldberg, Jessica, 2017. "Direct and indirect effects of Malawi's public works program on food security," Journal of Development Economics, Elsevier, vol. 128(C), pages 1-23.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kilic,Talip & Van den Broeck,Goedele & Koolwal,Gayatri B. & Moylan,Heather G., 2020. "Are You Being Asked ? Impacts of Respondent Selection on Measuring Employment," Policy Research Working Paper Series 9152, The World Bank.
    2. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    3. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    4. Jose Galdo & Ana C Dammert & Degnet Abebaw, 2021. "Gender Bias in Agricultural Child Labor: Evidence from Survey Design Experiments," The World Bank Economic Review, World Bank, vol. 35(4), pages 872-891.
    5. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Are we done yet? Response fatigue and rural livelihoods," Journal of Development Economics, Elsevier, vol. 153(C).
    6. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    7. Koolwal, Gayatri B., 2021. "Improving the measurement of rural women's employment: Global momentum and survey priorities," World Development, Elsevier, vol. 147(C).
    8. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    9. Gourlay,Sydney & Maggio,Giuseppe & Safyan,Anahit & Zezza,Alberto, 2022. "Measuring Land Tenure at the Individual Level : Lessons from Methodological Research in Armenia," Policy Research Working Paper Series 10140, The World Bank.
    10. repec:lic:licosd:41819 is not listed on IDEAS
    11. Ihsaan Bassier & Joshua Budlender, 2024. "Stimulus effects of a large public employment programme," Working Paper a09be470-a23f-4594-b51a-f, Agence française de développement.
    12. Adrian Chadi, 2019. "Dissatisfied with life or with being interviewed? Happiness and the motivation to participate in a survey," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(3), pages 519-553, October.
    13. Timler, Carl & Alvarez, Stéphanie & DeClerck, Fabrice & Remans, Roseline & Raneri, Jessica & Estrada Carmona, Natalia & Mashingaidze, Nester & Abe Chatterjee, Shantonu & Chiang, Tsai Wei & Termote, Ce, 2020. "Exploring solution spaces for nutrition-sensitive agriculture in Kenya and Vietnam," Agricultural Systems, Elsevier, vol. 180(C).
    14. Peterson-Wilhelm, Bailey & Schwab, Benjamin, 2024. "How does recall bias in farm labor impact separability tests?," Food Policy, Elsevier, vol. 128(C).
    15. Dang, Hai-Anh H & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    16. Chaoran Chen & Diego Restuccia & Raül Santaeulàlia-Llopis, 2023. "Land Misallocation and Productivity," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 441-465, April.
    17. Simon Franklin & Clément Imbert & Girum Abebe & Carolina Mejia-Mantilla, 2024. "Urban Public Works in Spatial Equilibrium: Experimental Evidence from Ethiopia," American Economic Review, American Economic Association, vol. 114(5), pages 1382-1414, May.
    18. Péter Elek & János Köllő, 2019. "Eliciting permanent and transitory undeclared work from matched administrative and survey data," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 46(3), pages 547-576, August.
    19. Li, Zhiyun & Ortiz-Bobea, Ariel, 2022. "On the Timing of Relevant Weather Conditions in Agriculture," 2023 Allied Social Sciences Association (ASSA) Annual Meeting, January 6-8, 2023, New Orleans, Louisiana 316528, Agricultural and Applied Economics Association.
    20. Zachary H. Seeskin, 2016. "Evaluating the Use of Commercial Data to Improve Survey Estimates of Property Taxes," CARRA Working Papers 2016-06, Center for Economic Studies, U.S. Census Bureau.
    21. Bhashkar Mazumder, 2018. "Intergenerational Mobility in the United States: What We Have Learned from the PSID," The ANNALS of the American Academy of Political and Social Science, , vol. 680(1), pages 213-234, November.

    More about this item

    Keywords

    Sub-Saharan Africa; Malawi; household surveys; respondent selection; labour; gender; JEL classification: C83; J21; J16;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:jafrec:v:32:y:2023:i:5:p:495-522.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://edirc.repec.org/data/csaoxuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.