IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v164y2023ics0304387823000524.html
   My bibliography  Save this article

Empowering women or increasing response bias? Experimental evidence from Congo

Author

Listed:
  • Harris, J. Andrew
  • van der Windt, Peter

Abstract

Women’s empowerment interventions are an important component of many development programs; surveys are a popular tool to measure how such programs affect gender-related attitudes. We consider how differences in gender response bias between the treatment and control groups complicate the use of attitudinal questions to evaluate women’s empowerment interventions. We examine data from two experiments: a randomized development program aimed to empower women in 1,250 Congolese villages and a follow-up survey experiment. After demonstrating strong response biases in gender-related questions as a function of interviewer gender, we show that these biases vary as a function of program treatment status. These findings mean that the estimated average treatment effects of women’s empowerment programs are sensitive to both the gender composition of the respondent sample as well as the interviewer pool. We conclude with lessons for survey implementation and pre-analysis plans.

Suggested Citation

  • Harris, J. Andrew & van der Windt, Peter, 2023. "Empowering women or increasing response bias? Experimental evidence from Congo," Journal of Development Economics, Elsevier, vol. 164(C).
    • Handle: RePEc:eee:deveco:v:164:y:2023:i:c:s0304387823000524
    DOI: 10.1016/j.jdeveco.2023.103097
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387823000524
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103097?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. Humphreys, Macartan & de la Sierra, Raúl Sánchez & der Windt, Peter Van, 2019. "Exporting democratic practices: Evidence from a village governance intervention in Eastern Congo," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 140, pages 279-301.
    3. Guirkinger, Catherine & Platteau, Jean-Philippe & Goetghebuer, Tatiana, 2015. "Productive inefficiency in extended agricultural households: Evidence from Mali," Journal of Development Economics, Elsevier, vol. 116(C), pages 17-27.
    4. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    5. Kean Siang & CH’NG, 2012. "Social comparison in deterrence policy," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 2(1), pages 1-2.
    6. Alex Armand & Alexander Coutts & Pedro C. Vicente & Inês Vilela, 2020. "Does Information Break the Political Resource Curse? Experimental Evidence from Mozambique," American Economic Review, American Economic Association, vol. 110(11), pages 3431-3453, November.
    7. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    8. Su-Hao Tu & Pei-Shan Liao, 2007. "Social Distance, Respondent Cooperation and Item Nonresponse in Sex Survey," Quality & Quantity: International Journal of Methodology, Springer, vol. 41(2), pages 177-199, April.
    9. Lori Beaman & Raghabendra Chattopadhyay & Esther Duflo & Rohini Pande & Petia Topalova, 2009. "Powerful Women: Does Exposure Reduce Bias?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1497-1540.
    10. Diva Dhar & Tarun Jain & Seema Jayachandran, 2022. "Reshaping Adolescents' Gender Attitudes: Evidence from a School-Based Experiment in India," American Economic Review, American Economic Association, vol. 112(3), pages 899-927, March.
    11. Jayachandran, Seema & Biradavolu, Monica & Cooper, Jan, 2021. "Using machine learning and qualitative interviews to design a five-question women's agency index," CEPR Discussion Papers 15961, C.E.P.R. Discussion Papers.
    12. Usdin, S. & Scheepers, E. & Goldstein, Susan & Japhet, Garth, 2005. "Achieving social change on gender-based violence: A report on the impact evaluation of Soul City's fourth series," Social Science & Medicine, Elsevier, vol. 61(11), pages 2434-2445, December.
    13. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    14. Baird, Sarah & Özler, Berk, 2012. "Examining the reliability of self-reported data on school participation," Journal of Development Economics, Elsevier, vol. 98(1), pages 89-93.
    15. D'Espallier, Bert & Guérin, Isabelle & Mersland, Roy, 2011. "Women and Repayment in Microfinance: A Global Analysis," World Development, Elsevier, vol. 39(5), pages 758-772, May.
    16. Humphreys, Macartan & Sánchez de la Sierra, Raúl & Van der Windt, Peter, 2019. "Exporting democratic practices: Evidence from a village governance intervention in Eastern Congo," Journal of Development Economics, Elsevier, vol. 140(C), pages 279-301.
    17. Esther Duflo, 2012. "Women Empowerment and Economic Development," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 1051-1079, December.
    18. Prina, Silvia, 2015. "Banking the poor via savings accounts: Evidence from a field experiment," Journal of Development Economics, Elsevier, vol. 115(C), pages 16-31.
    19. Vitrenko A., 2012. "Social and economical meaning of modern Advertising activity," Bulletin of Taras Shevchenko National University of Kyiv. Economics. Вісник Киiвського нацiонального унiверситету iм. Тараса Шевченка. Серiя: Економiка, CyberLeninka;Издательско-полиграфический центр «Киевский университет», issue 137, pages 56-59.
    20. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    21. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    22. van der Windt, Peter & Humphreys, Macartan & Sanchez de la Sierra, Raul, 2018. "Gender quotas in development programming: Null results from a field experiment in Congo," Journal of Development Economics, Elsevier, vol. 133(C), pages 326-345.
    23. Beath, Andrew & Christia, Fotini & Enikolopov, Ruben, 2013. "Empowering Women through Development Aid: Evidence from a Field Experiment in Afghanistan," American Political Science Review, Cambridge University Press, vol. 107(3), pages 540-557, August.
    24. Aleksandra An, 2012. "The Role of Social Space in Municipal Formations," Public administration issues, Higher School of Economics, issue 1, pages 174-184.
    25. Mummolo, Jonathan & Peterson, Erik, 2019. "Demand Effects in Survey Experiments: An Empirical Assessment," American Political Science Review, Cambridge University Press, vol. 113(2), pages 517-529, May.
    26. Bhavnani, Rikhil R., 2009. "Do Electoral Quotas Work after They Are Withdrawn? Evidence from a Natural Experiment in India," American Political Science Review, Cambridge University Press, vol. 103(1), pages 23-35, February.
    27. Clayton, Amanda, 2018. "Do Gender Quotas Really Reduce Bias? Evidence from a Policy Experiment in Southern Africa," Journal of Experimental Political Science, Cambridge University Press, vol. 5(3), pages 182-194, December.
    28. Luís Cavique & Armando B. Mendes & Jorge M.A. Santos, 2012. "Clique Communities In Social Networks," World Scientific Book Chapters, in: Luiz Moutinho & Kun-Huang Huarng (ed.), Quantitative Modelling In Marketing And Management, chapter 20, pages 469-490, World Scientific Publishing Co. Pte. Ltd..
    29. Blair, Graeme & Coppock, Alexander & Moor, Margaret, 2020. "When to Worry about Sensitivity Bias: A Social Reference Theory and Evidence from 30 Years of List Experiments," American Political Science Review, Cambridge University Press, vol. 114(4), pages 1297-1315, November.
    30. D. James Greiner & Donald B. Rubin, 2011. "Causal Effects of Perceived Immutable Characteristics," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 775-785, August.
    31. Harris, J. Andrew & Posner, Daniel N., 2019. "(Under What Conditions) Do Politicians Reward Their Supporters? Evidence from Kenya’s Constituencies Development Fund," American Political Science Review, Cambridge University Press, vol. 113(1), pages 123-139, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Callen & Miguel Fajardo-Steinhauser & Michael G. Findley & Tarek Ghani, 2023. "Can Digital Aid Deliver During Humanitarian Crises?," Papers 2312.13432, arXiv.org, revised Oct 2024.
    2. Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2020. "Educational inequality and public policy preferences: Evidence from representative survey experiments," Journal of Public Economics, Elsevier, vol. 188(C).
    3. van der Windt, Peter & Humphreys, Macartan & Sanchez de la Sierra, Raul, 2018. "Gender quotas in development programming: Null results from a field experiment in Congo," Journal of Development Economics, Elsevier, vol. 133(C), pages 326-345.
    4. Siwan Anderson, 2022. "Unbundling female empowerment," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(4), pages 1671-1701, November.
    5. van der Windt, Peter Cornelis & Humphreys, Macartan & de la Sierra, Raul Sanchez, 2020. "Gender Quotas in Development Programming: Null Results from a Field Experiment in Congo," SocArXiv gtns5_v1, Center for Open Science.
    6. Alexis Grigorieff & Christopher Roth & Diego Ubfal, 2020. "Does Information Change Attitudes Toward Immigrants?," Demography, Springer;Population Association of America (PAA), vol. 57(3), pages 1117-1143, June.
    7. Maria Perrotta Berlin & Evelina Bonnier & Anders Olofsgård, 2024. "Foreign Aid and Female Empowerment," Journal of Development Studies, Taylor & Francis Journals, vol. 60(5), pages 662-684, May.
    8. Lelys I. Dinarte Diaz & Saravana Ravindran & Manisha Shah & Shawn M. Powers & Helen Baker-Henningham, 2023. "Violent Discipline and Parental Behavior: Short- and Medium-term Effects of Virtual Parenting Support to Caregivers," NBER Working Papers 31338, National Bureau of Economic Research, Inc.
    9. Gottlieb, Jessica, 2016. "Why Might Information Exacerbate the Gender Gap in Civic Participation? Evidence from Mali," World Development, Elsevier, vol. 86(C), pages 95-110.
    10. Garcia-Hernandez, Ana & Grossman, Guy & Michelitch, Kristin Grace, 2022. "Networks and the Size of the Gender Gap in Politician Performance Across Job Duties," OSF Preprints j7zg2, Center for Open Science.
    11. Kosec, Katrina & Mo, Cecilia Hyunjung & Schmidt, Emily & Song, Jie, 2021. "Perceptions of relative deprivation and women’s empowerment," World Development, Elsevier, vol. 138(C).
    12. Lasse J. Jessen & Sebastian Koehne & Patrick Nüß & Jens Ruhose, 2024. "Socioeconomic Inequality in Life Expectancy: Perception and Policy Demand," CESifo Working Paper Series 10940, CESifo.
    13. Michael L. Anderson & Fangwen Lu, 2017. "Learning to Manage and Managing to Learn: The Effects of Student Leadership Service," Management Science, INFORMS, vol. 63(10), pages 3246-3261, October.
    14. McNamara, Trent & Mosquera, Roberto, 2024. "The political divide: The case of expectations and preferences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 110(C).
    15. Lergetporer, Philipp & Piopiunik, Marc & Simon, Lisa, 2021. "Does the education level of refugees affect natives’ attitudes?," European Economic Review, Elsevier, vol. 134(C).
    16. Carlotta Nani, 2024. "Perceived abilities and gender stereotypes within the household: experimental evidence from Bangladesh," IHEID Working Papers 19-2024, Economics Section, The Graduate Institute of International Studies.
    17. Steinert, Janina I. & Zenker, Juliane & Filipiak, Ute & Movsisyan, Ani & Cluver, Lucie D. & Shenderovich, Yulia, 2018. "Do saving promotion interventions increase household savings, consumption, and investments in Sub-Saharan Africa? A systematic review and meta-analysis," World Development, Elsevier, vol. 104(C), pages 238-256.
    18. Bjorn Van Campenhout & David J. Spielman & Els Lecoutere, 2021. "Information and Communication Technologies to Provide Agricultural Advice to Smallholder Farmers: Experimental Evidence from Uganda," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 317-337, January.
    19. Lubega, Patrick & Nakakawa, Frances & Narciso, Gaia & Newman, Carol & Kaaya, Archileo N. & Kityo, Cissy & Tumuhimbise, Gaston A., 2021. "Body and mind: Experimental evidence from women living with HIV," Journal of Development Economics, Elsevier, vol. 150(C).
    20. Gautam Nair & Kyle Peyton, 2022. "Building Mass Support for Global Pandemic Recovery Efforts in the United States," CID Working Papers 408, Center for International Development at Harvard University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:164:y:2023:i:c:s0304387823000524. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.