IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v98y2012i1p89-93.html
   My bibliography  Save this article

Examining the reliability of self-reported data on school participation

Author

Listed:
  • Baird, Sarah
  • Özler, Berk

Abstract

Many studies evaluate the impacts of Conditional Cash Transfer (CCT) programs on schooling using self-reports on enrollment and attendance even though there are reasons to doubt the reliability of these data. In this paper, we examine the extent to which school-age girls overstate their school participation. Using administrative data from a cash transfer experiment in Malawi and school attendance ledgers collected as part of the impact evaluation, we find that while all study participants overstate their enrollment and attendance rates, the extent to which this happens is significantly higher in the control group than the CCT arm. This finding implies that exclusive reliance on self-reported school participation data can lead to a serious underestimation of actual program impacts. We recommend that self-reports be supplemented using alternative sources of data on school participation that are appropriate to the experiment at hand — even if such efforts are likely to increase evaluation costs.

Suggested Citation

  • Baird, Sarah & Özler, Berk, 2012. "Examining the reliability of self-reported data on school participation," Journal of Development Economics, Elsevier, vol. 98(1), pages 89-93.
    • Handle: RePEc:eee:deveco:v:98:y:2012:i:1:p:89-93
    DOI: 10.1016/j.jdeveco.2011.05.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387811000514
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2011.05.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Filmer, Deon & Schady, Norbert, 2011. "Does more cash in conditional cash transfer programs always lead to larger impacts on school attendance?," Journal of Development Economics, Elsevier, vol. 96(1), pages 150-157, September.
    2. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    3. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    4. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    5. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-275, October.
    6. Alain de Janvry & Elisabeth Sadoulet, 2006. "Making Conditional Cash Transfer Programs More Efficient: Designing for Maximum Effect of the Conditionality," The World Bank Economic Review, World Bank, vol. 20(1), pages 1-29.
    7. FranÁois Bourguignon & Francisco H. G. Ferreira & Phillippe G. Leite, 2003. "Conditional Cash Transfers, Schooling, and Child Labor: Micro-Simulating Brazil's Bolsa Escola Program," The World Bank Economic Review, World Bank, vol. 17(2), pages 229-254, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    2. Sedlmayr, Richard & Shah, Anuj & Sulaiman, Munshi, 2020. "Cash-plus: Poverty impacts of alternative transfer-based approaches," Journal of Development Economics, Elsevier, vol. 144(C).
    3. Jacobus de Hoop & Jed Friedman & Eeshani Kandpal & Furio C. Rosati, 2019. "Child Schooling and Child Work in the Presence of a Partial Education Subsidy," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 503-531.
    4. Sarah Baird & Ephraim Chirwa & Jacobus de Hoop & Berk Özler, 2014. "Girl Power: Cash Transfers and Adolescent Welfare: Evidence from a Cluster-Randomized Experiment in Malawi," NBER Chapters, in: African Successes, Volume II: Human Capital, pages 139-164, National Bureau of Economic Research, Inc.
    5. Blattman, Christopher & Jamison, Julian & Koroknay-Palicz, Tricia & Rodrigues, Katherine & Sheridan, Margaret, 2016. "Measuring the measurement error: A method to qualitatively validate survey data," Journal of Development Economics, Elsevier, vol. 120(C), pages 99-112.
    6. Akresh, Richard & de Walque, Damien & Kazianga, Harounan, 2013. "Cash transfers and child schooling : evidence from a randomized evaluation of the role of conditionality," Policy Research Working Paper Series 6340, The World Bank.
    7. Chandra, Anjali & Mani, Subha & Dolphin, Heather & Dyson, Meredith & Marah, Yembeh, 2021. "Experimental Evidence from an Integrated Early Childhood Parenting Program in Sierra Leone," IZA Discussion Papers 14054, Institute of Labor Economics (IZA).
    8. Croke,Kevin & Dabalen, Andrew & Demombynes, Gabriel & Giugale, Marcelo & Hoogeveen, Johannes, 2013. "Collecting High-Frequency Data Using Mobile Phones: Do Timely Data Lead to Accountability?," World Bank - Economic Premise, The World Bank, issue 102, pages 1-5, January.
    9. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    10. Baird, Sarah & Gong, Erick & McIntosh, Craig & Özler, Berk, 2014. "The heterogeneous effects of HIV testing," Journal of Health Economics, Elsevier, vol. 37(C), pages 98-112.
    11. Li, Zhiyun & Ortiz-Bobea, Ariel, 2022. "On the Timing of Relevant Weather Conditions in Agriculture," 2023 Allied Social Sciences Association (ASSA) Annual Meeting, January 6-8, 2023, New Orleans, Louisiana 316528, Agricultural and Applied Economics Association.
    12. Rodriguez-Segura, Daniel & Schueler, Beth E., 2023. "Assessors influence results: Evidence on enumerator effects and educational impact evaluations," Journal of Development Economics, Elsevier, vol. 163(C).
    13. Malik, Samreen & Mihm, Benedikt, 2022. "Parental religiosity and human capital development: A field study in Pakistan," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 519-560.
    14. Steinert, Janina Isabel & Cluver, Lucie Dale & Meinck, Franziska & Doubt, Jenny & Vollmer, Sebastian, 2018. "Household economic strengthening through financial and psychosocial programming: Evidence from a field experiment in South Africa," Journal of Development Economics, Elsevier, vol. 134(C), pages 443-466.
    15. Harris, J. Andrew & van der Windt, Peter, 2023. "Empowering women or increasing response bias? Experimental evidence from Congo," Journal of Development Economics, Elsevier, vol. 164(C).
    16. Evans, David K. & Mendez Acosta, Amina, 2023. "How to measure student absenteeism in low- and middle-income countries," Economics of Education Review, Elsevier, vol. 96(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Akresh & Damien de Walque & Harounan Kazianga, 2013. "Cash Transfers and Child Schooling: Evidence from a Randomized Evaluation of the Role of Conditionality," Economics Working Paper Series 1301, Oklahoma State University, Department of Economics and Legal Studies in Business.
    2. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    3. Estevan, Fernanda, 2013. "The impact of conditional cash transfers on public education expenditures: A political economy approach," European Journal of Political Economy, Elsevier, vol. 32(C), pages 268-284.
    4. Jane Arnold Lincove & Adam Parker, 2016. "The influence of conditional cash transfers on eligible children and their siblings," Education Economics, Taylor & Francis Journals, vol. 24(4), pages 352-373, August.
    5. Jacobus de Hoop & Jed Friedman & Eeshani Kandpal & Furio C. Rosati, 2019. "Child Schooling and Child Work in the Presence of a Partial Education Subsidy," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 503-531.
    6. Del Rey, Elena & Estevan, Fernanda, 2013. "Conditional cash transfers and education quality in the presence of credit constraints," Economics of Education Review, Elsevier, vol. 34(C), pages 76-84.
    7. Zhou, Lei & Jiang, Bo & Wang, Jingxi, 2020. "Do cash transfers have impacts on student Academic, cognitive, and enrollment outcomes? Evidence from rural China," Children and Youth Services Review, Elsevier, vol. 116(C).
    8. Kitaura, Koji & Miyazawa, Kazutoshi, 2021. "Inequality and conditionality in cash transfers: Demographic transition and economic development," Economic Modelling, Elsevier, vol. 94(C), pages 276-287.
    9. Bauchet, Jonathan & Undurraga, Eduardo A. & Reyes-García, Victoria & Behrman, Jere R. & Godoy, Ricardo A., 2018. "Conditional cash transfers for primary education: Which children are left out?," World Development, Elsevier, vol. 105(C), pages 1-12.
    10. David K. Evans & Arkadipta Ghosh, 2008. "Prioritizing Educational Investments in Children in the Developing World," Working Papers WR-587, RAND Corporation.
    11. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    12. Seth R. Gitter & Bradford L. Barham, 2008. "Women's Power, Conditional Cash Transfers, and Schooling in Nicaragua," The World Bank Economic Review, World Bank, vol. 22(2), pages 271-290, May.
    13. M. Caridad Araujo & Mariano Bosch & Norbert Schady, 2017. "Can Cash Transfers Help Households Escape an Intergenerational Poverty Trap?," NBER Chapters, in: The Economics of Poverty Traps, pages 357-382, National Bureau of Economic Research, Inc.
    14. Karthik Muralidharan & Nishith Prakash, 2017. "Cycling to School: Increasing Secondary School Enrollment for Girls in India," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 321-350, July.
    15. Debowicz, Darío & Golan, Jennifer, 2014. "The impact of Oportunidades on human capital and income distribution in Mexico: A top-down/bottom-up approach," Journal of Policy Modeling, Elsevier, vol. 36(1), pages 24-42.
    16. Kate Ambler & Diego Aycinena & Dean Yang, 2015. "Channeling Remittances to Education: A Field Experiment among Migrants from El Salvador," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 207-232, April.
    17. Figueroa, José Luis, 2014. "Distributional effects of Oportunidades on early child development," Social Science & Medicine, Elsevier, vol. 113(C), pages 42-49.
    18. David K. Evans & Arkadipta Ghosh, 2008. "Prioritizing Educational Investments in Children in the Developing World," Working Papers 587, RAND Corporation.
    19. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    20. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.

    More about this item

    Keywords

    Measurement; Education; Conditional cash transfers; Impact evaluation;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:98:y:2012:i:1:p:89-93. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.