IDEAS home Printed from https://ideas.repec.org/p/ags/unadrs/280045.html
   My bibliography  Save this paper

IFAD RESEARCH SERIES 7 - Measuring IFAD’s impact: background paper to the IFAD9 Impact Assessment Initiative

Author

Listed:
  • Garbero, A.

Abstract

In recent years, the International Fund for Agricultural Development (IFAD) has increasingly strengthened its focus on achieving and measuring results. In 2011-2012, resources were invested in the IFAD9 Impact Assessment Initiative (IFAD9 IAI) in order to: (i) explore methodologies to assess impact; (ii) measure – to the degree possible – the results and impacts of IFAD-financed activities; and (iii) summarize lessons learned and advise on rigorous and cost-effective approaches to attributing impact to IFAD interventions. The initiative reflects a recognition of IFAD’s responsibility to generate evidence of the success of IFAD-supported projects so as to learn lessons for the benefit of future projects. This paper describes the IFAD9 IAI and the range of methods that have been identified to broaden the evidence base for the estimation of IFAD impacts, and presents the results from the aggregation and projection methodology used to compute the Fund’s aggregate impact on key outcomes, while also highlighting what has been learned. The results show that there are many areas in which IFAD‑supported project beneficiaries have had, on average, better outcomes in percentage terms as compared to comparison farmers who were not project beneficiaries. Specifically, IFAD-supported projects are effectively poverty-reducing: when choosing durable asset indexes as the preferred poverty proxies on the grounds that they better approximate long-run wealth, findings point to statistically significant gains. Overall, the analyses strongly imply that IFAD is effectively improving the well-being of rural people in terms of asset accumulation, and higher revenue and income. The IFAD9 IAI represents a pioneering research effort, which has tried to overcome the clear challenges of designing data collection and conducting ex post impact assessments in a context where data were scarce, with a view to measuring progress towards a global accountability goal over a very short period of time. Therefore, an important recommendation is that future impact assessments should be selected and designed ex ante, and structured to facilitate and maximize learning, rather than used solely as an instrument to prove accountability.

Suggested Citation

  • Garbero, A., 2016. "IFAD RESEARCH SERIES 7 - Measuring IFAD’s impact: background paper to the IFAD9 Impact Assessment Initiative," IFAD Research Series 280045, International Fund for Agricultural Development (IFAD).
    • Handle: RePEc:ags:unadrs:280045
    DOI: 10.22004/ag.econ.280045
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/280045/files/Research%20Series%207.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.280045?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Howard White, 2009. "Theory-based impact evaluation: principles and practice," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(3), pages 271-284.
    2. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    3. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2010. "How to Control for Many Covariates? Reliable Estimators Based on the Propensity Score," IZA Discussion Papers 5268, Institute of Labor Economics (IZA).
    4. Wooldridge, Jeffrey M., 2007. "Inverse probability weighted estimation for general missing data problems," Journal of Econometrics, Elsevier, vol. 141(2), pages 1281-1301, December.
    5. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    6. Markus Frlich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    7. White, Howard, 2009. "Theory-Based Impact Evaluation," 3ie Publications 2009-3, International Initiative for Impact Evaluation (3ie).
    8. Van Kerm, Philippe, 2006. "Comparisons of income mobility profiles," ISER Working Paper Series 2006-36, Institute for Social and Economic Research.
    9. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    10. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    11. Pradhan, Menno & Ravallion, Martin, 1998. "Measuring poverty using qualitative perceptions of welfare," Policy Research Working Paper Series 2011, The World Bank.
    12. Sahn, David E. & Stifel, David C., 2000. "Poverty Comparisons Over Time and Across Countries in Africa," World Development, Elsevier, vol. 28(12), pages 2123-2155, December.
    13. Deon Filmer & Kinnon Scott, 2012. "Assessing Asset Indices," Demography, Springer;Population Association of America (PAA), vol. 49(1), pages 359-392, February.
    14. Guido W. Imbens & Whitney Newey & Geert Ridder, 2005. "Mean-square-error Calculations for Average Treatment Effects," IEPR Working Papers 05.34, Institute of Economic Policy Research (IEPR).
    15. Kosuke Imai & Marc Ratkovic, 2014. "Covariate balancing propensity score," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 243-263, January.
    16. Deon Filmer & Lant Pritchett, 2001. "Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India," Demography, Springer;Population Association of America (PAA), vol. 38(1), pages 115-132, February.
    17. Mendola, Mariapia, 2007. "Agricultural technology adoption and poverty reduction: A propensity-score matching analysis for rural Bangladesh," Food Policy, Elsevier, vol. 32(3), pages 372-393, June.
    18. Ravallion, M., 1992. "Poverty Comparisons - A Guide to Concepts and Methods," Papers 88, World Bank - Living Standards Measurement.
    19. Martin Wall & Deborah Johnston, 2008. "Counting Heads or Counting Televisions: Can Asset-based Measures of Welfare Assist Policy-makers in Russia?," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 9(1), pages 131-147.
    20. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    21. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    22. Alessandra Garbero, 2014. "Estimating poverty dynamics using synthetic panels for IFAD-supported projects: a case study from Vietnam," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(4), pages 490-510, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    3. Mausumi Mahapatro & Deborah Johnston, 2020. "Imperfection Measures and the Production of Poverty: A Case Study of the Use of the Asset Index in Bangladesh," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(2), pages 513-531, November.
    4. Farrell, Max H., 2015. "Robust inference on average treatment effects with possibly more covariates than observations," Journal of Econometrics, Elsevier, vol. 189(1), pages 1-23.
    5. Zeqin Liu & Zongwu Cai & Ying Fang & Ming Lin, 2019. "Statistical Analysis and Evaluation of Macroeconomic Policies: A Selective Review," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201904, University of Kansas, Department of Economics, revised Mar 2019.
    6. Zhao, Zhong, 2008. "Sensitivity of propensity score methods to the specifications," Economics Letters, Elsevier, vol. 98(3), pages 309-319, March.
    7. Cunguara, Benedito & Darnhofer, Ika, 2011. "Assessing the impact of improved agricultural technologies on household income in rural Mozambique," Food Policy, Elsevier, vol. 36(3), pages 378-390, June.
    8. Chabé-Ferret, Sylvain, 2015. "Analysis of the bias of Matching and Difference-in-Difference under alternative earnings and selection processes," Journal of Econometrics, Elsevier, vol. 185(1), pages 110-123.
    9. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    10. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2010. "How to Control for Many Covariates? Reliable Estimators Based on the Propensity Score," IZA Discussion Papers 5268, Institute of Labor Economics (IZA).
    11. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    12. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    13. Faruque As Sunny & Linlin Fu & Md Sadique Rahman & Zuhui Huang, 2022. "Determinants and Impact of Solar Irrigation Facility (SIF) Adoption: A Case Study in Northern Bangladesh," Energies, MDPI, vol. 15(7), pages 1-17, March.
    14. Gevrek, Z. Eylem & Gevrek, Deniz & Neumeier, Christian, 2020. "Explaining the gender gaps in mathematics achievement and attitudes: The role of societal gender equality," Economics of Education Review, Elsevier, vol. 76(C).
    15. Hugo Bodory & Martin Huber & Michael Lechner, 2024. "The Finite Sample Performance of Instrumental Variable-Based Estimators of the Local Average Treatment Effect When Controlling for Covariates," Computational Economics, Springer;Society for Computational Economics, vol. 64(4), pages 2053-2078, October.
    16. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    17. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    18. Frölich, Markus & Huber, Martin & Wiesenfarth, Manuel, 2017. "The finite sample performance of semi- and non-parametric estimators for treatment effects and policy evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 91-102.
    19. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    20. Siddique Abu Bakkar, 2020. "Identity-based Earning Discrimination among Chinese People," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 11(1), pages 1-42, January.

    More about this item

    Keywords

    Agricultural and Food Policy;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:unadrs:280045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/ifaunit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.