Replication Studies of Development Impact Evaluations

Six years ago, the International Initiative for Impact Evaluation (3ie) launched a programme to promote and fund replication studies of impact evaluations in international development. We designed the programme with the objective of improving the quality of evidence for development policy-making, using replication research to both validate the results of published impact evaluations and build the incentives for more transparent and high quality research going forward. The programme’s focus is internal replication, which uses the original data from a study to address the same question as that study. This Journal of Development Studies special issue compiles the majority of completed 3ie-funded replication studies initiated in the first years of the programme. In all cases the pure replication components of these studies are generally able to reproduce the results published in the original article. Most of the measurement and estimation analyses confirm the robustness of the original articles or call into question just a subset of the original findings. These replication studies mostly focus on providing additional information about the impacts of the interventions – especially additional information that can be important for interpreting the articles for the purpose of policy-making.