In the past, evaluation focused to a large extent on the mechanisms of delivering programmes or projects. In other words, it focused on the implementation process. Relatively little attention was paid to evaluating the impact of interventions that were being financed.
While in recent years substantial efforts have been made to promote and disseminate quantitative counter-factual impact evaluation practice, there is much less sharing of good practice concerning so-called theory-based impact evaluation. However, while counter-factual impact evaluation can tell us the extent of the impact made by an intervention, theory-based impact evaluation is crucial to increasing our understanding of why certain interventions do or do not work. Without this understanding, it is impossible to improve interventions. In addition, in many cases counter-factual impact evaluation is not actually a viable method, and then theory-based evaluation can still inform how the intervention is contributing to change.
This seminar will therefore focus on this theory-based impact evaluation, drawing on the latest advances made in terms of methodology. The most cited methods – process tracing, congruence analysis, Qualitative Comparative Analysis (QCA), Pawson and Tilley’s realist evaluation and Mayne’s contribution analysis – will all be covered and put into perspective. Several cases will be used to explain these methods. You will also undertake a number of exercises to better understand the methods. An important focus of the course will be to show you how theory-based impact evaluation can match the rigour associated with counter-factual impact evaluation.
The seminar is aimed at those with experienced in impact evaluation who wish to further advance their capabilities in this field.