The Initial Design Document sets out the conceptual approach and methodological for the independent impact evaluation of a new Millennium Villages Project in Northern Ghana. The document is accompanied by three appendices which look at: Quantitative Data Collection Instruments, Qualitative Methods and Tools, and Quality Assurance Protocols and Templates.
The evaluation will use a difference-in-difference (DD) approach, by comparing the change in outcomes in the MVP areas before implementation to post-implementation, with changes in the same outcomes for an explicit control group. The sustainability of the effects of the intervention will be assessed by estimating the effects of the intervention after 10 years, while externalities will be detected by building in an additional treatment so that the control consists of both ‘faraway’ and ‘nearby’ communities. Externalities will also be estimated through social network analyses. Complementary qualitative research will address the questions why and how the Millennium Village has or has not had an impact.
The IDD is structured in the following way: Firstly, the document starts with an overview of the MV, describing the intervention and its aims (Chapter 1). The rest of the document then provides details on the evaluation approach and methodology, including the programme theory, the quasi-experimental design, and the quantitative survey tools (Chapter 2). The cost-effectiveness methodology (Chapter 3) and the qualitative methodology (Chapter 4) are then covered, followed by the governance arrangements for the evaluation (Chapter 5). Finally, the IDD ends with a summary of the communication strategy (Chapter 6).
A Peer Review Group assessment of the initial design document has been conducted. The Design Document, appendices and assessment can be downloaded from the IDS website through the link provided.
PDS Ghana; IDS; ITAD; Brown, A.N.; Osei, R.D.; de Hoop, T.; Udry, C.; White, H. Impact Evaluation of a New Millennium Village in Northern Ghana: Initial Design Document and Peer Review Assessment. (2013)