Investigating the impact of systematic reviews funded by DFID

This study traces the impact of these systematic reviews by looking at use within government and other organisations

Abstract

Systematic reviews for international development originated 20 years ago. In 2010 the Department for International Development (DFID) introduced a programme of systematic reviews with a capacity building element that spanned multiple policy sectors.

This study traces the impact of these systematic reviews both in the academic research literature and beyond academia, by looking at use within government and other organisations (for example through inclusion in documents, research repositories and decisions beyond academia). Systematic reviews were cited more often in academia than beyond, some for their substantive findings, and some for methodological debate. Beyond academia, of the 86 systematic reviews: 21 informed specific decisions or policies, 25 were cited to enhance understanding, one informed new procedures for embedding evidence in decision making, 19 appeared in existing procedures for decision making, and 21 appeared in portals, maps or databases to enhance knowledge accessibility. Reviews were used by academics (69 reviews), government (20), review advisors (2), other stakeholders (37), or none (14). Three models of knowledge exchange can explain how use of these systematic reviews beyond academia was achieved. Clearly communicated policy implications may lead to greater use for policy decisions (linear model of knowledge transfer). Greater involvement of policy teams in focusing and reporting the review may lead to reviews appearing more relevant beyond academia (relationship model). Organisations using multiple systematic reviews may be distinctive in terms of their investment in capacity of individuals, teams, institutions and a global support system for systematic reviews (dynamic systems model). The three models potentially overlap: a dynamic evidence system supporting policy input may lead to more relevant reviews with clearer implications for policy. Investment in systems and relationships to support the production of systematic reviews looks promising for systematic reviews that provide clearer implications for policy and greater use beyond academia.

Citation

Oliver S, Anand K, Bangpan M (2020) Investigating the impact of systematic reviews funded by DFID. EPPI-Centre, Social Science Research Unit, UCL Institute of Education

Investigating the impact of systematic reviews funded by DFID

Published 23 November 2020