The peer review process for awarding funds to international science research consortia: a qualitative developmental evaluation

This study explores how assessment criteria concerning research quality and capacity strengthening were applied during the peer review process

Abstract

Evaluating applications for multi-national, multi-disciplinary, dual-purpose research consortia is highly complex. There has been little research on the peer review process for evaluating grant applications and almost none on how applications for multi-national consortia are reviewed. Overseas development investments are increasingly being channelled into international science consortia to generate high-quality research while simultaneously strengthening multi-disciplinary research capacity. We need a better understanding of how such decisions are made and their effectiveness.

An award-making institution planned to fund 10 UK-Africa research consortia. Over two annual rounds, 34 out of 78 eligible applications were shortlisted and reviewed by at least 5 external reviewers before final selections were made by a face-to-face panel. We used an innovative approach involving structured, overt observations of award-making panel meetings and semi-structured interviews with panel members to explore how assessment criteria concerning research quality and capacity strengthening were applied during the peer review process. Data were coded and analysed using pre-designed matrices which incorporated categories relating to the assessment criteria.

Citation

Gregorius S, Dean L, Cole DC and Bates I. The peer review process for awarding funds to international science research consortia: a qualitative developmental evaluation [version 3; peer review: 2 approved] F1000Research 2018, 6 :1808 https://doi.org/10.12688/f1000research.12496.3

The peer review process for awarding funds to international science research consortia: a qualitative developmental evaluation

Published 6 October 2017