Transparency data

Theory of Change (HTML)

Published 31 January 2022

Evaluation Task Force (ETF) Objective: To ensure that robust evidence on the effectiveness of policies and programmes sits at the heart of government spending decisions

Inputs

  • Circa £950 thousand investment 2021-2022 covering 15 Full Time Employees. Post 2022 investment yet to be decided
  • £15 million 2022-2025 for the Evaluator Accelerator Fund
  • What Works Trial Advice Panel (TAP)” and What Works National Adviser
  • Senior level governance and oversight

Activities

  • Build relationships with key stakeholders across government including the policy, analytical and finance community
  • Advise and support departments on design and delivery of robust, proportionate evaluations
  • Set up and deliver Evaluation Task Force (ETF) support services (e.g Timebank, TAP)
  • Fund evaluations via the Evaluation Accelerator Fund
  • Deliver ‘Policy that Works’ conference
  • Embed evaluation requirements in department reporting mechanisms and processes (e.g. Outcome Delivery Plans)
  • Rapid scrutiny of evaluation plans attached to business cases submitted to Her Majesty’s Treasury (HMT) spending teams
  • Challenge departments on evaluation activity via ministerial engagement e.g. challenge panels
  • Develop and deliver a What Works Network (WWN) strategy
  • Manage and promote the WWN and relevant outputs across government
  • Create an ETF website to encourage publication of data, evaluation plans and evaluation results
  • Develop data sharing project and requirements

Outputs

  • Advice to departments on improving robustness of evaluation plans
  • Advice to departments on building experimental and quasi-experimental methods into evaluation designs
  • Advice to departments on commissioning evaluation
  • Advice to departments on evaluation publication and reporting
  • Advice and sign off on evaluation plans for innovation funds
  • Feedback to HMT spending teams on evaluation design and findings
  • Conditions on funding decisions following scrutiny of evaluation plans accompanying business cases
  • Conditions on department-wide evaluation arrangements attached to fiscal events
  • Assessments of departmental performance on evaluation
  • ETF website and public register of evaluation plan summaries, trial protocols, data and results
  • Escalation of data sharing/publication barriers to No.10 and HMT

(Intermediate) Outcomes

  • Increased number of spending and operational decisions made by departments considering evidence
  • Increased number of spending decisions made by Spending Teams considering evidence
  • Increased scale and quality of evaluations (with a focus on experimental approaches) across government.
  • Improved transparency of evaluation plans, data, and results
  • Improved evaluation culture across government

Impacts

  • Increased effectiveness and efficiency of government spending