Independent report

AI Standards Hub: pilot evaluation report

DSIT commissioned an independent review of the pilot phase of the AI Standards Hub (The Hub).

Documents

AI Standards Hub: pilot evaluation report

Request an accessible format.
If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email alt.formats@dsit.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Details

In October 2022, the UK Government launched the AI Standards Hub, an initiative led by the Alan Turing Institute, the British Standards Institution (BSI) the National Physical Laboratory (NPL) and supported by UK government.

The AI Standards Hub aims to help stakeholders navigate and actively participate in international AI standardisation efforts and to inform the direction of these efforts. Dedicated to knowledge sharing, community and capacity building, and strategic research, the Hub seeks to bring together industry, government, regulators, civil society and academia.

UK government commissioned Oxford Information Labs (OXIL) to provide an independent review of the progress of the pilot phase of the UK AI Standards Hub’s (the Hub), which took place from October 2022 to March 2023.

AI standards can play a vital role in our pro-innovation, agile approach to AI governance and support economic growth. AI standards can offer practical tools for implementing pro-innovation AI governance principles (e.g, transparency, safety) by setting out best practices that can be consistently applied to ensure that products, processes, and services perform as intended.

Key findings

The review concludes that in only six months, the pilot phase has enabled the Hub to take strong, initial steps towards achieving its long-term goals of advancing trustworthy and responsible AI. Qualitative and quantitative evidence show the great impact the Hub has had so far.

The AI Standards Hub increased users’ understanding of AI standards. Participants reported that the Hub has begun to address the existing knowledge gap with nearly 70% of survey Respondents agreeing that the Hub is already supporting the UK AI community in influencing and engaging on standards.

The pilot has enabled the creation of a distinct community around the Hub. By April 2023, the Hub reached 869 user signups. 82.4% of survey respondents viewed the Hub as a good place to collaborate with other stakeholders and share knowledge on AI standards.

The training offered during the pilot was found to be an especially valuable feature of the Hub, helping users navigate the international standards landscape.

The pilot has laid the ground for the Hub to contribute to the UK’s international influence in AI standards, with 67% of Respondents agreeing the AI Standards Hub is already helping the UK have an internationally recognised voice that informs the development of AI-related standards.

The Hub has helped inform domestic policy making - referenced in the UK’s AI White Paper and UK Science and Technology Framework.

Published 19 October 2023