National statistics

Local authority registered provider (LARP) data quality and methodology note

Updated 25 October 2022

Applies to England

Introduction

This report describes the quality assurance arrangements for the local authority registered provider social housing stock and rents in England statistics, providing more detail on the regulatory and operational context for data collection and the safeguards that aim to maximise data quality.

Background

The statistics we publish are based on data collected directly from LARPs through the local authority data return survey. We will use the LADR data extensively as a source of administrative data. We first collected this data in 2020 and use it to deliver our operational approach to regulating rents (see regulatory context below). The United Kingdom Statistics Authority encourages public bodies to use administrative data for statistical purposes, as such, we publish these data.

The first publication of these data as collected through the LADR was in February 2021 (relating to data as at 31 March 2020). In previous years, data on owned local authority stock and rents were collected through the local authority housing statistic and published by the Department for Levelling Up, Housing and Communities, formerly the Ministry for Housing, Communities and Local Government, in the corresponding statistical release - Local authority housing data - GOV.UK.

National Statistics status

The statistics derived from the LADR data and published as local authority registered provider social housing stock and rents in England are considered by the Office for Statistics Regulation, the regulatory arm of the UKSA, to have met the highest standards of trustworthiness, quality and public value.

Designation history

During 2020/21 we asked the OSR to review our planned publication of these statistics following the transfer of responsibility for the data collection and production from the, then, MHCLG to RSH. The OSR compliance check focused particularly on our work to maintain and enhance the quality of the statistics through this transition and in February 2021 they confirmed that these statistics could continue to be designated as National Statistics.

The OSR reported a range of positive features that demonstrated the trustworthiness, quality, and value of these statistics. These are outlined in detail in the 2020 data quality and methodology note.

User feedback

We are keen to increase the understanding of the data, including the accuracy and reliability, and the value to users. Please email feedback, including suggestions for improvements or queries as to the source data or processing to enquiries@rsh.gov.uk.

Proposed change to collection and published data

As part of our continued review of the data collected and published on local authority stock and rents, we are seeking feedback on our proposals to cease collecting a dwelling equivalent figure for non-self-contained units.

Background

When the LADR collection was created in 2019, it took questions from the existing Local Authority Housing Statistic and replicated these in order to maintain the timeseries for data publication. Since then, we have sought to ensure and improve the quality of the data returned to us through the LADR. An area which we are aware causes significant confusion, and which has been reported as having resulted in errors in previous years’ submissions, is the collection of the dwelling equivalent count of non-self-contained units.

The dwelling equivalent count is based on a clustering of non-self-contained units to provide an estimate of the number of properties in which bed spaces are present. It is not an accurate count of these properties, as it employs a maximum threshold for the number of bed spaces clustered together (which is different depending on whether the bed space is in a hostel or in a house of multiple occupation). We feel that the count does not provide significant insight into the number of non-self-contained units, nor is it comparable with the way in which non-self-contained units are recorded in our other collections.

Proposal

From 1 April 2022 we intend to cease the dwelling equivalent collection and collect non-self-contained units as bed spaces only across the LADR, ensuring comparability with our private registered provider statistics and meaning no dwelling equivalent data will be published after this publication. If this change, and loss of continuation of the dwelling equivalent timeseries poses significant issues with your analysis then please provide details of the concerns to us as soon as possible and by 31 January 2022.

Impact

The data presented in the 2021 publication includes bed space data for non-self-contained units, although dwelling equivalent data is provided in our additional tables. The table below shows the impact of this change on our 2021 data. The total across England is 2,847 units (0.2%) greater using bed spaces than when using the dwelling equivalent value. The impact is greater on supported housing than on general needs (1.1% compared to 0.1%). This is due to there being proportionally more supported housing provided as non-self-contained units (1.6% compared to 0.2% of general needs). We feel that this shift is minimal and that the move to only bed space level data will continue to provide high quality, comparable data in future years whilst reducing the burden on our data suppliers (LARPs).

2021 LARP data	Bed spaces	Dwelling equivalent	Difference	% difference
General needs (social rent)	1,441,412	1,439,825	1,587	0.1%
Supported housing (social rent)	98,830	97,838	992	1.0%
Low cost rental (social rent)	1,540,242	1,537,663	2,579	0.2%
Affordable Rent general needs	26,905	26,756	149	0.6%
Affordable Rent supported housing	3,830	3,706	124	3.2%
Affordable Rent	30,735	30,462	273	0.9%
Total [footnote 1]	1,570,977	1,568,125	2,847	0.2%

For more information please see the more detailed note exploring the impact of this proposed change available on our LARP statistics page.

Please send any feedback you have on this proposal, or any other aspect of the LARP statistical publication, to enquiries@rsh.gov.uk by 31 January 2022.

Publication schedule

We intend to publish these statistics in Autumn each year, with the data pre-announced in the release calendar.

All data, supplementary tables, data tools and additional information (including a list of individuals (if any) with 24 hour pre-release access) are published on our statistics pages.

These statistics are also presented in DLUHC live tables and our registered provider social housing statistics.

Quality assurance of administrative data

The data used in the production of these statistics are classed as administrative data. In 2015 the UK Statistics Authority published a regulatory standard for the quality assurance of administrative data. As part of our compliance to the code of practice, and in the context of other statistics published by the UK Government and its agencies, we have determined that the statistics drawn from the LADR are likely to be categorised as low quality risk – medium public interest (with a requirement for basic/ enhanced assurance).

The publication of these statistics can be considered as medium public interest, as there has been mainstream media interest, but they have only moderate economic and/or political sensitivity. Concerns over data quality are considered low given the data checks by providers and our data quality checks conducted on the submitted data and analytical processes. This categorisation is the same as for the previous LAHS and current SDR data based statistical releases, both of which have similar collection and analysis methodologies and coverage.

Notwithstanding this, we aim for the highest standards of data quality possible within the constraints of available resources and the existing regulatory and operational context. Through on-going internal analysis, we seek to understand the strengths and limitations of the data, the overall quality of the data and to identify potential means by which it may be improved.

Regulatory context

The regulatory framework for social housing in England underpins the collection of LADR data. For more information about the Regulator of Social Housing and the regulatory framework please see our website.

Regulatory standards

First collected in 2020, the LADR data are used to facilitate our operational approach to regulating the Rent Standard.

Paragraph 3.19 of the rent standard requires local authorities registered with us to “communicate with the Regulator in an accurate and timely manner. This includes all data and information required by the Regulator in respect of compliance with this Standard.” This requirement includes the annual submission of LADR data.

The regulatory framework and data quality

In Regulating the Standards, we set out the operational approach to regulation and emphasise the importance of providers supplying timely and accurate data. More detail on our approach and expectations regarding data and information submission from LARPs are set out in paras 3.6 to 3.10 of the document.

Governance of data and statistics at RSH

The statistician responsible for the publication of these statistics is also responsible for the LADR data collection and the cleansing of incoming LADR data; working with LARPs to directly address anomalies within the data submissions and producing the final data set on which the statistics are produced.

All LADR data are stored and analysed within password-protected government secure networks and access to the sector level analysis work undertaken on the data is restricted until after publication (LARP level data is accessed by our staff as part of operational work). Further information on the data quality assurance processes we employ is provided below.

Data submitted by LARPs is redacted within the public release to remove all contact information submitted within the Entity Level Information section. This contact information is not publicly available. There is no other administrative data held nor local authority specific data collected by us which can be made available for use in statistics.

LADR collection

All local authorities registered with the Regulator of Social Housing (LARPs) are expected to complete the LADR. The return provides us with the data required for the risk-based, data-driven approach to regulating local authority compliance with the rent standard.

History

The LADR was collected for the first time in 2020. This followed a pilot collection in 2019, where we worked with local authorities to encourage engagement and to identify areas where our systems and guidance could be improved. From 1 April 2020 the LADR was included on the single data list which outlines data sets local government must submit to central government.

Coverage

LADR does not collect data from all local authorities, only those registered with us as providers of social housing. However, as set out in section 114A of the Housing and Regeneration Act 2008, all local authorities who provide social housing are subject to compulsory registration. Therefore, the data collected in LADR can be considered a complete census of local authority owned ^{[footnote 2]} social housing. Where the managing agent of local authority stock – the arm’s length management organisation – also owns units, the ALMO will be registered as a private registered provider for these units. The ALMO will complete the statistical data return providing details of the stock they own and record LARP owned stock as units managed on behalf of others.

Comparison to previous data collection (LAHS)

The LAHS collection, collected by DLUHC includes a wide range of information related to local authority housing from all lower tier local authorities (including unitary authorities). Data are collected as a snapshot as at 31 March and for the whole of the financial year.

In 2020, following discussions with local authorities, a number of questions relating to social housing stock numbers and rents were transferred from LAHS to LADR in order that we could collect information essential for regulating rents and to ensure no duplication (nor increased burden) in data supply. The 2020 data quality and methodology note provides more information on the transfer of questions.

For more information on the changes between the two collections and the impact this may have on these statistics please see the technical notes and definitions.

Systems

The LADR is collected via a web-based system called NROSH+. The NROSH+ system is hosted and maintained by us (through our digital partner Homes England). We control the requirements for data input processes, storage, verification, sign off and extraction of submitted data and produce the statistical releases. Data is either imported or entered directly into the NROSH+ system directly by LARPs.

Communication with data suppliers

We work closely with local authorities, through email messages and phone discussions, to ensure there is a common understanding of the data collection requirements throughout the data collection process. Guidance materials are promoted and published on NROSH+ and we work closely with the central local information partnership – housing to develop questions and guidance.

Quality assurance processes

We do not have oversight of the systems and data quality assurance processes employed by the local authorities before submitting data to LADR. However, we do provide clear guidance and documentation on the NROSH+ system and subject LADR submissions to a series of checks to identify potential quality issues before each data return is signed off.

The final LADR data file that supports the statistical release is only created once all outstanding queries which could materially impact the quality of the published data are resolved. Any returns not meeting our quality standards are excluded from the final dataset. A list of all LARPs who have not submitted data or whose data did not meet our quality standards will be published alongside the data in the years this is required.

Submission checks

LADR data submitted to us is subject to both automated validation checks and manual inspection. Automated validations are programmed into NROSH+ and check the LADR data at the point of submission for correct formatting, consistency and logical possibility (within expected limits). For example, ensuring numbers of units are consistent across different parts of the LADR. Automated validations are either ‘hard’ or ‘soft’.

• Hard validations – LARPs cannot submit without the issue being resolved (for example, when data on stock numbers is missing but a rental value is given).
• Soft validations – LARPs can submit but are required to check their information, and if correct to submit a supporting document (for example, when a value appears to be outside of a normally expected range, such as higher than expected rents).

Manual inspections are systematically undertaken on all data submitted. Returns are checked for basic consistency and likely errors, for example where proportions of stock are recorded as particular excepted categories are outside the expected range or where rents are particularly high or low. This includes comparison to previously submitted data, with unexpected movements in stock levels or changes outside those anticipated in reported rent values being queried with LARPs.

Where we identify a potential anomaly with the submitted LADR data, a query is raised with the submitting LARP. This overall checking process is outlined in the diagram in Annex A.

We also use the provisional LAHS headline stock data each year to assess the quality and coverage of the LADR data. We review individual LA discrepancies against queries raised during cleaning to identify reasons for these. Where we do not have information, we contact LARPs to confirm the data submitted to LADR was accurate. Data from LADR is provided back to DLUHC to assist with further data checks on the LAHS data during the finalisation of the dataset. For more information on the differences between LADR and LAHS and the impact this may have on these statistics please see technical notes and definitions.

Post publication checks

LADR data (excluding contact details), are published at a disaggregated level as part of the statistical release. Releasing data into the public domain serves as an additional route through which erroneous data may be identified by the LARP or third parties.

Misreporting

There are no numerical measures of misreporting of LADR data by LARPs. However, one source of possible quality weakness is inconsistent interpretation of guidance with providers not applying this consistently across the sector. This issue is most likely to arise where there are technical or legal definitions that are complex or, to some degree, ambiguous. Please see technical notes and definitions for more information on other factors which impact on the data collected.

Corrections

Where errors in the LADR data are discovered within a survey year, either through regulatory activity or through provider contact, we allow providers to resubmit LADR data through the NROSH+ portal. Returns can be amended until mid-March the year following their launch.

Statistical release methodology

The data presented in the local authority registered provider social housing stock and rents statistics are drawn from the LADR data.

Accounting for missing data

All questions in the LADR are mandatory and all LARPs are expected to submit the return.

2021 responses

As in 2020, the 2021 response rate was 100%. This is a slightly higher response rate than for the LAHS return in previous years (98.4% in 2019 and 99.4% in 2018).

Due to the 100% response rate and all data queries being resolved in 2021 we have not needed to impute any figures to account for missing or suspected inaccurate data.

Quality assurance of the published statistics

The data, briefing note, look up tools and tables are quality assured by analysts within our statistics production team. This process ensures the figures are consistent across the release, and match the raw data submitted through LADR. Each check is signed off and recorded by the responsible statistician when it has been completed.

Revisions

Under the revisions policy (see technical notes and definitions), errors identified will be investigated and revised data gathered. Some corrections may be only minor changes to the data, with little or no impact on the published statistics. These changes will be published at the next scheduled release with no specific announcement.

However, if we become aware of substantial errors in the submitted data, statistical process or other methodology and where a major revision to the published data is required a non-scheduled revision of the statistical release will be published. This will include full details of the revisions, clearly marked data amendments and summary tables showing the overall impact of the changes.

We seek to ensure transparency in processes to maximise user confidence in the quality of our statistical releases.

2021 revisions

During 2020/21 we worked closely with LARPs to review data submitted to us in 2020. The focus of the work was through our regulation of rents, and identified issues with reported rents, stock classification and formula rent values.

This work resulted in 14 LARPs resubmitting their 2020 LADR data to us following identification of data errors. The majority of these errors were the result of inconsistent interpretation of the stock type definitions, with units reported under the wrong classification or incorrectly classified as social housing. Additionally, several LARPs had made calculation errors in the rent data submitted to us in 2020 and resubmitted data to rectify these errors.

The subsequent resubmissions had a small, but noticeable effect on the overall stock and rent headlines for the 2020 dataset.

In total a net change of -488 units (including LCHO) was noted (-0.03%).

The impact on England level general needs social rent data was -£0.15 (-0.17%) and supported housing social rent data was -£0.38 or -0.50%. The impact was seen in a limited number of regions and most impacted the East of England (with general needs social rent impact being -£1.11 or -1.23% and supported housing social rent impact being -£1.50 or -1.80%.

The impact on England level average Affordable Rent general needs rent was +£0.52 (+0.43%). The impact on Affordable Rent general needs was seen in just three regions and most impacted London (£-1.22 or -0.68%). There were no revisions impacting Affordable Rent supported housing.

More detailed comparisons are provided in our additional tables (5.1 to 5.5).

Annual cycle of regulatory activity

The LADR data is collected to inform engagement on registered providers’ compliance with the rent standard. As part of their response to any issues raised by us, providers subject their data to increased validation and may identify errors in the data submitted. We are committed to ensuring the quality of the LADR data and will gather corrected data from LARPs as part of this work.

We will republish these statistics in the April of the year following the initial publication, if the aggregate changes made by providers require a major revision. If a major revision to published data is not required, the changes will be incorporated (and clearly marked) in the published baseline data for the following years’ release.

The publication of 2020 statistics was delayed until February 2021 due to the coronavirus. As a result of this delay and the contracted timescale available for amendments, the revisions shown in the 2021 publication have not been incorporated into the briefing notes or additional tables of the 2020 release. However, the 2020 raw data set has been updated to show these changes and the additional tables published as part of the 2021 release show the impact of these revisions (please also see above).

Why not have your say on our statistics in 2021/22?

We want to hear your views on how the format and range of documents in this statistical release meet your needs. Please email feedback, including suggestions for improvements to enquiries@rsh.gov.uk or click below to quickly rate how this document meets your needs.

• All needs met
• Some needs met
• No needs met

Annex A: Quality assurance processes - process map

Data import, entry and system validation (pre submission to RSH)

Manual data processing and outlier checking (post submission to RSH)

© RSH copyright 2021 This publication is licensed under the terms of the Open Government Licence v3.0 except where otherwise stated. Where we have identified any third party copyright information you will need to obtain permission from the copyright holders concerned. Any enquiries regarding this publication should be sent via enquiries@rsh.gov.uk or call 0300 124 5225 or write to:

Regulator of Social Housing
Level 2
7-8 Wellington Place
Leeds LS1 4AP

RSH regulates private registered providers of social housing to promote a viable, efficient and well-governed social housing sector able to deliver homes that meet a range of needs.

1. Unit difference figures are based on unit differences between dwelling equivalents and bed spaces for each stock type. Total difference figures shown in the total row are five less than the sum of individual parts due to a 4 unit variance in self-contained figures in general needs (social rent) and 1 dwelling equivalent unit of LCHO being excluded from analysis. ↩

2. Local Authorities are asked to report units they own, and which are not leased to other registered providers. Where units are leased (on a lease of any length) to a private registered provider that body is considered to be the owner. The definition of ownership focuses on the body with the direct landlord relationship with the tenant. ↩