If you use assistive technology (such as a screen reader) and need a
version of this document in a more accessible format, please email firstname.lastname@example.org.
Please tell us what format you need. It will help us if you say what assistive technology you use.
The aim of this research was to investigate estimates of inter-rater reliability for assessments where inconsistency in marking between markers might be the major source of unreliability.