Research and analysis

Ofqual literature review of item-level marking in exams

This research from 2014 compares the pros and cons of using item-level marking in exams rather than whole-script marking.

• From: Ofqual
• Published: 14 February 2014

Applies to England

Documents

Quality of Marking: Review of Literature on Item-level Marking Research

Ref: Ofqual/14/5378

PDF, 320 KB, 11 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Details

There is currently limited empirical evidence available to allow a proper comparison of the relative merits of whole-script marking and item-level marking.

However, the limited research carried out to date suggests that item-level marking seems to be at least as reliable as whole-script marking, and under some conditions is likely to be more reliable than whole-script marking.

Specifically, item-level marking may:

• remove the ‘halo effect’ that means examiners carry forward preconceived ideas about the level of a student’s understanding based on his or her answers to previous unrelated items
• eliminate the most extreme cases of poor marking reliability, which impact significantly upon public confidence, although it is unlikely to make it more likely that a student will receive the correct grade
• improve the reliability of marking, particularly for the highest performing students

It is suggested that further research in this area is needed.

Published 14 February 2014