Research and analysis

The probabilistic elicitation of subjective data

Probabilistic elicitation provides a means to elicit the uncertainty surrounding subject matter experts’ best guesses for numerical values. This pioneering research is highly relevant to government work.

Document

The probabilistic elicitation of subjective data

This file may not be suitable for users of assistive technology. Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email centralenquiries@dstl.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Details

This paper feeds directly into the government’s Analytical Quality Assurance book.

Much of Dstl’s advice is driven by research that utilises subjective quantities, as determined by experts. At present, these subjective quantities are often reported as single-point figures; it is not known how confident the experts are in their estimates. Consequently, important decisions might be based on estimates for which the experts are unsure.

This report presents an established methodology and highlights best practice for representing the uncertainty surrounding experts’ subjective judgements. It gives decision-makers a means of assessing the levels of risk that they are taking by using expert judgement to inform the decision-making process.

Published 30 July 2015