What the A-level results crisis tells us about responsibility in decision analytics

20 August 2020

There are a lot of hot takes on the current exam results crisis. Amongst the cacophony of critical voices, you will even find a few offering thought-out alternatives. But subject these to any scrutiny and you will see they too have their own significant failings.

In England, there are around 750 thousand A-levels and 4.6 million GCSEs taken every year. That’s over 5 million individual results which need to be determined without the traditional exams results to do so. Outside the realms of science fiction, there is no conceivable algorithm or process which can do this without many many thousands of individuals each being left with a legitimate grievance. You may change who the thousands are, you may tinker with the number, but there is no avoiding this uncomfortable truth.

I would not claim Ofqual’s algorithm was a good solution, nor even the least bad; but it was at least a rational attempt to meet an impossible ask. This is ultimately all it could be. And – politicians take note – this is how it should always have been presented.

Algorithms are powerful tools. We create them to support decisions. We can even implement them to automate decisions. But we cannot, in the process, absolve someone of responsibility for these decisions. The conclusion we should draw is not that algorithms are bad, nor that public servants create bad algorithms. It is that, when you create a something to take a decision, there is always – always – a someone who remains responsible. You cannot devolve responsibility and accountability to an algorithm.

It is a simple truth, but one I fear we are doomed to need reminding of with increasing frequency.

Related articles :

Benefits management: 5 reasons benefits managers need to hire analysts

Without an analyst on your benefits team, you could be looking at fuzzy benefits, loose terminology and a shortage of numbers.


Quality Assurance of Analytical Modelling: The importance of QA in Model Risk Management

Quality assurance of analytical modelling is critical, but it in many organisations it doesn’t get the attention that it demands.


How NOT to predict football match scores using analytical modelling techniques

If it were easy to predict the outcomes of football matches, all analysts would be millionaires, right? They aren’t. Here’s why…