Our familiarity with artificial intelligence (AI) and the role of algorithms in our lives is increasing, but the intrigue remains around the validity and fairness of how machines are scoring online assessments—are they accurate, are they fair? The key to the success of AI and computer-based tests is to build the infrastructure from the ground up, according to Dr Rose Clesham, Director of Academic Standards & Measurement (English Assessment) at Pearson. The systems that Pearson’s English language tests are built on are highly sophisticated algorithms, and those algorithms are turning computer information back into a form of human scores, notes Dr Clesham.
“When we train our engines, the human scorers give pieces of work – lots and lots of pieces of work – and they score them in a human way and provide a human score, and that then is used to train or to start the journey of training our systems.”
LISTEN: Episode 8 — The fairness of algorithms
Let’s dive into some of the key points that unpack computer-based testing and its role in modern assessment.