Skip to content

DWP Awards £27M AI Contract Amid Bias Concerns

DWP's £27M AI push raises transparency and bias concerns. Campaigners warn of profiling millions with biased algorithms.

In the picture we can see three boys standing near the desk on it, we can see two computer systems...
In the picture we can see three boys standing near the desk on it, we can see two computer systems towards them and one boy is talking into the microphone and they are in ID cards with red tags to it and behind them we can see a wall with an advertisement board and written on it as Russia imagine 2013.

DWP Awards £27M AI Contract Amid Bias Concerns

The Department for Work and Pensions (DWP) has awarded IBM a £27 million contract to explore and deploy AI technologies. However, concerns have been raised about the department's use of AI and algorithmic bias.

The DWP's use of AI, including 'tech spikes', horizon scans, and proofs of concept, has drawn criticism for lack of transparency. Campaign group Big Brother Watch has warned about biased algorithms profiling millions of people each year. A recent report found the Universal Credit Advances machine learning model 'riddled with algorithmic bias'.

The contract, called Nexus AI, is initially valued at £9 million for a year, with potential extensions of two more years at the same cost. Despite these concerns, the DWP maintains its approach to AI adoption is 'value-led, responsible, secure, and firmly human-centred'. IBM will work with the DWP to identify business problems, build beta minimum viable products, and maintain and support live products.

The DWP's use of AI, worth up to £27 million, aims to enhance its services. However, the lack of transparency and concerns about algorithmic bias highlight the need for careful consideration and robust oversight in the department's AI adoption process.

Read also:

Latest