What power do algorithms have over us? - Stockholm University

Imagine that you have been convicted of a crime and an algorithm is to help the judge by proposing the sentence. When computers are programmed, discrimination is built into the algorithms, so if you look a certain way you get a harder sentence. This example is not fiction. It comes from the USA where AI is being used in the legal system to propose sentencing for criminal offences, and it proposes harder sentences for black people. It might be chance, a prejudiced system developer or perhaps distorted data that the system had to practice on.