An Algorithm For De-Biasing AI Systems

A fundamental truth about AI systems is that training the system with biased data creates biased results. This can be especially dangerous when the systems are being used to predict crime or select sentences for criminals, since they can hinge on unrelated traits such as race or gender to make determinations. A group of researchers from the Massachusetts Institute of Technology (MIT) CSAIL is working on a solution to "de-bias" data by resampling it to be more balanced. The paper published by PhD students [Alexander Amini] and [Ava Soleimany] describes an algorithm that can learn a specific task – such as facial recognition – as well as the structure of the training data, which allows it to identify and minimize any hidden biases. Testing showed that the algorithm minimized "categorical bias" by over 60% compared against other widely cited facial detection models, all while maintaining the same precision of detection.