Face recognition, bad people and bad data -- Benedict Evans

We worried that these databases would contain bad data or bad assumptions, and in particular that they might inadvertently and unconsciously encode the existing prejudices and biases of our societies and fix them into machinery. We worried people would screw up. That is, we worried what would happen if these systems didn't work and we worried what would happen if they did work. We're now having much the same conversation about AI in general (or more properly machine learning) and especially about face recognition, which has only become practical because of machine learning. And, we're worrying about the same things - we worry what happens if it doesn't work and we worry what happens if it does work.