De-biasing bias

Picture a machine learning system that relies on crowdsourced data labelers to help rank music recommendations. Labellers are all different and this difference may manifest in their labels. The answer depends on many things, but one of them is who you are asking. Bias means different things to different people. The other day I watched a very interesting discussion along these lines between a lawyer (Jake Goldenfein) and a data scientist (Danula Hettiachchii). It seemed like my colleagues had fundamentally different ideas about bias.