A new way to assess AI bias in object-recognition systems

Delivering the benefits of artificial intelligence to everyone requires creating systems that work well for everyone. At F8 2019, we highlighted Facebook AI's range of systems and processes currently in production for developing inclusive AI and addressing labeling bias, algorithmic bias, and intervention bias. These efforts help ensure our computer vision (CV) systems work well for all skin tones, for example, and allow our augmented reality effects to serve everyone regardless of facial features, hairstyle, or other factors. But creating fair and unbiased AI systems will require mitigating other forms of potential bias as well, so today, Facebook AI researchers have published the first systematic study that measures the accuracy of object-recognition systems for different communities across the world. Events such as weddings or commonly used household items (dish soap, for instance) can look very different in different places, so CV systems trained with data predominantly from one region may not perform as well when classifying images from somewhere else.