Companies Need To Start Reporting What AI Gets Wrong, Not Just What It Does Right

In just a few years, deep learning-powered AI and other forms of machine learning have exploded from niche tools into the underlying basis of nearly every major modern online platform. Yet, even as these algorithms increasingly wield near-absolute power over what we see and say online, we have precious little visibility into how they function. If AI tools can robustly prevent hate speech and terrorist recruiting, flag false news and delete financial scams, they will be a welcome addition to our online lives. On the other hand, without any visibility into how often they get things wrong, we have little reason to trust their successes. AI and machine learning have become ubiquitous on the modern web, powering everything from security scanning to content moderation.