Humble AI: Building Guardrails Against Overconfidence

As AI becomes ubiquitous, more and more high-stakes decisions will be made automatically by machine learning models. AI can determine the very future of your business and can make life-or-death decisions for real people. But as the world changes, an AI system is often faced with new examples that it hasn't seen before, and it may not know the right answer. Without proper guardrails, these automated decisions can quickly turn into catastrophic failures if left unchecked and can reduce trust in AI. As the stakes get higher, it is critical that AI systems are built to be humble -- just like humans, AI should know when it doesn't know the right answer.