AI Bias a Real Concern in Business

This number jibes with another finding from the DataRobot survey: that 38% of the organizations surveyed reported they use "black box" machine learning systems that offer no insight into how it makes decisions. The juxtaposition of AI bias concerns and black box systems is enough to warrant serious questions about the direction compaines should take with their machine learning, according to John Giannandrea, Apple's senior vice president of machine learning and AI strategy. "If someone is trying to sell you a black box system… and you don't know how it works or what data was used to train it, then I wouldn't trust it," DataRobot quotes Giannandrea as saying in its report. The survey indicates that organizations are aware of the potential pitfalls and are actively working to mitigate it. DataRobot found that 64% of survey respondents say they're "very to extremely" confident in their ability to identify AI bias.