Intelligence Community Searches for Ways to Protect AI from Tampering

The intelligence community is investing in artificial intelligence as a way to augment the capabilities of intelligence analysts, with the National Geospatial-Intelligence Agency promoting computer vision technology and the CIA looking to AI and machine learning to help it sift through large volumes of data. Yet AI is only as strong and useful as the protections around it. That's why the intelligence community's research arm is looking for ways to predict if AI has been tampered with. In a draft broad agency announcement released last month, the Intelligence Advanced Research Projects Activity sought industry input on its TrojAI program. The program is designed to create software to automatically inspect an AI system and predict if it contains a "Trojan" attack that has tampered with its training.