U.S. agency wants you–to keep AI from being trained to be malicious

The Intelligence Advanced Research Projects Agency announced it will be holding an event next week for organizations potentially interested in participating in two artificial intelligence security programs. One, called Secure Assured Intelligent Learning Systems (SAILS), looks to find ways to stop AI system users from learning too much about private data used to train the systems. Without such protections, malicious users might be able to find out information about training data in aggregate, such as "the average of an individual's face used to train a facial identification model," or even determine whether a particular person's data was included in the training model, according to the agency. "The goal is to provide a mechanism by which model creators can have confidence that their trained models will not inadvertently reveal sensitive information," according to IARPA. A second effort, called TrojAI, looks to spot Trojans, an allusion to the legend of the Trojan horse referring to hidden malicious behaviors.