Counterfit: Open-source Tool For Testing The Security Of AI Systems - AI Summary

After developing a tool for testing the security of its own AI systems and assessing them for vulnerabilities, Microsoft has decided to open-source it to help organizations verify that that the algorithms they use are "robust, reliable, and trustworthy." Counterfit started as a collection of attack scripts written to target individual AI models, but Microsoft turned it into an automation tool to attack multiple AI systems at scale. Counterfit is also being piloted in the AI development phase to catch vulnerabilities in AI systems before they hit production," Will Pearce and Ram Shankar Siva Kumar from Microsoft's Azure Trustworthy ML team explained. It can be used for penetration testing and red teaming AI systems (by using preloaded published attack algorithms), scanning for vulnerabilities in them, and logging (recording attacks against a target model). After developing a tool for testing the security of its own AI systems and assessing them for vulnerabilities, Microsoft has decided to open-source it to help organizations verify that that the algorithms they use are "robust, reliable, and trustworthy." Counterfit started as a collection of attack scripts written to target individual AI models, but Microsoft turned it into an automation tool to attack multiple AI systems at scale. Counterfit is also being piloted in the AI development phase to catch vulnerabilities in AI systems before they hit production," Will Pearce and Ram Shankar Siva Kumar from Microsoft's Azure Trustworthy ML team explained.