Goto

Collaborating Authors

 iba






IBA: Towards Irreversible Backdoor Attacks in Federated Learning

Neural Information Processing Systems

Federated learning (FL) is a distributed learning approach that enables machine learning models to be trained on decentralized data without compromising end devices' personal, potentially sensitive data. However, the distributed nature and uninvestigated data intuitively introduce new security vulnerabilities, including backdoor attacks. In this scenario, an adversary implants backdoor functionality into the global model during training, which can be activated to cause the desired misbehaviors for any input with a specific adversarial pattern. Despite having remarkable success in triggering and distorting model behavior, prior backdoor attacks in FL often hold impractical assumptions, limited imperceptibility, and durability. Specifically, the adversary needs to control a sufficiently large fraction of clients or know the data distribution of other honest clients.


Towards Invisible Backdoor Attack on Text-to-Image Diffusion Model

Zhang, Jie, Wang, Zhongqi, Shan, Shiguang, Chen, Xilin

arXiv.org Artificial Intelligence

Backdoor attacks targeting text-to-image diffusion models have advanced rapidly, enabling attackers to implant malicious triggers into these models to manipulate their outputs. However, current backdoor samples often exhibit two key abnormalities compared to benign samples: 1) Semantic Consistency, where backdoor prompts tend to generate images with similar semantic content even with significant textual variations to the prompts; 2) Attention Consistency, where the trigger induces consistent structural responses in the cross-attention maps. These consistencies leave detectable traces for defenders, making backdoors easier to identify. To enhance the stealthiness of backdoor samples, we propose a novel Invisible Backdoor Attack (IBA) by explicitly mitigating these consistencies. Specifically, our approach leverages syntactic structures as backdoor triggers to amplify the sensitivity to textual variations, effectively breaking down the semantic consistency. Besides, a regularization method based on Kernel Maximum Mean Discrepancy (KMMD) is proposed to align the distribution of cross-attention responses between backdoor and benign samples, thereby disrupting attention consistency. Extensive experiments demonstrate that our IBA achieves a 97.5% attack success rate while exhibiting stronger resistance to defenses, with an average of over 98% backdoor samples bypassing three state-of-the-art detection mechanisms. The code is available at https://github.com/Robin-WZQ/IBA.


IBA: Towards Irreversible Backdoor Attacks in Federated Learning

Neural Information Processing Systems

Federated learning (FL) is a distributed learning approach that enables machine learning models to be trained on decentralized data without compromising end devices' personal, potentially sensitive data. However, the distributed nature and uninvestigated data intuitively introduce new security vulnerabilities, including backdoor attacks. In this scenario, an adversary implants backdoor functionality into the global model during training, which can be activated to cause the desired misbehaviors for any input with a specific adversarial pattern. Despite having remarkable success in triggering and distorting model behavior, prior backdoor attacks in FL often hold impractical assumptions, limited imperceptibility, and durability. Specifically, the adversary needs to control a sufficiently large fraction of clients or know the data distribution of other honest clients.


AI may replace a third of graduate jobs: Study

#artificialintelligence

LONDON • Machines or software may eventually replace a third of graduate-level jobs worldwide, with legal frameworks for regulating employment and safety becoming rapidly outdated, says a new report by the International Bar Association (IBA), a global forum for the legal profession set up in 1947. The innovation in artificial intelligence (AI) and robotics could force governments to order quotas of human workers, upend traditional working practices and pose new dilemmas for insuring driverless cars, says the report, released this week. The IBA's survey found that the previous manufacturing model of poorer, emerging economies having a competitive advantage due to cheaper workforces will soon be eroded by robot production lines and intelligent computer systems. To illustrate, a German car worker costs more than £40 (S$70) an hour, but a robot costs only between £5 and £8 an hour. "A production robot is thus cheaper than a worker in China," the report notes.