Oceania
Gradient Routing: Masking Gradients to Localize Computation in Neural Networks
Cloud, Alex, Goldman-Wetzler, Jacob, Wybitul, Evžen, Miller, Joseph, Turner, Alexander Matt
Neural networks are trained primarily based on their inputs and outputs, without regard for their internal mechanisms. These neglected mechanisms determine properties that are critical for safety, like (i) transparency; (ii) the absence of sensitive information or harmful capabilities; and (iii) reliable generalization of goals beyond the training distribution. To address this shortcoming, we introduce gradient routing, a training method that isolates capabilities to specific subregions of a neural network. Gradient routing applies data-dependent, weighted masks to gradients during backpropagation. These masks are supplied by the user in order to configure which parameters are updated by which data points. We show that gradient routing can be used to (1) learn representations which are partitioned in an interpretable way; (2) enable robust unlearning via ablation of a pre-specified network subregion; and (3) achieve scalable oversight of a reinforcement learner by localizing modules responsible for different behaviors. Throughout, we find that gradient routing localizes capabilities even when applied to a limited, ad-hoc subset of the data. We conclude that the approach holds promise for challenging, real-world applications where quality data are scarce.
FLARE: Towards Universal Dataset Purification against Backdoor Attacks
Hou, Linshan, Luo, Wei, Hua, Zhongyun, Chen, Songhua, Zhang, Leo Yu, Li, Yiming
Deep neural networks (DNNs) are susceptible to backdoor attacks, where adversaries poison datasets with adversary-specified triggers to implant hidden backdoors, enabling malicious manipulation of model predictions. Dataset purification serves as a proactive defense by removing malicious training samples to prevent backdoor injection at its source. We first reveal that the current advanced purification methods rely on a latent assumption that the backdoor connections between triggers and target labels in backdoor attacks are simpler to learn than the benign features. We demonstrate that this assumption, however, does not always hold, especially in all-to-all (A2A) and untargeted (UT) attacks. As a result, purification methods that analyze the separation between the poisoned and benign samples in the input-output space or the final hidden layer space are less effective. We observe that this separability is not confined to a single layer but varies across different hidden layers. Motivated by this understanding, we propose FLARE, a universal purification method to counter various backdoor attacks. FLARE aggregates abnormal activations from all hidden layers to construct representations for clustering. To enhance separation, FLARE develops an adaptive subspace selection algorithm to isolate the optimal space for dividing an entire dataset into two clusters. FLARE assesses the stability of each cluster and identifies the cluster with higher stability as poisoned. Extensive evaluations on benchmark datasets demonstrate the effectiveness of FLARE against 22 representative backdoor attacks, including all-to-one (A2O), all-to-all (A2A), and untargeted (UT) attacks, and its robustness to adaptive attacks.
TEAM: Topological Evolution-aware Framework for Traffic Forecasting--Extended Version
Kieu, Duc, Kieu, Tung, Han, Peng, Yang, Bin, Jensen, Christian S., Le, Bac
Due to the global trend towards urbanization, people increasingly move to and live in cities that then continue to grow. Traffic forecasting plays an important role in the intelligent transportation systems of cities as well as in spatio-temporal data mining. State-of-the-art forecasting is achieved by deep-learning approaches due to their ability to contend with complex spatio-temporal dynamics. However, existing methods assume the input is fixed-topology road networks and static traffic time series. These assumptions fail to align with urbanization, where time series are collected continuously and road networks evolve over time. In such settings, deep-learning models require frequent re-initialization and re-training, imposing high computational costs. To enable much more efficient training without jeopardizing model accuracy, we propose the Topological Evolution-aware Framework (TEAM) for traffic forecasting that incorporates convolution and attention. This combination of mechanisms enables better adaptation to newly collected time series, while being able to maintain learned knowledge from old time series. TEAM features a continual learning module based on the Wasserstein metric that acts as a buffer that can identify the most stable and the most changing network nodes. Then, only data related to stable nodes is employed for re-training when consolidating a model. Further, only data of new nodes and their adjacent nodes as well as data pertaining to changing nodes are used to re-train the model. Empirical studies with two real-world traffic datasets offer evidence that TEAM is capable of much lower re-training costs than existing methods are, without jeopardizing forecasting accuracy.
101 Best Early Black Friday Deals of 2024 to Shop on Thanksgiving
It's Thanksgiving Day which means the big holiday--Black Friday, of course--is just one day away. In the next few hours retailers will be slashing prices to kick off the holiday shopping season and clear out their 2024 stock. You don't have to wait to carve the Thanksgiving turkey and watch the Cowboys lose to snag discounts, because we've spotted the best early Black Friday deals. The WIRED team has decades of experience in product testing and a nose for sniffing out the best deals using a suite of price-tracking tools, including our proprietary tracker which pulls discounts on the products we've tested and reviewed throughout the year. For Black Friday, we cross-reference our buying guide recommendations with the latest sale prices to find the best early Black Friday deals on gadgets and gizmos worth owning. Someone from the WIRED Reviews team has tested every product we include in our deals coverage, so you can rest easy knowing we won't highlight low prices on low-quality goods.
Use robots instead of hiring low-paid migrants, says shadow home secretary
Businesses should be using more robots instead of hiring low-paid migrants, the shadow home secretary has said. The Conservative MP Chris Philp says other countries "use a lot more automation" for tasks such as picking fruit and vegetables "rather than simply importing a lot of low-wage migrant labour". Speaking on BBC Breakfast, he called for more investment in technology to reduce the UK's net migration figures. Philp said: "To give an example, in Australia and New Zealand, they are rolling out robotic and automated fruit- and vegetable-picking equipment, in South Korea they use nine times the number of robots in manufacturing processes compared to us, in America they use a lot more modular construction which is much faster and much more efficient. "There's a lot of things British industry can do to grow without needing to import large numbers of low-wage migrants." At an impromptu press conference on Wednesday, Kemi Badenoch, the Conservative leader, said her party had got it wrong on immigration. She promised a review of "every policy, treaty and part of our legal framework" including the role of the European convention on human rights (ECHR) and the Human Rights Act. Get the day's headlines and highlights emailed direct to you every morning She said her party still believed in a "deterrent" to irregular migration but did not commit to restoring the Rwanda scheme scrapped by Labour, even though Philp called for it to be reinstated two weeks ago. He said on Thursday that Labour had "cancelled the Rwanda scheme before it even started". Philp was asked about reports that under the Conservatives, ministers had been examining using a giant wave machine to deter Channel crossings. He told the BBC: "I don't recall ever having seriously looked at that idea.
Third of NI adults visit porn sites, Ofcom finds
Third of NI adults visit porn sites, Ofcom finds Getty ImagesA new Ofcom report finds over 430,000 adults in Northern Ireland visited "pornographic content services" online in May 2024 Adults in Northern Ireland are more likely to look at pornography online than those in any other part of the UK. That is according to new research published by the communications regulator Ofcom. It said that more than 430,000 adults in Northern Ireland visited "pornographic content services" online in May 2024 - more than one third of the adult population. That was higher than the proportion of adults viewing similar content in Wales, Scotland and England. The figures come from Ofcom's Online Nation report for 2024, which looks into the UK's digital habits.
Knowledge-Augmented Explainable and Interpretable Learning for Anomaly Detection and Diagnosis
Atzmueller, Martin, Bohne, Tim, Windler, Patricia
Knowledge-augmented learning enables the combination of knowledge-based and data-driven approaches. For anomaly detection and diagnosis, understandability is typically an important factor, especially in high-risk areas. Therefore, explainability and interpretability are also major criteria in such contexts. This chapter focuses on knowledge-augmented explainable and interpretable learning to enhance understandability, transparency and ultimately computational sensemaking. We exemplify different approaches and methods in the domains of anomaly detection and diagnosis - from comparatively simple interpretable methods towards more advanced neuro-symbolic approaches.
SOWing Information: Cultivating Contextual Coherence with MLLMs in Image Generation
Pei, Yuhan, Wang, Ruoyu, Yang, Yongqi, Zhu, Ye, Russakovsky, Olga, Wu, Yu
Originating from the diffusion phenomenon in physics, which describes the random movement and collisions of particles, diffusion generative models simulate a random walk in the data space along the denoising trajectory. This allows information to diffuse across regions, yielding harmonious outcomes. However, the chaotic and disordered nature of information diffusion in diffusion models often results in undesired interference between image regions, causing degraded detail preservation and contextual inconsistency. In this work, we address these challenges by reframing disordered diffusion as a powerful tool for text-vision-to-image generation (TV2I) tasks, achieving pixel-level condition fidelity while maintaining visual and semantic coherence throughout the image. We first introduce Cyclic One-Way Diffusion (COW), which provides an efficient unidirectional diffusion framework for precise information transfer while minimizing disruptive interference. Building on COW, we further propose Selective One-Way Diffusion (SOW), which utilizes Multimodal Large Language Models (MLLMs) to clarify the semantic and spatial relationships within the image. Based on these insights, SOW combines attention mechanisms to dynamically regulate the direction and intensity of diffusion according to contextual relationships. Extensive experiments demonstrate the untapped potential of controlled information diffusion, offering a path to more adaptive and versatile generative models in a learning-free manner.
Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graph
Zhang, Yutong, Chen, Lixing, Li, Shenghong, Cao, Nan, Shi, Yang, Ding, Jiaxin, Qu, Zhe, Zhou, Pan, Bai, Yang
Large language models (LLMs) have demonstrated exceptional performance across a wide variety of domains. Nonetheless, generalist LLMs continue to fall short in reasoning tasks necessitating specialized knowledge. Prior investigations into specialized LLMs focused on domain-specific training, which entails substantial efforts in domain data acquisition and model parameter fine-tuning. To address these challenges, this paper proposes the Way-to-Specialist (WTS) framework, which synergizes retrieval-augmented generation with knowledge graphs (KGs) to enhance the specialized capability of LLMs in the absence of specialized training. In distinction to existing paradigms that merely utilize external knowledge from general KGs or static domain KGs to prompt LLM for enhanced domain-specific reasoning, WTS proposes an innovative "LLM$\circlearrowright$KG" paradigm, which achieves bidirectional enhancement between specialized LLM and domain knowledge graph (DKG). The proposed paradigm encompasses two closely coupled components: the DKG-Augmented LLM and the LLM-Assisted DKG Evolution. The former retrieves question-relevant domain knowledge from DKG and uses it to prompt LLM to enhance the reasoning capability for domain-specific tasks; the latter leverages LLM to generate new domain knowledge from processed tasks and use it to evolve DKG. WTS closes the loop between DKG-Augmented LLM and LLM-Assisted DKG Evolution, enabling continuous improvement in the domain specialization as it progressively answers and learns from domain-specific questions. We validate the performance of WTS on 6 datasets spanning 5 domains. The experimental results show that WTS surpasses the previous SOTA in 4 specialized domains and achieves a maximum performance improvement of 11.3%.
SoGraB: A Visual Method for Soft Grasping Benchmarking and Evaluation
Greenland, Benjamin G., Pinskier, Josh, Wang, Xing, Nguyen, Daniel, Shi, Ge, Bandyopadhyay, Tirthankar, Chung, Jen Jen, Howard, David
Recent years have seen soft robotic grippers gain increasing attention due to their ability to robustly grasp soft and fragile objects. However, a commonly available standardised evaluation protocol has not yet been developed to assess the performance of varying soft robotic gripper designs. This work introduces a novel protocol, the Soft Grasping Benchmarking and Evaluation (SoGraB) method, to evaluate grasping quality, which quantifies object deformation by using the Density-Aware Chamfer Distance (DCD) between point clouds of soft objects before and after grasping. We validated our protocol in extensive experiments, which involved ranking three Fin-Ray gripper designs with a subset of the EGAD object dataset. The protocol appropriately ranked grippers based on object deformation information, validating the method's ability to select soft grippers for complex grasping tasks and benchmark them for comparison against future designs.