Government
Buffer-based Gradient Projection for Continual Federated Learning
Dai, Shenghong, Sohn, Jy-yong, Chen, Yicong, Alam, S M Iftekharul, Balakrishnan, Ravikumar, Banerjee, Suman, Himayat, Nageen, Lee, Kangwook
Continual Federated Learning (CFL) is essential for enabling real-world applications where multiple decentralized clients adaptively learn from continuous data streams. A significant challenge in CFL is mitigating catastrophic forgetting, where models lose previously acquired knowledge when learning new information. Existing approaches often face difficulties due to the constraints of device storage capacities and the heterogeneous nature of data distributions among clients. While some CFL algorithms have addressed these challenges, they frequently rely on unrealistic assumptions about the availability of task boundaries (i.e., knowing when new tasks begin). To address these limitations, we introduce Fed-A-GEM, a federated adaptation of the A-GEM method (Chaudhry et al., 2019), which employs a buffer-based gradient projection approach. Fed-A-GEM alleviates catastrophic forgetting by leveraging local buffer samples and aggregated buffer gradients, thus preserving knowledge across multiple clients. Our method is combined with existing CFL techniques, enhancing their performance in the CFL context. Our experiments on standard benchmarks show consistent performance improvements across diverse scenarios. For example, in a task-incremental learning scenario using the CIFAR-100 dataset, our method can increase the accuracy by up to 27%. Our code is available at https://github.com/shenghongdai/Fed-A-GEM.
Coverage Metrics for a Scenario Database for the Scenario-Based Assessment of Automated Driving Systems
de Gelder, Erwin, Buermann, Maren, Camp, Olaf Op den
Automated Driving Systems (ADSs) have the potential to make mobility services available and safe for all. A multi-pillar Safety Assessment Framework (SAF) has been proposed for the type-approval process of ADSs. The SAF requires that the test scenarios for the ADS adequately covers the Operational Design Domain (ODD) of the ADS. A common method for generating test scenarios involves basing them on scenarios identified and characterized from driving data. This work addresses two questions when collecting scenarios from driving data. First, do the collected scenarios cover all relevant aspects of the ADS' ODD? Second, do the collected scenarios cover all relevant aspects that are in the driving data, such that no potentially important situations are missed? This work proposes coverage metrics that provide a quantitative answer to these questions. The proposed coverage metrics are illustrated by means of an experiment in which over 200000 scenarios from 10 different scenario categories are collected from the HighD data set. The experiment demonstrates that a coverage of 100 % can be achieved under certain conditions, and it also identifies which data and scenarios could be added to enhance the coverage outcomes in case a 100 % coverage has not been achieved. Whereas this work presents metrics for the quantification of the coverage of driving data and the identified scenarios, this paper concludes with future research directions, including the quantification of the completeness of driving data and the identified scenarios.
LiveFC: A System for Live Fact-Checking of Audio Streams
The advances in the digital era have led to rapid dissemination of information. This has also aggravated the spread of misinformation and disinformation. This has potentially serious consequences, such as civil unrest. While fact-checking aims to combat this, manual fact-checking is cumbersome and not scalable. While automated fact-checking approaches exist, they do not operate in real-time and do not always account for spread of misinformation through different modalities. This is particularly important as proactive fact-checking on live streams in real-time can help people be informed of false narratives and prevent catastrophic consequences that may cause civil unrest. This is particularly relevant with the rapid dissemination of information through video on social media platforms or other streams like political rallies and debates. Hence, in this work we develop a platform named LiveFC, that can aid in fact-checking live audio streams in real-time. LiveFC has a user-friendly interface that displays the claims detected along with their veracity and evidence for live streams with associated speakers for claims from respective segments. The app can be accessed at http://livefc.factiverse.ai and a screen recording of the demo can be found at https://bit.ly/3WVAoIw.
Correlating Time Series with Interpretable Convolutional Kernels
Chen, Xinyu, Cai, HanQin, Liu, Fuqiang, Zhao, Jinhua
This study addresses the problem of convolutional kernel learning in univariate, multivariate, and multidimensional time series data, which is crucial for interpreting temporal patterns in time series and supporting downstream machine learning tasks. First, we propose formulating convolutional kernel learning for univariate time series as a sparse regression problem with a non-negative constraint, leveraging the properties of circular convolution and circulant matrices. Second, to generalize this approach to multivariate and multidimensional time series data, we use tensor computations, reformulating the convolutional kernel learning problem in the form of tensors. This is further converted into a standard sparse regression problem through vectorization and tensor unfolding operations. In the proposed methodology, the optimization problem is addressed using the existing non-negative subspace pursuit method, enabling the convolutional kernel to capture temporal correlations and patterns. To evaluate the proposed model, we apply it to several real-world time series datasets. On the multidimensional rideshare and taxi trip data from New York City and Chicago, the convolutional kernels reveal interpretable local correlations and cyclical patterns, such as weekly seasonality. In the context of multidimensional fluid flow data, both local and nonlocal correlations captured by the convolutional kernels can reinforce tensor factorization, leading to performance improvements in fluid flow reconstruction tasks. Thus, this study lays an insightful foundation for automatically learning convolutional kernels from time series data, with an emphasis on interpretability through sparsity and non-negativity constraints.
External Steering of Vine Robots via Magnetic Actuation
Kim, Nam Gyun, Greenidge, Nikita J., Davy, Joshua, Park, Shinwoo, Chandler, James H., Ryu, Jee-Hwan, Valdastri, Pietro
This paper explores the concept of external magnetic control for vine robots to enable their high curvature steering and navigation for use in endoluminal applications. Vine robots, inspired by natural growth and locomotion strategies, present unique shape adaptation capabilities that allow passive deformation around obstacles. However, without additional steering mechanisms, they lack the ability to actively select the desired direction of growth. The principles of magnetically steered growing robots are discussed, and experimental results showcase the effectiveness of the proposed magnetic actuation approach. We present a 25 mm diameter vine robot with integrated magnetic tip capsule, including 6 Degrees of Freedom (DOF) localization and camera and demonstrate a minimum bending radius of 3.85 cm with an internal pressure of 30 kPa. Furthermore, we evaluate the robot's ability to form tight curvature through complex navigation tasks, with magnetic actuation allowing for extended free-space navigation without buckling. The suspension of the magnetic tip was also validated using the 6 DOF localization system to ensure that the shear-free nature of vine robots was preserved. Additionally, by exploiting the magnetic wrench at the tip, we showcase preliminary results of vine retraction. The findings contribute to the development of controllable vine robots for endoluminal applications, providing high tip force and shear-free navigation.
Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning
Huang, Tiansheng, Bhattacharya, Gautam, Joshi, Pratik, Kimball, Josh, Liu, Ling
Safety aligned Large Language Models (LLMs) are vulnerable to harmful fine-tuning attacks \cite{qi2023fine}-- a few harmful data mixed in the fine-tuning dataset can break the LLMs's safety alignment. Existing mitigation strategies include alignment stage solutions \cite{huang2024vaccine, rosati2024representation} and fine-tuning stage solutions \cite{huang2024lazy,mukhoti2023fine}. However, our evaluation shows that both categories of defenses fail \textit{when some specific training hyper-parameters are chosen} -- a large learning rate or a large number of training epochs in the fine-tuning stage can easily invalidate the defense, which however, is necessary to guarantee finetune performance. To this end, we propose Antidote, a post-fine-tuning stage solution, which remains \textbf{\textit{agnostic to the training hyper-parameters in the fine-tuning stage}}. Antidote relies on the philosophy that by removing the harmful parameters, the harmful model can be recovered from the harmful behaviors, regardless of how those harmful parameters are formed in the fine-tuning stage. With this philosophy, we introduce a one-shot pruning stage after harmful fine-tuning to remove the harmful weights that are responsible for the generation of harmful content. Despite its embarrassing simplicity, empirical results show that Antidote can reduce harmful score while maintaining accuracy on downstream tasks.Our project page is at \url{https://huangtiansheng.github.io/Antidote_gh_page/}
From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range
Bolme, David S., Aykac, Deniz, Shivers, Ryan, Brogan, Joel, Barber, Nell, Zhang, Bob, Davies, Laura, Cornett, David III
This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.
Russia says it intercepted more than 150 Ukrainian drones in 'massive' raid
Russia says it has stopped a "massive" Ukrainian air attack by downing at least 158 drones in 15 regions, including two over Russia's capital Moscow. The Russian defence ministry on Sunday said 46 of the drones were shot over the Kursk region, where Ukraine has sent its forces in recent weeks in the largest incursion on Russian soil since World War II. A further 34 drones were shot down over the Bryansk region, 28 over the Voronezh region, and 14 over the Belgorod region – all of which border Ukraine, the ministry said, adding that a total of 15 Russian regions were hit. Moscow's Mayor Sergei Sobyanin on Sunday said falling debris from one of the two drones shot down over the city caused a fire at an oil refinery. Also in Russia, Belgorod Governor Vyacheslav Gladkov said nine people were wounded in Ukrainian aerial missile attacks in the Russian border region.
Fires at Russian energy plants after Ukraine drone attacks
In Ukraine, a 23-year-old lorry driver was killed after a Russian air strike on a grain convoy in the Sumy region overnight, local officials have said. Prosecutors said four others were injured in the attack after one lorry caught fire and around 20 others were damaged. Ukraine's air force also said it had destroyed eight out of 11 drones used by Russia, adding that grain and agriculture facilities had been targeted in the Mykolaiv region as well. Sumy borders Russia's Kursk region, where Ukraine has been carrying out a military incursion for nearly a month. Progress has slowed in recent days, but Ukraine claimed last week it controlled 1,294 sq km (500 sq miles) of territory - including 100 settlements.
Tony Blair: 'I would have stayed if I could, is the truth'
Were you to board an aeroplane piloted by a man who has never previously sat in a cockpit, you'd be alarmed. Were you to face surgery by a woman with no medical qualifications, you'd be frightened. Politics is the one profession that can put someone in a position of great power and responsibility without any prior experience or demonstration of ability. "It's bizarre," Tony Blair says. "In any other walk of life, that doesn't happen." When he became prime minister in 1997 he was in his early forties and an absolute neophyte at governing. He was much better at it, he believes, towards the end of his decade at No 10 than at the outset. So he's written a book about the dos and the don'ts of leadership "because government is a science as well as an art". In the first flush of taking power, leaders "listen eagerly" because they grasp that they know little or nothing about governing.