Africa
Pentagon Combines Sea Drones, AI to Police Gulf Region
Iran's recent seizure of unmanned US Navy boats shined a light on a pioneering Pentagon program to develop networks of air, surface, and underwater drones for patrolling large regions, meshing their surveillance with artificial intelligence. The year-old program operates numerous unmanned surface vessels, or USVs, in the waters around the Arabian peninsula, gathering data and images to be beamed back to collection centers in the Gulf. The program operated without incident until Iranian forces tried to grab three seven-meter Saildrone Explorer USVs in two incidents, on August 29-30 and September 1. In the first, a ship of Iran's Islamic Revolutionary Guard Corps hooked a line to a Saildrone in the Gulf and began towing it away, only releasing it when a US Navy Patrol boat and helicopter sped to the scene. In the second, an Iranian destroyer picked up two Saildrones in the Red Sea, hoisting them aboard.
We need to think bigger about AI and Art
Whether you're on the'AI art is art' camp or the other, this is a tool that will forever change the creative industry for better or worse, and it has arrived. If you're fortunate enough to not know anything about this technology, a number of machine learning / AI research labs have created AI systems that allow computers to generate images. These tools are mostly experimental and nothing close to being able to create what humans can create -- until now. It's something that the digital art field has paid close attention to and is going to change art in ways we could never expect. From abstract art, digital painting, complex sculpture, architectural visualisation or 5 years old hand drawing, whatever you ask for, the AI makes it, or at least tries its best to.
The US doesn't know where its critical minerals are. AI could help find them.
The energy transition requires critical minerals. Though the U.S. has plentiful resources of its own, the country has largely relied on foreign sources. That's in part because one major roadblock to accessing American critical mineral deposits is that they remain largely unmapped. That may be about to change, though. The Department of Defense and the U.S. Geological Survey have issued two separate challenges to explore using artificial intelligence and machine learning to expedite USGS' task of assessing the availability and mining potential of 50 critical minerals.
Model-based Reinforcement Learning with Multi-step Plan Value Estimation
Lin, Haoxin, Sun, Yihao, Zhang, Jiaji, Yu, Yang
A promising way to improve the sample efficiency of reinforcement learning is model-based methods, in which many explorations and evaluations can happen in the learned models to save real-world samples. However, when the learned model has a non-negligible model error, sequential steps in the model are hard to be accurately evaluated, limiting the model's utilization. This paper proposes to alleviate this issue by introducing multi-step plans to replace multi-step actions for model-based RL. We employ the multi-step plan value estimation, which evaluates the expected discounted return after executing a sequence of action plans at a given state, and updates the policy by directly computing the multi-step policy gradient via plan value estimation. The new model-based reinforcement learning algorithm MPPVE (Model-based Planning Policy Learning with Multi-step Plan Value Estimation) shows a better utilization of the learned model and achieves a better sample efficiency than state-of-the-art model-based RL approaches.
Semantic-Preserving Adversarial Code Comprehension
Li, Yiyang, Wu, Hongqiu, Zhao, Hai
Based on the tremendous success of pre-trained language models (PrLMs) for source code comprehension tasks, current literature studies either ways to further improve the performance (generalization) of PrLMs, or their robustness against adversarial attacks. However, they have to compromise on the trade-off between the two aspects and none of them consider improving both sides in an effective and practical way. To fill this gap, we propose Semantic-Preserving Adversarial Code Embeddings (SPACE) to find the worst-case semantic-preserving attacks while forcing the model to predict the correct labels under these worst cases. Experiments and analysis demonstrate that SPACE can stay robust against state-of-the-art attacks while boosting the performance of PrLMs for code.
A Temporal Graphlet Kernel for Classifying Dissemination in Evolving Networks
Oettershagen, Lutz, Kriege, Nils M., Jordan, Claude, Mutzel, Petra
We introduce the \emph{temporal graphlet kernel} for classifying dissemination processes in labeled temporal graphs. Such dissemination processes can be spreading (fake) news, infectious diseases, or computer viruses in dynamic networks. The networks are modeled as labeled temporal graphs, in which the edges exist at specific points in time, and node labels change over time. The classification problem asks to discriminate dissemination processes of different origins or parameters, e.g., infectious diseases with different infection probabilities. Our new kernel represents labeled temporal graphs in the feature space of temporal graphlets, i.e., small subgraphs distinguished by their structure, time-dependent node labels, and chronological order of edges. We introduce variants of our kernel based on classes of graphlets that are efficiently countable. For the case of temporal wedges, we propose a highly efficient approximative kernel with low error in expectation. We show that our kernels are faster to compute and provide better accuracy than state-of-the-art methods.
Personalized Federated Learning with Communication Compression
Bergou, El Houcine, Burlachenko, Konstantin, Dutta, Aritra, Richtárik, Peter
In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn a single global model for all participating devices, which may not be helpful to all devices participating in the training due to the heterogeneity of the data across the devices. Recently, Hanzely and Richt\'{a}rik (2020) proposed a new formulation for training personalized FL models aimed at balancing the trade-off between the traditional global model and the local models that could be trained by individual devices using their private data only. They derived a new algorithm, called Loopless Gradient Descent (L2GD), to solve it and showed that this algorithms leads to improved communication complexity guarantees in regimes when more personalization is required. In this paper, we equip their L2GD algorithm with a bidirectional compression mechanism to further reduce the communication bottleneck between the local devices and the server. Unlike other compression-based algorithms used in the FL-setting, our compressed L2GD algorithm operates on a probabilistic communication protocol, where communication does not happen on a fixed schedule. Moreover, our compressed L2GD algorithm maintains a similar convergence rate as vanilla SGD without compression. To empirically validate the efficiency of our algorithm, we perform diverse numerical experiments on both convex and non-convex problems and using various compression techniques.
Intrusion Detection Systems Using Support Vector Machines on the KDDCUP'99 and NSL-KDD Datasets: A Comprehensive Survey
Ngueajio, Mikel K., Washington, Gloria, Rawat, Danda B., Ngueabou, Yolande
With the growing rates of cyber-attacks and cyber espionage, the need for better and more powerful intrusion detection systems (IDS) is even more warranted nowadays. The basic task of an IDS is to act as the first line of defense, in detecting attacks on the internet. As intrusion tactics from intruders become more sophisticated and difficult to detect, researchers have started to apply novel Machine Learning (ML) techniques to effectively detect intruders and hence preserve internet users' information and overall trust in the entire internet network security. Over the last decade, there has been an explosion of research on intrusion detection techniques based on ML and Deep Learning (DL) architectures on various cyber security-based datasets such as the DARPA, KDDCUP'99, NSL-KDD, CAIDA, CTU-13, UNSW-NB15. In this research, we review contemporary literature and provide a comprehensive survey of different types of intrusion detection technique that applies Support Vector Machines (SVMs) algorithms as a classifier. We focus only on studies that have been evaluated on the two most widely used datasets in cybersecurity namely: the KDDCUP'99 and the NSL-KDD datasets. We provide a summary of each method, identifying the role of the SVMs classifier, and all other algorithms involved in the studies. Furthermore, we present a critical review of each method, in tabular form, highlighting the performances measures, strengths, and limitations, of each of the methods surveyed.
Reproducibility in machine learning for medical imaging
Colliot, Olivier, Thibeau-Sutre, Elina, Burgos, Ninon
Reproducibility is a cornerstone of science, as the replication of findings is the process through which they become knowledge. It is widely considered that many fields of science are undergoing a reproducibility crisis. This has led to the publications of various guidelines in order to improve research reproducibility. This didactic chapter intends at being an introduction to reproducibility for researchers in the field of machine learning for medical imaging. We first distinguish between different types of reproducibility. For each of them, we aim at defining it, at describing the requirements to achieve it and at discussing its utility. The chapter ends with a discussion on the benefits of reproducibility and with a plea for a non-dogmatic approach to this concept and its implementation in research practice.
Ordinal Graph Gamma Belief Network for Social Recommender Systems
Wang, Dongsheng, Wang, Chaojie, Chen, Bo, Zhou, Mingyuan
To build recommender systems that not only consider user-item interactions represented as ordinal variables, but also exploit the social network describing the relationships between the users, we develop a hierarchical Bayesian model termed ordinal graph factor analysis (OGFA), which jointly models user-item and user-user interactions. OGFA not only achieves good recommendation performance, but also extracts interpretable latent factors corresponding to representative user preferences. We further extend OGFA to ordinal graph gamma belief network, which is a multi-stochastic-layer deep probabilistic model that captures the user preferences and social communities at multiple semantic levels. For efficient inference, we develop a parallel hybrid Gibbs-EM algorithm, which exploits the sparsity of the graphs and is scalable to large datasets. Our experimental results show that the proposed models not only outperform recent baselines on recommendation datasets with explicit or implicit feedback, but also provide interpretable latent representations.