Government
AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributions
Accurately modeling complex, multimodal distributions is necessary for optimal decision-making, but doing so for rotations in three-dimensions, i.e., the SO(3) group, is challenging due to the curvature of the rotation manifold. The recently described implicit-PDF (IPDF) is a simple, elegant, and effective approach for learning arbitrary distributions on SO(3) up to a given precision. However, inference with IPDF requires $N$ forward passes through the network's final multilayer perceptron (where $N$ places an upper bound on the likelihood that can be calculated by the model), which is prohibitively slow for those without the computational resources necessary to parallelize the queries. In this paper, I introduce AQuaMaM, a neural network capable of both learning complex distributions on the rotation manifold and calculating exact likelihoods for query rotations in a single forward pass. Specifically, AQuaMaM autoregressively models the projected components of unit quaternions as mixtures of uniform distributions that partition their geometrically-restricted domain of values. When trained on an "infinite" toy dataset with ambiguous viewpoints, AQuaMaM rapidly converges to a sampling distribution closely matching the true data distribution. In contrast, the sampling distribution for IPDF dramatically diverges from the true data distribution, despite IPDF approaching its theoretical minimum evaluation loss during training. When trained on a constructed dataset of 500,000 renders of a die in different rotations, AQuaMaM reaches a test log-likelihood 14% higher than IPDF. Further, compared to IPDF, AQuaMaM uses 24% fewer parameters, has a prediction throughput 52$\times$ faster on a single GPU, and converges in a similar amount of time during training.
SamBaS: Sampling-Based Stochastic Block Partitioning
Wanye, Frank, Gleyzer, Vitaliy, Kao, Edward, Feng, Wu-chun
Community detection is a well-studied problem with applications in domains ranging from networking to bioinformatics. Due to the rapid growth in the volume of real-world data, there is growing interest in accelerating contemporary community detection algorithms. However, the more accurate and statistically robust methods tend to be hard to parallelize. One such method is stochastic block partitioning (SBP) - a community detection algorithm that works well on graphs with complex and heterogeneous community structure. In this paper, we present a sampling-based SBP (SamBaS) for accelerating SBP on sparse graphs. We characterize how various graph parameters affect the speedup and result quality of community detection with SamBaS and quantify the trade-offs therein. To evaluate SamBas on real-world web graphs without known ground-truth communities, we introduce partition quality score (PQS), an evaluation metric that outperforms modularity in terms of correlation with F1 score. Overall, SamBaS achieves speedups of up to 10X while maintaining result quality (and even improving result quality by over 150% on certain graphs, relative to F1 score).
DECISIVE Benchmarking Data Report: sUAS Performance Results from Phase I
Norton, Adam, Ahmadzadeh, Reza, Jerath, Kshitij, Robinette, Paul, Weitzen, Jay, Wickramarathne, Thanuka, Yanco, Holly, Choi, Minseop, Donald, Ryan, Donoghue, Brendan, Dumas, Christian, Gavriel, Peter, Giedraitis, Alden, Hertel, Brendan, Houle, Jack, Letteri, Nathan, Meriaux, Edwin, Khavas, Zahra Rezaei, Singh, Rakshith, Willcox, Gregg, Yoni, Naye
This report reviews all results derived from performance benchmarking conducted during Phase I of the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell, using the test methods specified in the DECISIVE Test Methods Handbook v1.1 for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, mapping, autonomy, trust, and situation awareness. Using those 20 test methods, over 230 tests were conducted across 8 sUAS platforms: Cleo Robotics Dronut X1P (P = prototype), FLIR Black Hornet PRS, Flyability Elios 2 GOV, Lumenier Nighthawk V3, Parrot ANAFI USA GOV, Skydio X2D, Teal Golden Eagle, and Vantage Robotics Vesper. Best in class criteria is specified for each applicable test method and the sUAS that match this criteria are named for each test method, including a high-level executive summary of their performance.
DoubleH: Twitter User Stance Detection via Bipartite Graph Neural Networks
Zhang, Chong, Zhou, Zhenkun, Peng, Xingyu, Xu, Ke
Given the development and abundance of social media, studying the stance of social media users is a challenging and pressing issue. Social media users express their stance by posting tweets and retweeting. Therefore, the homogeneous relationship between users and the heterogeneous relationship between users and tweets are relevant for the stance detection task. Recently, graph neural networks (GNNs) have developed rapidly and have been applied to social media research. In this paper, we crawl a large-scale dataset of the 2020 US presidential election and automatically label all users by manually tagged hashtags. Subsequently, we propose a bipartite graph neural network model, DoubleH, which aims to better utilize homogeneous and heterogeneous information in user stance detection tasks. Specifically, we first construct a bipartite graph based on posting and retweeting relations for two kinds of nodes, including users and tweets. We then iteratively update the node's representation by extracting and separately processing heterogeneous and homogeneous information in the node's neighbors. Finally, the representations of user nodes are used for user stance classification. Experimental results show that DoubleH outperforms the state-of-the-art methods on popular benchmarks. Further analysis illustrates the model's utilization of information and demonstrates stability and efficiency at different numbers of layers.
DECISIVE Test Methods Handbook: Test Methods for Evaluating sUAS in Subterranean and Constrained Indoor Environments, Version 1.1
Norton, Adam, Ahmadzadeh, Reza, Jerath, Kshitij, Robinette, Paul, Weitzen, Jay, Wickramarathne, Thanuka, Yanco, Holly, Choi, Minseop, Donald, Ryan, Donoghue, Brendan, Dumas, Christian, Gavriel, Peter, Giedraitis, Alden, Hertel, Brendan, Houle, Jack, Letteri, Nathan, Meriaux, Edwin, Khavas, Zahra Rezaei, Singh, Rakshith, Willcox, Gregg, Yoni, Naye
This handbook outlines all test methods developed under the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, mapping, autonomy, trust, and situation awareness. For sUAS deployment in subterranean and constrained indoor environments, this puts forth two assumptions about applicable sUAS to be evaluated using these test methods: (1) able to operate without access to GPS signal, and (2) width from prop top to prop tip does not exceed 91 cm (36 in) wide (i.e., can physically fit through a typical doorway, although successful navigation through is not guaranteed). All test methods are specified using a common format: Purpose, Summary of Test Method, Apparatus and Artifacts, Equipment, Metrics, Procedure, and Example Data. All test methods are designed to be run in real-world environments (e.g., MOUT sites) or using fabricated apparatuses (e.g., test bays built from wood, or contained inside of one or more shipping containers).
Transforming Unstructured Text into Data with Context Rule Assisted Machine Learning (CRAML)
Meisenbacher, Stephen, Norlander, Peter
We describe a method and new no-code software tools enabling domain experts to build custom structured, labeled datasets from the unstructured text of documents and build niche machine learning text classification models traceable to expert-written rules. The Context Rule Assisted Machine Learning (CRAML) method allows accurate and reproducible labeling of massive volumes of unstructured text. CRAML enables domain experts to access uncommon constructs buried within a document corpus, and avoids limitations of current computational approaches that often lack context, transparency, and interpetability. In this research methods paper, we present three use cases for CRAML: we analyze recent management literature that draws from text data, describe and release new machine learning models from an analysis of proprietary job advertisement text, and present findings of social and economic interest from a public corpus of franchise documents. CRAML produces document-level coded tabular datasets that can be used for quantitative academic research, and allows qualitative researchers to scale niche classification schemes over massive text data. CRAML is a low-resource, flexible, and scalable methodology for building training data for supervised ML. We make available as open-source resources: the software, job advertisement text classifiers, a novel corpus of franchise documents, and a fully replicable start-to-finish trained example in the context of no poach clauses.
Thales and NukkAI Partner to Develop Solution for Military Applications - Defense Advancement
French artificial intelligence start-up NukkAI has signed a contract with Thales to develop an AI-based data fusion solution for military applications. Thales believes military analysts in operations centers face significant challenges in extracting relevant information from the huge volumes of data generated by multiple sources such as video and audio streams, websites, Twitter feeds, satellite imagery, social media, and telephone conversations. According to Thales, real-time data analytics will enable them to develop advanced military strategies with greater efficiency. As a result, Thales is planning to implement NukkAI's solution in a number of its military data processing programs. When operators are swamped by information, the solution will use real-time data exploitation and fusion methods to automatically review the knowledge available so that analysts can focus on elements of interest.
Why a Social License is Needed for AI
If business wants to use AI at scale, adhering to the technical guidelines for responsible AI development isn't enough. It must obtain society's explicit approval to deploy the technology. Six years ago, in March 2016, Microsoft Corporation launched an experimental AI-based chatbot, TayTweets, whose Twitter handle was @TayandYou. Tay, an acronym for "thinking about you," mimicked a 19-year-old American girl online, so the digital giant could showcase the speed at which AI can learn when it interacts with human beings. Living up to its description as "AI with zero chill," Tay started off replying cheekily to Twitter users and turning photographs into memes. Some topics were off limits, though; Microsoft had trained Tay not to comment on societal issues such as Black Lives Matter. Soon enough, a group of Twitter users targeted Tay with a barrage of tweets about controversial issues such as the Holocaust and Gamergate. They goaded the chatbot into replying with racist and sexually charged responses, exploiting its repeat-after-me capability. Realizing that Tay was reacting like IBM's Watson, which started using profanity after perusing the online Urban Dictionary, Microsoft was quick to delete the first inflammatory tweets. Less than 16 hours and more than 100,000 tweets later, the digital giant shut down Tay.
Al Gore explains global AI program that is spying on thousands of facilities to monitor emissions
Former Vice President Al Gore on Thursday outlined a global effort run by "machine-learning" artificial intelligence is essentially spying on individual facilities in every country in the world to measure their emissions of greenhouse gases and target the world's largest emitters. At the World Economic Forum in Davos, Switzerland, Gore formally introduced attendees to the initiative known as Climate Tracking Real-Time Atmospheric Carbon Emissions, or Climate TRACE. The initiative has led to a website that allows for real-time tracking of emissions in any area of the world, which Gore said is allowing climate activists, reporters and others to identify high-priority industries and regions for emissions reduction programs. "It's a non-profit coalition that uses artificial intelligence to process data from 300 existing satellites and from 30,000 land, sea and air base sensors and multiple internet data streams to use artificial intelligence to create machine-learning algorithms to zoom in on every single significant source of greenhouse gas (GHG) pollution," he said of Climate TRACE. Gore showed how Climate TRACE uses these inputs to zoom in on specific facilities and assess how much they contribute to GHG emissions.