Government
Characterizing 4-string contact interaction using machine learning
Erbin, Harold, Fırat, Atakan Hilmi
The geometry of 4-string contact interaction of closed string field theory is characterized using machine learning. We obtain Strebel quadratic differentials on 4-punctured spheres as a neural network by performing unsupervised learning with a custom-built loss function. This allows us to solve for local coordinates and compute their associated mapping radii numerically. We also train a neural network distinguishing vertex from Feynman region. As a check, 4-tachyon contact term in the tachyon potential is computed and a good agreement with the results in the literature is observed. We argue that our algorithm is manifestly independent of number of punctures and scaling it to characterize the geometry of $n$-string contact interaction is feasible.
Advanced Situational Graphs for Robot Navigation in Structured Indoor Environments
Bavle, Hriday, Sanchez-Lopez, Jose Luis, Shaheer, Muhammad, Civera, Javier, Voos, Holger
Mobile robots extract information from its environment to understand their current situation to enable intelligent decision making and autonomous task execution. In our previous work, we introduced the concept of Situation Graphs (S-Graphs) which combines in a single optimizable graph, the robot keyframes and the representation of the environment with geometric, semantic and topological abstractions. Although S-Graphs were built and optimized in real-time and demonstrated state-of-the-art results, they are limited to specific structured environments with specific hand-tuned dimensions of rooms and corridors. In this work, we present an advanced version of the Situational Graphs (S-Graphs+), consisting of the five layered optimizable graph that includes (1) metric layer along with the graph of free-space clusters (2) keyframe layer where the robot poses are registered (3) metric-semantic layer consisting of the extracted planar walls (4) novel rooms layer constraining the extracted planar walls (5) novel floors layer encompassing the rooms within a given floor level. S-Graphs+ demonstrates improved performance over S-Graphs efficiently extracting the room information while simultaneously improving the pose estimate of the robot, thus extending the robots situational awareness in the form of a five layered environmental model.
Quark: Controllable Text Generation with Reinforced Unlearning
Lu, Ximing, Welleck, Sean, Hessel, Jack, Jiang, Liwei, Qin, Lianhui, West, Peter, Ammanabrolu, Prithviraj, Choi, Yejin
Large-scale language models often learn behaviors that are misaligned with user expectations. Generated text may contain offensive or toxic language, contain significant repetition, or be of a different sentiment than desired by the user. We consider the task of unlearning these misalignments by fine-tuning the language model on signals of what not to do. We introduce Quantized Reward Konditioning (Quark), an algorithm for optimizing a reward function that quantifies an (un)wanted property, while not straying too far from the original model. Quark alternates between (i) collecting samples with the current language model, (ii) sorting them into quantiles based on reward, with each quantile identified by a reward token prepended to the language model's input, and (iii) using a standard language modeling loss on samples from each quantile conditioned on its reward token, while remaining nearby the original language model via a KL-divergence penalty. By conditioning on a high-reward token at generation time, the model generates text that exhibits less of the unwanted property. For unlearning toxicity, negative sentiment, and repetition, our experiments show that Quark outperforms both strong baselines and state-of-the-art reinforcement learning methods like PPO (Schulman et al. 2017), while relying only on standard language modeling primitives.
Autoregressive Structured Prediction with Language Models
Liu, Tianyu, Jiang, Yuchen, Monath, Nicholas, Cotterell, Ryan, Sachan, Mrinmaya
Recent years have seen a paradigm shift in NLP towards using pretrained language models ({PLM}) for a wide range of tasks. However, there are many difficult design decisions to represent structures (e.g. tagged text, coreference chains) in a way such that they can be captured by PLMs. Prior work on structured prediction with PLMs typically flattens the structured output into a sequence, which limits the quality of structural information being learned and leads to inferior performance compared to classic discriminative models. In this work, we describe an approach to model structures as sequences of actions in an autoregressive manner with PLMs, allowing in-structure dependencies to be learned without any loss. Our approach achieves the new state-of-the-art on all the structured prediction tasks we looked at, namely, named entity recognition, end-to-end relation extraction, and coreference resolution.
Cognitive Simplification Operations Improve Text Simplification
Text Simplification (TS) is the task of converting a text into a form that is easier to read while maintaining the meaning of the original text. A sub-task of TS is Cognitive Simplification (CS), converting text to a form that is readily understood by people with cognitive disabilities without rendering it childish or simplistic. This sub-task has yet to be explored with neural methods in NLP, and resources for it are scarcely available. In this paper, we present a method for incorporating knowledge from the cognitive accessibility domain into a TS model, by introducing an inductive bias regarding what simplification operations to use. We show that by adding this inductive bias to a TS-trained model, it is able to adapt better to CS without ever seeing CS data, and outperform a baseline model on a traditional TS benchmark. In addition, we provide a novel test dataset for CS, and analyze the differences between CS corpora and existing TS corpora, in terms of how simplification operations are applied.
Fairness and Randomness in Machine Learning: Statistical Independence and Relativization
Derr, Rabanus, Williamson, Robert C.
Fair Machine Learning endeavors to prevent unfairness arising in the context of machine learning applications embedded in society. Despite the variety of definitions of fairness and proposed "fair algorithms", there remain unresolved conceptual problems regarding fairness. In this paper, we dissect the role of statistical independence in fairness and randomness notions regularly used in machine learning. Thereby, we are led to a suprising hypothesis: randomness and fairness can be considered equivalent concepts in machine learning. In particular, we obtain a relativized notion of randomness expressed as statistical independence by appealing to Von Mises' century-old foundations for probability. This notion turns out to be "orthogonal" in an abstract sense to the commonly used i.i.d.-randomness. Using standard fairness notions in machine learning, which are defined via statistical independence, we then link the ex ante randomness assumptions about the data to the ex post requirements for fair predictions. This connection proves fruitful: we use it to argue that randomness and fairness are essentially relative and that both concepts should reflect their nature as modeling assumptions in machine learning.
Can Strategic Data Collection Improve the Performance of Poverty Prediction Models?
Soman, Satej, Aiken, Emily, Rolf, Esther, Blumenstock, Joshua
Machine learning-based estimates of poverty and wealth are increasingly being used to guide the targeting of humanitarian aid and the allocation of social assistance. However, the ground truth labels used to train these models are typically borrowed from existing surveys that were designed to produce national statistics -- not to train machine learning models. Here, we test whether adaptive sampling strategies for ground truth data collection can improve the performance of poverty prediction models. Through simulations, we compare the status quo sampling strategies (uniform at random and stratified random sampling) to alternatives that prioritize acquiring training data based on model uncertainty or model performance on sub-populations. Perhaps surprisingly, we find that none of these active learning methods improve over uniform-at-random sampling. We discuss how these results can help shape future efforts to refine machine learning-based estimates of poverty.
La veille de la cybersécurité
Nearly 75% of the world's largest companies have already integrated AI and machine learning (ML) into their business strategies. As more and more companies -- and their customers -- gain increasing value from ML applications, organizations should be considering new security best practices to keep pace with the evolving technology landscape. Companies that utilize dynamic or high-speed transactional data to build, train, or serve ML models today have an important opportunity to ensure their ML applications operate securely and as intended. A well-managed approach that takes into account a range of ML security considerations can detect, prevent, and mitigate potential threats while ensuring ML continues to deliver on its transformational potential. ML security has the same goal as all cybersecurity measures: reducing the risk of sensitive data being exposed.
Will The White House's Artificial Intelligence "Bill of Rights" Protect Consumers from Big-Tech's Advertising Abuses?
The Biden administration just released a document that they believe should define the standards for responsible use of one of the more critical technologies that is set to define the future – Artificial Intelligence (AI). The document, "The Blueprint for an AI Bill of Rights: Making Automated Systems Work for the American People," was released by the White House Office of Science and Technology Policy (WHOSTP). It lays out the five guiding principles that the WHOSTP feels should guide the "design, use, and deployment" of automated systems in order to protect Americans in the age of AI. The Blueprint emphasizes creating safe and effective AI systems, providing algorithmic discrimination protections, data privacy, clarified notice and explanations of how AI may be used, and providing alternative options for consumers that choose to opt out. This idea of governmental guidance in AI may seem innovative, but the truth is, at least 60 countries already have national AI protocols and the United States is merely playing catch-up at this point.
Why You Must Embrace Responsible AI Now
"What we're hearing from our friends and thought leaders in this space that pay close attention to the regulations is just behave as though you're under the European Union's AI Act guidelines, whether you're in Europe, America, or anywhere else," says Roetzer. Regulations like the AI Act will be used as a template by other governments soon. You can't avoid issues around responsible and ethical AI. Regulations will force you to act. Even if you're an AI beginner, you'll quickly run into ethical issues around data, how it's used, and who provides it. You need an AI ethics policy or guidelines.