Government
Genetic Programming Based Symbolic Regression for Analytical Solutions to Differential Equations
Oh, Hongsup, Amici, Roman, Bomarito, Geoffrey, Zhe, Shandian, Kirby, Robert, Hochhalter, Jacob
In this paper, we present a machine learning method for the discovery of analytic solutions to differential equations. The method utilizes an inherently interpretable algorithm, genetic programming based symbolic regression. Unlike conventional accuracy measures in machine learning we demonstrate the ability to recover true analytic solutions, as opposed to a numerical approximation. The method is verified by assessing its ability to recover known analytic solutions for two separate differential equations. The developed method is compared to a conventional, purely data-driven genetic programming based symbolic regression algorithm. The reliability of successful evolution of the true solution, or an algebraic equivalent, is demonstrated.
Concrete Safety for ML Problems: System Safety for ML Development and Assessment
Jatho, Edgar W., Mailloux, Logan O., Williams, Eugene D., McClure, Patrick, Kroll, Joshua A.
Many stakeholders struggle to make reliances on ML-driven systems due to the risk of harm these systems may cause. Concerns of trustworthiness, unintended social harms, and unacceptable social and ethical violations undermine the promise of ML advancements. Moreover, such risks in complex ML-driven systems present a special challenge as they are often difficult to foresee, arising over periods of time, across populations, and at scale. These risks often arise not from poor ML development decisions or low performance directly but rather emerge through the interactions amongst ML development choices, the context of model use, environmental factors, and the effects of a model on its target. Systems safety engineering is an established discipline with a proven track record of identifying and managing risks even in high-complexity sociotechnical systems. In this work, we apply a state-of-the-art systems safety approach to concrete applications of ML with notable social and ethical risks to demonstrate a systematic means for meeting the assurance requirements needed to argue for safe and trustworthy ML in sociotechnical systems.
Capturing Topic Framing via Masked Language Modeling
Guo, Xiaobo, Ma, Weicheng, Vosoughi, Soroush
Differential framing of issues can lead to divergent world views on important issues. This is especially true in domains where the information presented can reach a large audience, such as traditional and social media. Scalable and reliable measurement of such differential framing is an important first step in addressing them. In this work, based on the intuition that framing affects the tone and word choices in written language, we propose a framework for modeling the differential framing of issues through masked token prediction via large-scale fine-tuned language models (LMs). Specifically, we explore three key factors for our framework: 1) prompt generation methods for the masked token prediction; 2) methods for normalizing the output of fine-tuned LMs; 3) robustness to the choice of pre-trained LMs used for fine-tuning. Through experiments on a dataset of articles from traditional media outlets covering five diverse and politically polarized topics, we show that our framework can capture differential framing of these topics with high reliability.
Conditioning Predictive Models: Risks and Strategies
Hubinger, Evan, Jermyn, Adam, Treutlein, Johannes, Hudson, Rubi, Woolverton, Kate
Our intention is to provide a definitive reference on what it would take to safely make use of generative/predictive models in the absence of a solution to the Eliciting Latent Knowledge problem. Furthermore, we believe that large language models can be understood as such predictive models of the world, and that such a conceptualization raises significant opportunities for their safe yet powerful use via carefully conditioning them to predict desirable outputs. Unfortunately, such approaches also raise a variety of potentially fatal safety problems, particularly surrounding situations where predictive models predict the output of other AI systems, potentially unbeknownst to us. There are numerous potential solutions to such problems, however, primarily via carefully conditioning models to predict the things we want (e.g. humans) rather than the things we don't (e.g. malign AIs). Furthermore, due to the simplicity of the prediction objective, we believe that predictive models present the easiest inner alignment problem that we are aware of. As a result, we think that conditioning approaches for predictive models represent the safest known way of eliciting human-level and slightly superhuman capabilities from large language models and other similar future models.
MetaQA: Combining Expert Agents for Multi-Skill Question Answering
Puerto, Haritz, Şahin, Gözde Gül, Gurevych, Iryna
The recent explosion of question answering (QA) datasets and models has increased the interest in the generalization of models across multiple domains and formats by either training on multiple datasets or by combining multiple models. Despite the promising results of multi-dataset models, some domains or QA formats may require specific architectures, and thus the adaptability of these models might be limited. In addition, current approaches for combining models disregard cues such as question-answer compatibility. In this work, we propose to combine expert agents with a novel, flexible, and training-efficient architecture that considers questions, answer predictions, and answer-prediction confidence scores to select the best answer among a list of answer candidates. Through quantitative and qualitative experiments we show that our model i) creates a collaboration between agents that outperforms previous multi-agent and multi-dataset approaches in both in-domain and out-of-domain scenarios, ii) is highly data-efficient to train, and iii) can be adapted to any QA format. We release our code and a dataset of answer predictions from expert agents for 16 QA datasets to foster future developments of multi-agent systems on https://github.com/UKPLab/MetaQA.
Novel Building Detection and Location Intelligence Collection in Aerial Satellite Imagery
Singh, Sandeep, Wiles, Christian, Bilal, Ahmed
Building structures detection and information about these buildings in aerial images is an important solution for city planning and management, land use analysis. It can be the center piece to answer important questions such as planning evacuation routes in case of an earthquake, flood management, etc. These applications rely on being able to accurately retrieve up-to-date information. Being able to accurately detect buildings in a bounding box centered on a specific latitude-longitude value can help greatly. The key challenge is to be able to detect buildings which can be commercial, industrial, hut settlements, or skyscrapers. Once we are able to detect such buildings, our goal will be to cluster and categorize similar types of buildings together.
Sketching Robot Programs On the Fly
Porfirio, David, Stegner, Laura, Cakmak, Maya, Sauppé, Allison, Albarghouthi, Aws, Mutlu, Bilge
Service robots for personal use in the home and the workplace require end-user development solutions for swiftly scripting robot tasks as the need arises. Many existing solutions preserve ease, efficiency, and convenience through simple programming interfaces or by restricting task complexity. Others facilitate meticulous task design but often do so at the expense of simplicity and efficiency. There is a need for robot programming solutions that reconcile the complexity of robotics with the on-the-fly goals of end-user development. In response to this need, we present a novel, multimodal, and on-the-fly development system, Tabula. Inspired by a formative design study with a prototype, Tabula leverages a combination of spoken language for specifying the core of a robot task and sketching for contextualizing the core. The result is that developers can script partial, sloppy versions of robot programs to be completed and refined by a program synthesizer. Lastly, we demonstrate our anticipated use cases of Tabula via a set of application scenarios.
Adaptive Coverage Path Planning for Efficient Exploration of Unknown Environments
Bouman, Amanda, Ott, Joshua, Kim, Sung-Kyun, Chen, Kenny, Kochenderfer, Mykel J., Lopez, Brett, Agha-mohammadi, Ali-akbar, Burdick, Joel
We present a method for solving the coverage problem with the objective of autonomously exploring an unknown environment under mission time constraints. Here, the robot is tasked with planning a path over a horizon such that the accumulated area swept out by its sensor footprint is maximized. Because this problem exhibits a diminishing returns property known as submodularity, we choose to formulate it as a tree-based sequential decision making process. This formulation allows us to evaluate the effects of the robot's actions on future world coverage states, while simultaneously accounting for traversability risk and the dynamic constraints of the robot. To quickly find near-optimal solutions, we propose an effective approximation to the coverage sensor model which adapts to the local environment. Our method was extensively tested across various complex environments and served as the local exploration algorithm for a competing entry in the DARPA Subterranean Challenge.
Council Post: How AI Solutions Can Defend Against Cyberattacks G.R. Je
Gerasim Hovhannisyan, CEO and Co-Founder atEasyDMARC, a rapidly growing B2B SaaS to solve email security and deliverability problems. In part, because hybrid and remote workplaces are the new normal for most companies, the sophistication of cyberattacks and the risks they pose have grown rapidly over the last few years. In fact, these new work styles have opened up a whole new set of phishing methods for threat actors. According to Cybersecurity Ventures, global cybercrime is expected to grow by 15% per year over the next five years, costing about $10.5 billion by 2025. Even though hundreds of IT experts analyze threats daily, it is a daunting task.
Possible Failures of ChatGPT - EnterpriseTalk
Without a human-centric approach, OpenAI ChatGPT runs on the data available on the various channels, which can also deliver services without meeting the context requirements. Sometimes, it writes plausible-sounding content but can be trustworthy. The new kid on the block, AI-powered ChatGPT offers numerous exceptional services and is claimed to be useful for coding, content writing, etc., minimizing human intervention. As erudite machinery becomes a trending sensation, companies can also see AI biases, security risks, and less personalized CX. The uncapped accessibility, and unrestricted usage of ChatGPT have increased the cybersecurity risks that can hamper the whole organization. Through ChatGPT, cybercriminals can draft a fraudulent email carrying unsecured links, attachments providing sensitive data, or instructions regarding transferring money into specific accounts from a reputed company or person.