Agents
MTSI Opens Artificial Intelligence Tech Research Hub
Modern Technology Solutions Inc. has opened a laboratory in Huntsville, Ala., for research and development of artificial intelligence-based technology platforms for the military sector. MTSI said Friday it looks to accomplish a holistic approach to AI application through the new lab along with the company's engineering and data analytics processes. Willie Maddox, manager of AI Lab, said the company aims to apply deep reinforcement learning to address challenges related to multiagent dynamic route planning. Alexandria, Va.-based MTSI offers engineering and technology services to government customers in the missile defense, cybersecurity, intelligence, unmanned and autonomous systems, aviation, space and homeland security areas.
Machine Learning Enables Polymer Cloud-Point Engineering via Inverse Design
We demonstrate high-accuracy tuning of poly(2-oxazoline) cloud point via machine learning. With a design space of four repeating units and a range of molecular masses, we achieve an accuracy of 4 C root mean squared error (RMSE) in a temperature range of 24– 90 C, employing gradient boosting with decision trees. The RMSE is 3x better than linear and polynomial regression. We perform inverse design via particle-swarm optimization, predicting and synthesizing 17 polymers with constrained design at 4 target cloud points from 37 to 80 C. Our approach challenges the status quo in polymer design with a machine learning algorithm, that is capable of fast and systematic discovery of new polymers.
Improving Coordination in Multi-Agent Deep Reinforcement Learning through Memory-driven Communication
Pesce, Emanuele, Montana, Giovanni
Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced with a task requiring coordination and synchronisation skills, inter-agent communication plays an essential role. In this work, we propose a framework for multi-agent training using deep deterministic policy gradients that enables the concurrent, end-to-end learning of an explicit communication protocol through a memory device. During training, the agents learn to perform read and write operations enabling them to infer a shared representation of the world. We empirically demonstrate that concurrent learning of the communication device and individual policies can improve inter-agent coordination and performance, and illustrate how different communication patterns can emerge for different tasks.
Japan is Using Artificial Intelligence To Catch Criminals On The Run
The company collaborated with the University of Electro-Communications in Japan for the research, which they claim can rapidly generate a solution system for sealing off escape routes with police dispersal. It takes approximately five minutes. "Fujitsu Laboratories and the University of Electro-Communications have developed an algorithm to rapidly solve city-scale road network security problems. Compared with previous technology, this makes it possible to find the theoretically optimal security plan 20 times faster, on average, for a 100-node problem, and 500 times faster, on average, for a 200-node problem," Fujitsu says. The company plans to scale up by commercializing the technology through their Fujitsu Limited AI arm, Human Centric Al Zinrai (Zinrai), next year.
Cooperative event-based rigid formation control
Sun, Zhiyong, Liu, Qingchen, Huang, Na, Yu, Changbin, Anderson, Brian D. O.
This paper discusses cooperative stabilization control of rigid formations via an event-based approach. We first design a centralized event-based formation control system, in which a central event controller determines the next triggering time and broadcasts the event signal to all the agents for control input update. We then build on this approach to propose a distributed event control strategy, in which each agent can use its local event trigger and local information to update the control input at its own event time. For both cases, the triggering condition, event function and triggering behavior are discussed in detail, and the exponential convergence of the event-based formation system is guaranteed.
Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptions
Ehsan, Upol, Tambwekar, Pradyumna, Chan, Larry, Harrison, Brent, Riedl, Mark
Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on human explanation data can enable agents to learn to generate human-like explanations for their behavior. In this paper, using the context of an agent that plays Frogger, we describe (a) how to collect a corpus of explanations, (b) how to train a neural rationale generator to produce different styles of rationales, and (c) how people perceive these rationales. We conducted two user studies. The first study establishes the plausibility of each type of generated rationale and situates their user perceptions along the dimensions of confidence, humanlike-ness, adequate justification, and understandability. The second study further explores user preferences between the generated rationales with regard to confidence in the autonomous agent, communicating failure and unexpected behavior. Overall, we find alignment between the intended differences in features of the generated rationales and the perceived differences by users. Moreover, context permitting, participants preferred detailed rationales to form a stable mental model of the agent's behavior.
PFML-based Semantic BCI Agent for Game of Go Learning and Prediction
Lee, Chang-Shing, Wang, Mei-Hui, Ko, Li-Wei, Tsai, Bo-Yu, Tsai, Yi-Lin, Yang, Sheng-Chi, Lin, Lu-An, Lee, Yi-Hsiu, Ohashi, Hirofumi, Kubota, Naoyuki, Shuo, Nan
This paper presents a semantic brain computer interface (BCI) agent with particle swarm optimization (PSO) based on a Fuzzy Markup Language (FML) for Go learning and prediction applications. Additionally, we also establish an Open Go Darkforest (OGD) cloud platform with Facebook AI research (FAIR) open source Darkforest and ELF OpenGo AI bots. The Japanese robot Palro will simultaneously predict the move advantage in the board game Go to the Go players for reference or learning. The proposed semantic BCI agent operates efficiently by the human-based BCI data from their brain waves and machine-based game data from the prediction of the OGD cloud platform for optimizing the parameters between humans and machines. Experimental results show that the proposed human and smart machine co-learning mechanism performs favorably. We hope to provide students with a better online learning environment, combining different kinds of handheld devices, robots, or computer equipment, to achieve a desired and intellectual learning goal in the future.
Towards a Decentralized, Autonomous Multiagent Framework for Mitigating Crop Loss
Ceren, Roi, Quinn, Shannon, Raines, Glen
We propose a generalized decision-theoretic system for a heterogeneous team of autonomous agents who are tasked with online identification of phenotypically expressed stress in crop fields.. This system employs four distinct types of agents, specific to four available sensor modalities: satellites (Layer 3), uninhabited aerial vehicles (L2), uninhabited ground vehicles (L1), and static ground-level sensors (L0). Layers 3, 2, and 1 are tasked with performing image processing at the available resolution of the sensor modality and, along with data generated by layer 0 sensors, identify erroneous differences that arise over time. Our goal is to limit the use of the more computationally and temporally expensive subsequent layers. Therefore, from layer 3 to 1, each layer only investigates areas that previous layers have identified as potentially afflicted by stress. We introduce a reinforcement learning technique based on Perkins' Monte Carlo Exploring Starts for a generalized Markovian model for each layer's decision problem, and label the system the Agricultural Distributed Decision Framework (ADDF). As our domain is real-world and online, we illustrate implementations of the two major components of our system: a clustering-based image processing methodology and a two-layer POMDP implementation.
Fair Allocation of Indivisible Goods to Asymmetric Agents
Farhadi, Alireza, Ghodsi, Mohammad, Hajiaghayi, Mohammad Taghi, Lahaie, Sébastien, Pennock, David, Seddighin, Masoud, Seddighin, Saeed, Yami, Hadi
We study fair allocation of indivisible goods to agents with unequal entitlements. Fair allocation has been the subject of many studies in both divisible and indivisible settings. Our emphasis is on the case where the goods are indivisible and agents have unequal entitlements. This problem is a generalization of the work by Procaccia and Wang (2014) wherein the agents are assumed to be symmetric with respect to their entitlements. Although Procaccia and Wang show an almost fair (constant approximation) allocation exists in their setting, our main result is in sharp contrast to their observation. We show that, in some cases with n agents, no allocation can guarantee better than 1/n approximation of a fair allocation when the entitlements are not necessarily equal. Furthermore, we devise a simple algorithm that ensures a 1/n approximation guarantee. Our second result is for a restricted version of the problem where the valuation of every agent for each good is bounded by the total value he wishes to receive in a fair allocation. Although this assumption might seem without loss of generality, we show it enables us to find a 1/2 approximation fair allocation via a greedy algorithm. Finally, we run some experiments on real-world data and show that, in practice, a fair allocation is likely to exist. We also support our experiments by showing positive results for two stochastic variants of the problem, namely stochastic agents and stochastic items.