Agents
Reinforcement Communication Learning in Different Social Network Structures
Dubova, Marina, Moskvichev, Arseny, Goldstone, Robert
Social network structure is one of the key determinants of human language evolution. Previous work has shown that the network of social interactions shapes decentralized learning in human groups, leading to the emergence of different kinds of communicative conventions. We examined the effects of social network organization on the properties of communication systems emerging in decentralized, multi-agent reinforcement learning communities. We found that the global connectivity of a social network drives the convergence of populations on shared and symmetric communication systems, preventing the agents from forming many local "dialects". Moreover, the agent's degree is inversely related to the consistency of its use of communicative conventions. These results show the importance of the basic properties of social network structure on reinforcement communication learning and suggest a new interpretation of findings on human convergence on word conventions.
AI helps drone swarms navigate through crowded, unfamiliar spaces
Drone swarms frequently fly outside for a reason: it's difficult for the robotic fliers to navigate in tight spaces without hitting each other. Caltech researchers may have a way for those drones to fly indoors, however. They've developed a machine learning algorithm, Global-to-Local Safe Autonomy Synthesis (GLAS), that lets swarms navigate crowded, unmapped environments. The system works by giving each drone a degree of independence that lets it adapt to a changing environment. Instead of relying on existing maps or the routes of every other drone in the swarm, GLAS has each machine learning how to navigate a given space on its own even as it coordinates with others.
On Controllability of AI
The unprecedented progress in Artificial Intelligence (AI) [1-6], over the last decade, came alongside of multiple AI failures [7, 8] and cases of dual use [9] causing a realization [10] that it is not sufficient to create highly capable machines, but that it is even more important to make sure that intelligent machines are beneficial [11] for the humanity. This lead to the birth of the new subfield of research commonly known as AI Safety and Security [12] with hundreds of papers and books published annually on different aspects of the problem [13-31]. All such research is done under the assumption that the problem of controlling highly capable intelligent machines is solvable, which has not been established by any rigorous means. However, it is a standard practice in computer science to first show that a problem doesn't belong to a class of unsolvable problems [32, 33] before investing resources into trying to solve it or deciding what approaches to try. Unfortunately, to the best of our knowledge no mathematical proof or even rigorous argumentation has been published demonstrating that the AI control problem may be solvable, even in principle, much less in practice. Or as Gans puts it citing Bostrom: "Thusfar, AI researchers and philosophers have not been able to come up with methods of control that would ensure [bad] outcomes did not take place …" [34].
ESCELL: Emergent Symbolic Cellular Language
Chowdhury, Aritra, Kubricht, James R., Sood, Anup, Tu, Peter, Santamaria-Pang, Alberto
We present ESCELL, a method for developing an emergent symbolic language of communication between multiple agents reasoning about cells. We show how agents are able to cooperate and communicate successfully in the form of symbols similar to human language to accomplish a task in the form of a referential game (Lewis' signaling game). In one form of the game, a sender and a receiver observe a set of cells from 5 different cell phenotypes. The sender is told one cell is a target and is allowed to send one symbol to the receiver from a fixed arbitrary vocabulary size. The receiver relies on the information in the symbol to identify the target cell. We train the sender and receiver networks to develop an innate emergent language between themselves to accomplish this task. We observe that the networks are able to successfully identify cells from 5 different phenotypes with an accuracy of 93.2%. We also introduce a new form of the signaling game where the sender is shown one image instead of all the images that the receiver sees. The networks successfully develop an emergent language to get an identification accuracy of 77.8%.
Multi-Principal Assistance Games
Fickinger, Arnaud, Zhuang, Simon, Hadfield-Menell, Dylan, Russell, Stuart
Assistance games (also known as cooperative inverse reinforcement learning games) have been proposed as a model for beneficial AI, wherein a robotic agent must act on behalf of a human principal but is initially uncertain about the humans payoff function. This paper studies multi-principal assistance games, which cover the more general case in which the robot acts on behalf of N humans who may have widely differing payoffs. Impossibility theorems in social choice theory and voting theory can be applied to such games, suggesting that strategic behavior by the human principals may complicate the robots task in learning their payoffs. We analyze in particular a bandit apprentice game in which the humans act first to demonstrate their individual preferences for the arms and then the robot acts to maximize the sum of human payoffs. We explore the extent to which the cost of choosing suboptimal arms reduces the incentive to mislead, a form of natural mechanism design. In this context we propose a social choice method that uses shared control of a system to combine preference inference with social welfare optimization.
IPsoft Amelia Now Available on Genesys AppFoundry
IPsoft, the largest independent leader in enterprise artificial intelligence (AI), announced that Amelia, its industry-leading digital customer service agent, is now available on Genesys AppFoundry from Genesys, the global leader in cloud customer experience and contact centre solutions. Amelia, with her superior conversational AI capabilities, can handle customers' most common requests by herself, without human support, empowering organizations to offer their customers immediate and scalable 24/7 support for faster problem resolutions. The integration of Amelia is available through Genesys Cloud, the industry's leading cloud contact centre platform, with a robust feature set and open APIs, which allows for flexibility, scalability and rapid innovations. Genesys and IPsoft customers, includes Bankia one of the largest banks in Spain. Bankia deployed Amelia as a digital contact centre agent to scale customer service and improve the customer experience.
Computing the Dirichlet-Multinomial Log-Likelihood Function
Dirichlet-multinomial (DMN) distribution is commonly used to model over-dispersion in count data. Precise and fast numerical computation of the DMN log-likelihood function is important for performing statistical inference using this distribution, and remains a challenge. To address this, we use mathematical properties of the gamma function to derive a closed form expression for the DMN log-likelihood function. Compared to existing methods, calculation of the closed form has a lower computational complexity, hence is much faster without comprimising computational accuracy.
Learning Desirable Matchings From Partial Preferences
Hosseini, Hadi, Menon, Vijay, Shah, Nisarg, Sikdar, Sujoy
A fundamental problem in multi-agent systems is resource allocation. Specifically, the problem of assigning a number of indivisible objects to agents with different preferences has been widely studied not only in multi-agent systems, but also in economics [21] and theoretical computer science [12]. The focus of our work is the special case of allocating n objects to n agents (so each agent is matched to a single object), which models many real-world applications. For example, imagine allocating office spaces to faculty members in a new building. Instead of asking each faculty member to report a full preference ranking over the available offices, the department head may ask faculty members to reveal their top choices, and then if need be, he may ask individual faculty members to reveal their next best choices, and so on. The goal of the department head is to learn a matching that satisfies some form of "economic efficiency" while asking as few queries as possible.
A Review of Platforms for the Development of Agent Systems
Pal, Constantin-Valentin, Leon, Florin, Paprzycki, Marcin, Ganzha, Maria
Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such agent platforms have been developed. Meanwhile, some of them have been abandoned, others continue their development and new platforms are released. This paper presents a up-to-date review of the existing agent platforms and also a historical perspective of this domain. It aims to serve as a reference point for people interested in developing agent systems. This work details the main characteristics of the included agent platforms, together with links to specific projects where they have been used. It distinguishes between the active platforms and those no longer under development or with unclear status. It also classifies the agent platforms as general purpose ones, free or commercial, and specialized ones, which can be used for particular types of applications.
Dow's Machine Learning Journey In International Trade
A ccontainer vessel leaves the port in Singapore on July 16, 2020. Dow Chemical is in the midst of a digital transformation. They have set up Centers to test out new and emerging technologies. They have had success in developing valuable intellectual property in the area of trade classifications. Dr. John Wassick, Integrated Supply Chain Technology Fellow, Dow Inc. DD, was on a supply chain panel at the ARC Industry Forum in Orlando.