Agents
Learning Desirable Matchings From Partial Preferences
Hosseini, Hadi, Menon, Vijay, Shah, Nisarg, Sikdar, Sujoy
A fundamental problem in multi-agent systems is resource allocation. Specifically, the problem of assigning a number of indivisible objects to agents with different preferences has been widely studied not only in multi-agent systems, but also in economics [21] and theoretical computer science [12]. The focus of our work is the special case of allocating n objects to n agents (so each agent is matched to a single object), which models many real-world applications. For example, imagine allocating office spaces to faculty members in a new building. Instead of asking each faculty member to report a full preference ranking over the available offices, the department head may ask faculty members to reveal their top choices, and then if need be, he may ask individual faculty members to reveal their next best choices, and so on. The goal of the department head is to learn a matching that satisfies some form of "economic efficiency" while asking as few queries as possible.
A Review of Platforms for the Development of Agent Systems
Pal, Constantin-Valentin, Leon, Florin, Paprzycki, Marcin, Ganzha, Maria
Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such agent platforms have been developed. Meanwhile, some of them have been abandoned, others continue their development and new platforms are released. This paper presents a up-to-date review of the existing agent platforms and also a historical perspective of this domain. It aims to serve as a reference point for people interested in developing agent systems. This work details the main characteristics of the included agent platforms, together with links to specific projects where they have been used. It distinguishes between the active platforms and those no longer under development or with unclear status. It also classifies the agent platforms as general purpose ones, free or commercial, and specialized ones, which can be used for particular types of applications.
Dow's Machine Learning Journey In International Trade
A ccontainer vessel leaves the port in Singapore on July 16, 2020. Dow Chemical is in the midst of a digital transformation. They have set up Centers to test out new and emerging technologies. They have had success in developing valuable intellectual property in the area of trade classifications. Dr. John Wassick, Integrated Supply Chain Technology Fellow, Dow Inc. DD, was on a supply chain panel at the ARC Industry Forum in Orlando.
Toward Forgetting-Sensitive Referring Expression Generationfor Integrated Robot Architectures
Williams, Tom, Johnson, Torin, Culpepper, Will, Larson, Kellyn
To engage in human-like dialogue, robots require the ability to describe the objects, locations, and people in their environment, a capability known as "Referring Expression Generation." As speakers repeatedly refer to similar objects, they tend to re-use properties from previous descriptions, in part to help the listener, and in part due to cognitive availability of those properties in working memory (WM). Because different theories of working memory "forgetting" necessarily lead to differences in cognitive availability, we hypothesize that they will similarly result in generation of different referring expressions. To design effective intelligent agents, it is thus necessary to determine how different models of forgetting may be differentially effective at producing natural human-like referring expressions. In this work, we computationalize two candidate models of working memory forgetting within a robot cognitive architecture, and demonstrate how they lead to cognitive availability-based differences in generated referring expressions.
A model to support collective reasoning: Formalization, analysis and computational assessment
Ganzer, Jordi, Criado, Natalia, Lopez-Sanchez, Maite, Parsons, Simon, Rodriguez-Aguilar, Juan A.
Inspired by e-participation systems, in this paper we propose a new model to represent human debates and methods to obtain collective conclusions from them. This model overcomes drawbacks of existing approaches by allowing users to introduce new pieces of information into the discussion, to relate them to existing pieces, and also to express their opinion on the pieces proposed by other users. In addition, our model does not assume that users' opinions are rational in order to extract information from it, an assumption that significantly limits current approaches. Instead, we define a weaker notion of rationality that characterises coherent opinions, and we consider different scenarios based on the coherence of individual opinions and the level of consensus that users have on the debate structure. Considering these two factors, we analyse the outcomes of different opinion aggregation functions that compute a collective decision based on the individual opinions and the debate structure. In particular, we demonstrate that aggregated opinions can be coherent even if there is a lack of consensus and individual opinions are not coherent. We conclude our analysis with a computational evaluation demonstrating that collective opinions can be computed efficiently for real-sized debates.
Reinforcement Learning Under Moral Uncertainty
An ambitious goal for artificial intelligence is to create agents that behave ethically: The capacity to abide by human moral norms would greatly expand the context in which autonomous agents could be practically and safely deployed. While ethical agents could be trained through reinforcement, by rewarding correct behavior under a specific moral theory (e.g. utilitarianism), there remains widespread disagreement (both societally and among moral philosophers) about the nature of morality and what ethical theory (if any) is objectively correct. Acknowledging such disagreement, recent work in moral philosophy proposes that ethical behavior requires acting under moral uncertainty, i.e. to take into account when acting that one's credence is split across several plausible ethical theories. Inspired by such work, this paper proposes a formalism that translates such insights to the field of reinforcement learning. Demonstrating the formalism's potential, we then train agents in simple environments to act under moral uncertainty, highlighting how such uncertainty can help curb extreme behavior from commitment to single theories. The overall aim is to draw productive connections from the fields of moral philosophy and machine ethics to that of machine learning, to inspire further research by highlighting a spectrum of machine learning research questions relevant to training ethically capable reinforcement learning agents.
Emergent Multi-Agent Communication in the Deep Learning Era
Lazaridou, Angeliki, Baroni, Marco
The ability to cooperate through language is a defining feature of humans. As the perceptual, motory and planning capabilities of deep artificial networks increase, researchers are studying whether they also can develop a shared language to interact. From a scientific perspective, understanding the conditions under which language evolves in communities of deep agents and its emergent features can shed light on human language evolution. From an applied perspective, endowing deep networks with the ability to solve problems interactively by communicating with each other and with us should make them more flexible and useful in everyday life.
Explore and Explain: Self-supervised Navigation and Recounting
Bigazzi, Roberto, Landi, Federico, Cornia, Marcella, Cascianelli, Silvia, Baraldi, Lorenzo, Cucchiara, Rita
Embodied AI has been recently gaining attention as it aims to foster the development of autonomous and intelligent agents. In this paper, we devise a novel embodied setting in which an agent needs to explore a previously unknown environment while recounting what it sees during the path. In this context, the agent needs to navigate the environment driven by an exploration goal, select proper moments for description, and output natural language descriptions of relevant objects and scenes. Our model integrates a novel self-supervised exploration module with penalty, and a fully-attentive captioning model for explanation. Also, we investigate different policies for selecting proper moments for explanation, driven by information coming from both the environment and the navigation. Experiments are conducted on photorealistic environments from the Matterport3D dataset and investigate the navigation and explanation capabilities of the agent as well as the role of their interactions.
Power Virtual Agents is now available in more languages
Power Virtual Agents is gaining traction around the world and the market has responded with a strong desire for us to support more languages. Today we're excited to announce that we are bringing to public preview support for an extended set of languages! This enables our partners and customers to build even more engaging and locally relevant experiences for their users. When you create a new bot, you select the language you want the bot to understand when interacting with your users. You'll see that your new bot is prepopulated with content in the target language and you can easily create more topics with trigger phrases and bot responses in the language you've selected.
Towards an Interface Description Template for AI-enabled Systems
Shadab, Niloofar, Salado, Alejandro
Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components. However, reusing components with AI capabilities might introduce new risks as there is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed. We know from SW-intensive systems that AI algorithms are generally fragile and behave unexpectedly to changes in context and boundary conditions. The question we address in this paper is, what type of information should be captured in the Interface Control Document (ICD) of an AI-enabled system or component to assess its compatibility with a system for which it was not designed originally. We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component to facilitate its adequate reuse across different systems and operational contexts. Our work is inspired by Google's Model Card concept, which was developed with the same goal but focused on the reusability of AI algorithms. We extend that concept to address system-level autonomy capabilities of AI-enabled cyber-physical systems.