Goto

Collaborating Authors

 Agents


Prioritized Guidance for Efficient Multi-Agent Reinforcement Learning Exploration

arXiv.org Machine Learning

Exploration efficiency is a challenging problem in multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the collaborative approach among multiple agents. Another important problem is the less informative reward restricts the learning speed of MARL compared with the informative label in supervised learning. In this work, we leverage on a novel communication method to guide MARL to accelerate exploration and propose a predictive network to forecast the reward of current state-action pair and use the guidance learned by the predictive network to modify the reward function. An improved prioritized experience replay is employed to better take advantage of the different knowledge learned by different agents which utilizes Time-difference (TD) error more effectively. Experimental results demonstrates that the proposed algorithm outperforms existing methods in cooperative multi-agent environments. We remark that this algorithm can be extended to supervised learning to speed up its training.


Interactive Learning of Environment Dynamics for Sequential Tasks

arXiv.org Artificial Intelligence

In order for robots and other artificial agents to efficiently learn to perform useful tasks defined by an end user, they must understand not only the goals of those tasks, but also the structure and dynamics of that user's environment. While existing work has looked at how the goals of a task can be inferred from a human teacher, the agent is often left to learn about the environment on its own. To address this limitation, we develop an algorithm, Behavior Aware Modeling (BAM), which incorporates a teacher's knowledge into a model of the transition dynamics of an agent's environment. We evaluate BAM both in simulation and with real human teachers, learning from a combination of task demonstrations and evaluative feedback, and show that it can outperform approaches which do not explicitly consider this source of dynamics knowledge.


Vision-and-Dialog Navigation

arXiv.org Artificial Intelligence

Robots navigating in human environments should use language to ask for assistance and be able to understand human responses. To study this challenge, we introduce Cooperative Vision-and-Dialog Navigation, a dataset of over 2k embodied, human-human dialogs situated in simulated, photorealistic home environments. The Navigator asks questions to their partner, the Oracle, who has privileged access to the best next steps the Navigator should take according to a shortest path planner. To train agents that search an environment for a goal location, we define the Navigation from Dialog History task. An agent, given a target object and a dialog history between humans cooperating to find that object, must infer navigation actions towards the goal in unexplored environments. We establish an initial, multi-modal sequence-to-sequence model and demonstrate that looking farther back in the dialog history improves performance. Sourcecode and a live interface demo can be found at https://github.com/mmurray/cvdn


Beware the hype around AI. It has fooled many

#artificialintelligence

By Ariel Procaccia Last March, McDonald's Corp. acquired the startup Dynamic Yield for $300 million, in the hope of employing machine learning to personalize customer experience. In the age of artificial intelligence, this was a no-brainer for McDonald's, since Dynamic Yield is widely recognized for its AI-powered technology and recently even landed a spot in a prestigious list of top AI startups. Neural McNetworks are upon us. Trouble is, Dynamic Yield's platform has nothing to do with AI, according to an article posted on Medium last month by the company's former head of content, Mike Mallazzo. It was a heartfelt takedown of phony AI, which was itself taken down by the author but remains engraved in the collective memory of the internet.


Facebook, Carnegie Mellon build first AI that beats pros in 6-player poker

#artificialintelligence

Pluribus is the first AI bot capable of beating human experts in six-player no-limit Hold'em, the most widely played poker format in the world. This is the first time an AI bot has beaten top human players in a complex game with more than two players or two teams. We tested Pluribus against professional poker players, including two winners of the World Series of Poker Main Event. Pluribus succeeds because it can very efficiently handle the challenges of a game with both hidden information and more than two players. It uses self-play to teach itself how to win, with no examples or guidance on strategy. Pluribus uses far fewer computing resources than the bots that have defeated humans in other games. The bot's success will advance AI research, because many important AI challenges involve many players and hidden information. For decades, poker has been a difficult and important grand challenge problem for the field of AI. Because poker involves hidden information -- you don't know your opponents' cards -- success requires bluffing and other strategies that do not apply to chess, Go, and other games.


Self Organizing Supply Chains for Micro-Prediction: Present and Future uses of the ROAR Protocol

arXiv.org Machine Learning

A multi-agent system is trialed as a means of crowd-sourcing inexpensive but high quality streams of predictions. Each agent is a microservice embodying statistical models and endowed with economic self-interest. The ability to fork and modify simple agents is granted to a large number of employees in a firm and empirical lessons are reported. We suggest that one plausible trajectory for this project is the creation of a Prediction Web.


Towards Blockchain-based Multi-Agent Robotic Systems: Analysis, Classification and Applications

arXiv.org Artificial Intelligence

This is known as cloud computing, distributed planning and management, and the classical Blockchain Trilemma - when it comes to the distributed ledgers provides and optimistic outlook towards choice two of the three between decentralization, scalability increasingly popular technological solutions such as the Internet and security [12]. One of the scaling methods that does not of Robotic Things (IoRT) [1], [2], [3], [4], [5] and the compromise security or decentralization is called sharding, Blockchain-based Multi-Agent Robotic Systems (MARS) [6], which involves fragmentation of the available dataset into [7], [8], [9]. It is known that one of the important problems smaller datasets called shards [11], [12]. Although multi-agent in developing multi-robot systems is the design of strategies robotic systems (MARS) are not so critical to scalability and for their coordination in such a way that the robots could speed as the financial and big data-based systems, they are effectively perform their operations and reasonably coordinate nevertheless also very sensitive to delays and throughput of the task allocation among themselves [10]. Real-world scenarios the information channels at data exchange between agents.


How video game engines help create smarter AI

#artificialintelligence

Video game developers have longed used artificial intelligence to help create believable worlds. So it's not too surprising that researchers can now use some of those same game-making tools to train AI. During a talk at VentureBeat's Transform 2019 conference last week, Unity Technologies VP of AI and machine learning Danny Lange argued that game engines are perfect for creating what he called "real" computer intelligence -- self-learning systems capable of producing complex behaviors after a short amount of time. With game engines (like the company's own Unity engine), you can simulate the rules of the real world and test intelligent agents against it. "If you think about [it], the game engine has three dimensions, time, physics … it has everything you need to play around with the core elements that led to [human] intelligence," said Lange.


A hybrid neural network model based on improved PSO and SA for bankruptcy prediction

arXiv.org Machine Learning

Predicting firm's failure is one of the most interesting subjects for investors and decision makers. In this paper, a bankruptcy prediction model is proposed based on Artificial Neural networks (ANN). Taking into consideration that the choice of v ariables to discriminate between bankrupt and non - bankrupt firms influences significantly the model's accuracy and considering the problem of local minima, we propose a hybrid ANN based on variables selection techniques. Moreover, we evolve the convergence of Particle Swarm Optimization (PSO) by proposing a training algorithm based on an improved PSO and Simulated Annealing. A comparative performance study is reported, and the proposed hybrid model shows a high performance and convergence in the context of missing data.


Vadere: An open-source simulation framework to promote interdisciplinary understanding

arXiv.org Artificial Intelligence

Pedestrian dynamics is an interdisciplinary field of research. Psychologists, sociologists, traffic engineers, physicists, mathematicians and computer scientists all strive to understand the dynamics of a moving crowd. In principle, computer simulations offer means to further this understanding. Yet, unlike for many classic dynamical systems in physics, there is no universally accepted locomotion model for crowd dynamics. On the contrary, a multitude of approaches, with very different characteristics, compete. Often only the experts in one special model type are able to assess the consequences these characteristics have on a simulation study. Therefore, scientists from all disciplines who wish to use simulations to analyze pedestrian dynamics need a tool to compare competing approaches. Developers, too, would profit from an easy way to get insight into an alternative modeling ansatz. Vadere meets this interdisciplinary demand by offering an open-source simulation framework that is lightweight in its approach and in its user interface while offering pre-implemented versions of the most widely spread models.