Agents
FleetPy: A Modular Open-Source Simulation Tool for Mobility On-Demand Services
Engelhardt, Roman, Dandl, Florian, Syed, Arslan-Ali, Zhang, Yunfei, Fehn, Fabian, Wolf, Fynn, Bogenberger, Klaus
The market share of mobility on-demand (MoD) services strongly increased in recent years and is expected to rise even higher once vehicle automation is fully available. These services might reduce space consumption in cities as fewer parking spaces are required if private vehicle trips are replaced. If rides are shared additionally, occupancy related traffic efficiency is increased. Simulations help to identify the actual impact of MoD on a traffic system, evaluate new control algorithms for improved service efficiency and develop guidelines for regulatory measures. This paper presents the open-source agent-based simulation framework FleetPy. FleetPy (written in the programming language "Python") is explicitly developed to model MoD services in a high level of detail. It specially focuses on the modeling of interactions of users with operators while its flexibility allows the integration and embedding of multiple operators in the overall transportation system. Its modular structure ensures the transferabillity of previously developed elements and the selection of an appropriate level of modeling detail. This paper compares existing simulation frameworks for MoD services and highlights exclusive features of FleetPy. The upper level simulation flows are presented, followed by required input data for the simulation and the output data FleetPy produces. Additionally, the modules within FleetPy and high-level descriptions of current implementations are provided. Finally, an example showcase for Manhattan, NYC provides insights into the impacts of different modules for simulation flow, fleet optimization, traveler behavior and network representation.
Entangled Rendezvous: A Possible Application of Bell Non-Locality For Mobile Agents on Networks
Rendezvous is an old problem of assuring that two or more parties, initially separated, not knowing the position of each other, and not allowed to communicate, meet without pre-agreement on the meeting point. This problem has been extensively studied in classical computer science and has vivid importance to modern applications like coordinating a fleet of drones in an enemy's territory. Quantum non-locality, like Bell inequality violation, has shown that in many cases quantum entanglement allows for improved coordination of two separated parties compared to classical sources. The non-signaling correlations in many cases even strengthened such phenomena. In this work, we analyze, how Bell non-locality can be used by asymmetric location-aware agents trying to rendezvous on a finite network with a limited number of steps. We provide the optimal solution to this problem for both agents using quantum resources, and agents with only ``classical'' computing power. Our results show that for cubic graphs and cycles it is possible to gain an advantage by allowing the agents to use assistance of entangled quantum states.
DoRO: Disambiguation of referred object for embodied agents
Pramanick, Pradip, Sarkar, Chayan, Paul, Sayan, Roychoudhury, Ruddra dev, Bhowmick, Brojeshwar
Robotic task instructions often involve a referred object that the robot must locate (ground) within the environment. While task intent understanding is an essential part of natural language understanding, less effort is made to resolve ambiguity that may arise while grounding the task. Existing works use vision-based task grounding and ambiguity detection, suitable for a fixed view and a static robot. However, the problem magnifies for a mobile robot, where the ideal view is not known beforehand. Moreover, a single view may not be sufficient to locate all the object instances in the given area, which leads to inaccurate ambiguity detection. Human intervention is helpful only if the robot can convey the kind of ambiguity it is facing. In this article, we present DoRO (Disambiguation of Referred Object), a system that can help an embodied agent to disambiguate the referred object by raising a suitable query whenever required. Given an area where the intended object is, DoRO finds all the instances of the object by aggregating observations from multiple views while exploring & scanning the area. It then raises a suitable query using the information from the grounded object instances. Experiments conducted with the AI2Thor simulator show that DoRO not only detects the ambiguity more accurately but also raises verbose queries with more accurate information from the visual-language grounding.
Cybersecurity mesh provides decentralized safety and swarm AI for remote-first enterprises - Channel969
Be a part of executives from July 26-28 for Remodel's AI & Edge Week. Hear from high leaders talk about matters surrounding AL/ML know-how, conversational AI, IVA, NLP, Edge, and extra. Cybersecurity mesh has been named a high strategic know-how development for 2022 by Gartner. In line with Gartner's report, cybersecurity mesh is a cutting-edge conceptual safety structure methodology that permits right this moment's scattered enterprises to increase and implement safety the place it's most wanted. David Carvalho, CEO and founding father of cybersecurity community Naoris Protocol, instructed VentureBeat through e-mail that cybersecurity mesh is a versatile, composable structure that integrates broadly distributed safety companies.
Using AI to train teams of robots to work together
"It's easier when agents can talk to each other," said Huy Tran, an aerospace engineer at Illinois. "But we wanted to do this in a way that's decentralized, meaning that they don't talk to each other. We also focused on situations where it's not obvious what the different roles or jobs for the agents should be." Tran said this scenario is much more complex and a harder problem because it's not clear what one agent should do versus another agent. "The interesting question is how do we learn to accomplish a task together over time," Tran said.
Adapting the Exploration-Exploitation Balance in Heterogeneous Swarms: Tracking Evasive Targets
Kwa, Hian Lee, Babineau, Victor, Philippot, Julien, Bouffanais, Roland
There has been growing interest in the use of multi-robot systems in various tasks and scenarios. The main attractiveness of such systems is their flexibility, robustness, and scalability. An often overlooked yet promising feature is system modularity, which offers the possibility to harness agent specialization, while also enabling system-level upgrades. However, altering the agents' capacities can change the exploration-exploitation balance required to maximize the system's performance. Here, we study the effect of a swarm's heterogeneity on its exploration-exploitation balance while tracking multiple fast-moving evasive targets under the Cooperative Multi-Robot Observation of Multiple Moving Targets framework. To this end, we use a decentralized search and tracking strategy with adjustable levels of exploration and exploitation. By indirectly tuning the balance, we first confirm the presence of an optimal balance between these two key competing actions. Next, by substituting slower moving agents with faster ones, we show that the system exhibits a performance improvement without any modifications to the original strategy. In addition, owing to the additional amount of exploitation carried out by the faster agents, we demonstrate that a heterogeneous system's performance can be further improved by reducing an agent's level of connectivity, to favor the conduct of exploratory actions. Furthermore, in studying the influence of the density of swarming agents, we show that the addition of faster agents can counterbalance a reduction in the overall number of agents while maintaining the level of tracking performance. Finally, we explore the challenges of using differentiated strategies to take advantage of the heterogeneous nature of the swarm.
Safe and Robust Experience Sharing for Deterministic Policy Gradient Algorithms
Saglam, Baturay, Cicek, Dogan C., Mutlu, Furkan B., Kozat, Suleyman S.
Learning in high dimensional continuous tasks is challenging, mainly when the experience replay memory is very limited. We introduce a simple yet effective experience sharing mechanism for deterministic policies in continuous action domains for the future off-policy deep reinforcement learning applications in which the allocated memory for the experience replay buffer is limited. To overcome the extrapolation error induced by learning from other agents' experiences, we facilitate our algorithm with a novel off-policy correction technique without any action probability estimates. We test the effectiveness of our method in challenging OpenAI Gym continuous control tasks and conclude that it can achieve a safe experience sharing across multiple agents and exhibits a robust performance when the replay memory is strictly limited.
Measuring Difficulty of Novelty Reaction
Nikonova, Ekaterina, Xue, Cheng, Pinto, Vimukthini, Gamage, Chathura, Zhang, Peng, Renz, Jochen
Current AI systems are designed to solve close-world problems with the assumption that the underlying world is remaining more or less the same. However, when dealing with real-world problems such assumptions can be invalid as sudden and unexpected changes can occur. To effectively deploy AI-powered systems in the real world, AI systems should be able to deal with open-world novelty quickly. Inevitably, dealing with open-world novelty raises an important question of novelty difficulty. Knowing whether one novelty is harder to deal with than another, can help researchers to train their systems systematically. In addition, it can also serve as a measurement of the performance of novelty robust AI systems. In this paper, we propose to define the novelty reaction difficulty as a relative difficulty of performing the known task after the introduction of the novelty. We propose a universal method that can be applied to approximate the difficulty. We present the approximations of the difficulty using our method and show how it aligns with the results of the evaluation of AI agents designed to deal with novelty.
On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligence
Ma, Yi, Tsao, Doris, Shum, Heung-Yeung
Ten years into the revival of deep networks and artificial intelligence, we propose a theoretical framework that sheds light on understanding deep networks within a bigger picture of Intelligence in general. We introduce two fundamental principles, Parsimony and Self-consistency, that address two fundamental questions regarding Intelligence: what to learn and how to learn, respectively. We believe the two principles are the cornerstones for the emergence of Intelligence, artificial or natural. While these two principles have rich classical roots, we argue that they can be stated anew in entirely measurable and computable ways. More specifically, the two principles lead to an effective and efficient computational framework, compressive closed-loop transcription, that unifies and explains the evolution of modern deep networks and many artificial intelligence practices. While we mainly use modeling of visual data as an example, we believe the two principles will unify understanding of broad families of autonomous intelligent systems and provide a framework for understanding the brain.
A Geometric Approach to Passive Localisation
Triommatis, Theofilos, Potapov, Igor, Rees, Gareth, Ralph, Jason F.
In this paper, we present a geometric framework for the passive localisation of static emitters. The objective is to localise the position of the emitters in a given area by centralised coordination of mobile passive sensors. This framework uses only the geometry of the problem to minimise the maximal bounds of the emitters' locations without using a belief or probability distribution. This geometric approach provides effective boundaries on the emitters' position. It can also be useful in evaluating different decision-making strategies for coordinating mobile passive sensors and complementing statistical methods during the initialisation process. The effectiveness of the geometric approach is shown by designing and evaluating a greedy decision-making strategy, where a sensor selects its future position by minimising the maximum uncertainty on its next measurement using one of the global objective functions. Finally, we analyse and discuss the emergent behaviour and robustness of the proposed algorithms.