Agents
Astrobotics: Swarm Robotics for Astrophysical Studies
Macktoobian, Matin, Gillet, Denis, Kneib, Jean-Paul
Published in "IEEE Robotics and Automation Magazine", DOI: 10.1109/MRA.2020.3044911 Matin Macktoobian, Denis Gillet, and Jean-Paul Kneib The authors are with the School of Engineering, Swiss Federal Institute of Technology in Lausanne (EPFL), Lausanne, Switzerland (e-mail: matin.macktoobian@epfl.ch; Abstract This paper introduces the emerging field of astrobotics, that is, a recently-established branch of robotics to be of service to astrophysics and observational astronomy. We first describe a modern requirement of dark matter studies, i.e., the generation of the map of the observable universe, using astrobots. Astrobots differ from conventional two-degree-of-freedom robotic manipulators in two respects. First, the dense formation of astrobots give rise to the extremely overlapping dynamics of neighboring astrobots which make them severely subject to collisions. Second, the structure of astrobots and their mechanical specifications are specialized due to the embedded optical fibers passed through them. We focus on the coordination problem of astrobots whose solutions shall be collision-free, fast execution, and complete in terms of the astrobots' convergence rates. We also illustrate the significant impact of astrobots assignments to observational targets on the quality of coordination solutions To present the current state of the field, we elaborate the open problems including next-generation astrophysical projects including 20,000 astrobots, and other fields, such as space debris tracking, in which astrobots may be potentially used. Astrobotics is an emerging field of swarm robotics aiming to the development and control of astrobots [1, 2] to be of service to astrophysical studies and cosmological spectroscopic observations. In particular, astrobotics addresses a wide range of swarm-robotic-related topics (see, Figure 1) which exhibit challenging problems in design, interaction, coordination, and mission planning corresponding to astrobots. There have been many astrophysical projects, such as the SDSS family [3] which seek the generation of the map of the observable universe.
Exploring Effectiveness of Explanations for Appropriate Trust: Lessons from Cognitive Psychology
Verhagen, Ruben S., Mehrotra, Siddharth, Neerincx, Mark A., Jonker, Catholijn M., Tielman, Myrthe L.
The rapid development of Artificial Intelligence (AI) requires developers and designers of AI systems to focus on the collaboration between humans and machines. AI explanations of system behavior and reasoning are vital for effective collaboration by fostering appropriate trust, ensuring understanding, and addressing issues of fairness and bias. However, various contextual and subjective factors can influence an AI system explanation's effectiveness. This work draws inspiration from findings in cognitive psychology to understand how effective explanations can be designed. We identify four components to which explanation designers can pay special attention: perception, semantics, intent, and user & context. We illustrate the use of these four explanation components with an example of estimating food calories by combining text with visuals, probabilities with exemplars, and intent communication with both user and context in mind. We propose that the significant challenge for effective AI explanations is an additional step between explanation generation using algorithms not producing interpretable explanations and explanation communication. We believe this extra step will benefit from carefully considering the four explanation components outlined in our work, which can positively affect the explanation's effectiveness.
Game Theoretic Rating in N-player general-sum games with Equilibria
Marris, Luke, Lanctot, Marc, Gemp, Ian, Omidshafiei, Shayegan, McAleer, Stephen, Connor, Jerome, Tuyls, Karl, Graepel, Thore
Rating strategies in a game is an important area of research in game theory and artificial intelligence, and can be applied to any real-world competitive or cooperative setting. Traditionally, only transitive dependencies between strategies have been used to rate strategies (e.g. Elo), however recent work has expanded ratings to utilize game theoretic solutions to better rate strategies in non-transitive games. This work generalizes these ideas and proposes novel algorithms suitable for N-player, general-sum rating of strategies in normal-form games according to the payoff rating system. This enables well-established solution concepts, such as equilibria, to be leveraged to efficiently rate strategies in games with complex strategic interactions, which arise in multiagent training and real-world interactions between many agents. We empirically validate our methods on real world normal-form data (Premier League) and multiagent reinforcement learning agent evaluation.
Cost Aware Asynchronous Multi-Agent Active Search
Banerjee, Arundhati, Ghods, Ramina, Schneider, Jeff
Multi-agent active search requires autonomous agents to choose sensing actions that efficiently locate targets. In a realistic setting, agents also must consider the costs that their decisions incur. Previously proposed active search algorithms simplify the problem by ignoring uncertainty in the agent's environment, using myopic decision making, and/or overlooking costs. In this paper, we introduce an online active search algorithm to detect targets in an unknown environment by making adaptive cost-aware decisions regarding the agent's actions. Our algorithm combines principles from Thompson Sampling (for search space exploration and decentralized multi-agent decision making), Monte Carlo Tree Search (for long horizon planning) and pareto-optimal confidence bounds (for multi-objective optimization in an unknown environment) to propose an online lookahead planner that removes all the simplifications. We analyze the algorithm's performance in simulation to show its efficacy in cost aware active search.
From Intelligent Agents to Trustworthy Human-Centred Multiagent Systems
Soorati, Mohammad Divband, Gerding, Enrico H., Marchioni, Enrico, Naumov, Pavel, Norman, Timothy J., Ramchurn, Sarvapali D., Rastegari, Bahar, Sobey, Adam, Stein, Sebastian, Tarpore, Danesh, Yazdanpanah, Vahid, Zhang, Jie
The Agents, Interaction and Complexity research group at the University of Southampton has a long track record of research in multiagent systems (MAS). We have made substantial scientific contributions across learning in MAS, game-theoretic techniques for coordinating agent systems, and formal methods for representation and reasoning. We highlight key results achieved by the group and elaborate on recent work and open research challenges in developing trustworthy autonomous systems and deploying human-centred AI systems that aim to support societal good.
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks
Liu, Zhuqing, Zhang, Xin, Khanduri, Prashant, Lu, Songtao, Liu, Jia
In recent years, decentralized bilevel optimization problems have received In recent years, fueled by the rise of machine learning and artificial increasing attention in the networking and machine learning intelligence in edge networks, decentralized bilevel optimization communities thanks to their versatility in modeling decentralized problems have received increasing attention in the networking and learning problems over peer-to-peer networks (e.g., multi-agent machine learning communities. This is due to the versatility of meta-learning, multi-agent reinforcement learning, personalized decentralized bilevel optimization in supporting many decentralized training, and Byzantine-resilient learning). However, for decentralized learning paradigms over peer-to-peer networks, such as the bilevel optimization over peer-to-peer networks with limited multi-agent versions of meta learning [22, 33, 33], hyperparameter computation and communication capabilities, how to achieve low optimization problem[24, 29], area under curve (AUC) problems sample and communication complexities are two fundamental challenges [19, 32], and reinforcement learning[9, 40]. To date, however, that remain under-explored so far. In this paper, we make there remain many challenges and open problems in decentralized the first attempt to investigate the class of decentralized bilevel bilevel learning over peer-to-peer networks. Two of the most optimization problems with nonconvex and strongly-convex structure fundamental challenges in decentralized bilevel optimization are corresponding to the outer and inner subproblems, respectively.
PlaneSDF-based Change Detection for Long-term Dense Mapping
Fu, Jiahui, Lin, Chengyuan, Taguchi, Yuichi, Cohen, Andrea, Zhang, Yifu, Mylabathula, Stephen, Leonard, John J.
The ability to process environment maps across multiple sessions is critical for robots operating over extended periods of time. Specifically, it is desirable for autonomous agents to detect changes amongst maps of different sessions so as to gain a conflict-free understanding of the current environment. In this paper, we look into the problem of change detection based on a novel map representation, dubbed Plane Signed Distance Fields (PlaneSDF), where dense maps are represented as a collection of planes and their associated geometric components in SDF volumes. Given point clouds of the source and target scenes, we propose a three-step PlaneSDF-based change detection approach: (1) PlaneSDF volumes are instantiated within each scene and registered across scenes using plane poses; 2D height maps and object maps are extracted per volume via height projection and connected component analysis. (2) Height maps are compared and intersected with the object map to produce a 2D change location mask for changed object candidates in the source scene. (3) 3D geometric validation is performed using SDF-derived features per object candidate for change mask refinement. We evaluate our approach on both synthetic and real-world datasets and demonstrate its effectiveness via the task of changed object detection. Supplementary video: https://youtu.be/oh-MQPWTwZI
Incentivising cooperation by rewarding the weakest member
Schossau, Jory, Shirmohammadi, Bamshad, Hintze, Arend
Autonomous agents that act with each other on behalf of humans are becoming more common in many social domains, such as customer service, transportation, and health care. In such social situations greedy strategies can reduce the positive outcome for all agents, such as leading to stop-and-go traffic on highways, or causing a denial of service on a communications channel. Instead, we desire autonomous decision-making for efficient performance while also considering equitability of the group to avoid these pitfalls. Unfortunately, in complex situations it is far easier to design machine learning objectives for selfish strategies than for equitable behaviors. Here we present a simple way to reward groups of agents in both evolution and reinforcement learning domains by the performance of their weakest member. We show how this yields ``fairer'' more equitable behavior, while also maximizing individual outcomes, and we show the relationship to biological selection mechanisms of group-level selection and inclusive fitness theory.
A Complete Set of Connectivity-aware Local Topology Manipulation Operations for Robot Swarms
Khateri, Koresh, Soma, Karthik, Pourgholi, Mahdi, Montazeri, Mohsen, Sabattini, Lorenzo, Beltrame, Giovanni
The topology of a robotic swarm affects the convergence speed of consensus and the mobility of the robots. In this paper, we prove the existence of a complete set of local topology manipulation operations that allow the transformation of a swarm topology. The set is complete in the sense that any other possible set of manipulation operations can be performed by a sequence of operations from our set. The operations are local as they depend only on the first and second hop neighbors' information to transform any initial spanning tree of the network's graph to any other connected tree with the same number of nodes. The flexibility provided by our method is similar to global methods that require full knowledge of the swarm network. We prove the existence of a sequence of transformations for any tree-to-tree transformation, and derive sequences of operations to form a line or star from any initial spanning tree. Our work provides a theoretical and practical framework for topological control of a swarm, establishing global properties using only local information.