Search-and-rescue (SaR) in unknown environments requires precise, optimal, and fast decisions. Robots are promising candidates for autonomously performing SaR tasks in unknown environments. While humans use their heuristics to effectively deal with uncertainties, optimisation of multiple objectives in the presence of physical and control constraints is a mathematical challenge that requires machine computations. Thus having both human-inspired and mathematical control capabilities is desired for SaR robots. Moreover, coordinating the decisions of robots with little computation cost in large-scale SaR missions is an open challenge. Finally, in real-life data perceived by SaR robots may be prone to uncertainties. We introduce a hierarchical multi-agent control architecture that exploits non-homogeneous and imperfect perception capabilities of SaR robots, as well as the computational efficiency and robustness to failure of decentralised control methods and global performance improvement of centralised control methods. The integrated structure of the proposed control framework allows to combine human-inspired and mathematical decision making methods in a coordinated and computationally efficient way. The results of various computer-based simulations show that while the area coverage of the proposed approach is comparable to existing heuristic methods that are particularly developed for coverage-oriented SaR, the efficiency of the introduced approach in locating the trapped victims is significantly higher. Furthermore, with comparable computation times, the proposed control approach successfully avoids potential conflicts that exist in non-cooperative methods. These results confirm that the proposed multi-agent control system is capable of combining coverage-oriented and target-oriented SaR in a balanced and coordinated way.

We present a framework to integrate tensor network (TN) methods with reinforcement learning (RL) for solving dynamical optimisation tasks. We consider the RL actor-critic method, a model-free approach for solving RL problems, and introduce TNs as the approximators for its policy and value functions. Our "actor-critic with tensor networks" (ACTeN) method is especially well suited to problems with large and factorisable state and action spaces. As an illustration of the applicability of ACTeN we solve the exponentially hard task of sampling rare trajectories in two paradigmatic stochastic models, the East model of glasses and the asymmetric simple exclusion process (ASEP), the latter being particularly challenging to other methods due to the absence of detailed balance. With substantial potential for further integration with the vast array of existing RL methods, the approach introduced here is promising both for applications in physics and to multi-agent RL problems more generally.

The need for high-level autonomy and robustness of autonomous systems for missions in dynamic and remote environment has pushed developers to come up with new software architectures. A common architecture style is to summarize the capabilities of the robotic system into elementary actions, called skills, on top of which a skill management layer is implemented to structure, test and control the functional layer. However, current available verification tools only provide either mission-specific verification or verification on a model that does not replicate the actual execution of the system, which makes it difficult to ensure its robustness to unexpected events. To that end, a tool, SkiNet, has been developed to transform the skill-based architecture of a system into a Petri net modeling the state-machine behaviors of the skills and the resources they handle. The Petri net allows the use of model-checking, such as Linear Temporal Logic (LTL) or Computational Tree Logic (CTL), for the user to analyze and verify the model of the system.

In decentralized multi-robot navigation, the agents lack the world knowledge to make safe and (near-)optimal plans reliably and make their decisions on their neighbors' observable states. We present a reinforcement learning based multi-agent navigation algorithm that performs inter-agent communications. In order to deal with the variable number of neighbors for each agent, we use a multi-head self-attention mechanism to encode neighbor information and create a fixed-length observation vector. We pose communication selection as a link prediction problem, where the network predicts whether communication is necessary given the observable information. The communicated information augments the observed neighbor information and is used to select a suitable navigation plan. We highlight the benefits of our approach by performing safe and efficient navigation among multiple robots in dense and challenging benchmarks. We also compare the performance with other learning-based methods and highlight improvements in terms of fewer collisions and time-to-goal in dense scenarios.

This paper describes (R)ules (o)f (T)he (R)oad (A)dvisor, an agent that provides recommended and possible actions to be generated from a set of human-level rules. We describe the architecture and design of RoTRA, both formally and with an example. Specifically, we use RoTRA to formalise and implement the UK "Rules of the Road", and describe how this can be incorporated into autonomous cars such that they can reason internally about obeying the rules of the road. In addition, the possible actions generated are annotated to indicate whether the rules state that the action must be taken or that they only recommend that the action should be taken, as per the UK Highway Code (Rules of The Road). The benefits of utilising this system include being able to adapt to different regulations in different jurisdictions; allowing clear traceability from rules to behaviour, and providing an external automated accountability mechanism that can check whether the rules were obeyed in some given situation. A simulation of an autonomous car shows, via a concrete example, how trust can be built by putting the autonomous vehicle through a number of scenarios which test the car's ability to obey the rules of the road. Autonomous cars that incorporate this system are able to ensure that they are obeying the rules of the road and external (legal or regulatory) bodies can verify that this is the case, without the vehicle or its manufacturer having to expose their source code or make their working transparent, thus allowing greater trust between car companies, jurisdictions, and the general public.

Autonomous Systems (AS) like Humanoid Robots, Autonomous Vehicles, or Unmanned Aerial Vehicles are becoming increasingly complex and need to interact with dynamic environments and with each other. For this reason, robots require tools to enable advanced perception and understanding of the environment, or capabilities to operate in complex situations. Artificial Intelligence is extending the capability of perception and action of the agents and allows robots to operate in environments not suitable for robots just a few years ago. In most common scenarios the complexity of the environment requires to the robot to have different skills, the capability of different actions, and hence also a certain degree of reasoning and understanding of which action to take and when. A relevant example could be an urban road, with car, pedestrian, and signals.

The Robot Operating System (ROS) is a widely used framework for building robotic systems. It offers a wide variety of reusable packages and a pattern for new developments. It is up to developers how to combine these elements and integrate them with decision-making for autonomous behavior. The feature of such decision-making that is in general valued the most is safety assurance. In this research preview, we present a formal approach for generating safe autonomous decision-making in ROS. We first describe how to improve our existing static verification approach to verify multi-goal multi-agent decision-making. After that, we describe how to transition from the improved static verification approach to the proposed runtime verification approach. An initial implementation of this research proposal yields promising results.

A highly autonomous system (HAS) has to assess the situation it is in and derive beliefs, based on which, it decides what to do next. The beliefs are not solely based on the observations the HAS has made so far, but also on general insights about the world, in which the HAS operates. These insights have either been built in the HAS during design or are provided by trusted sources during its mission. Although its beliefs may be imprecise and might bear flaws, the HAS will have to extrapolate the possible futures in order to evaluate the consequences of its actions and then take its decisions autonomously. In this paper, we formalize an autonomous decisive system as a system that always chooses actions that it currently believes are the best. We show that it can be checked whether an autonomous decisive system can be built given an application domain, the dynamically changing knowledge base and a list of LTL mission goals. We moreover can synthesize a belief formation for an autonomous decisive system. For the formal characterization, we use a doxastic framework for safety-critical HASs where the belief formation supports the HAS's extrapolation.

Imagine you are about to sit down to play a game with a friend. But this isn't just any friend -- it's a computer program that doesn't know the rules of the game. It does, however, understand that it has a goal, and that goal is to win. Because this friend doesn't know the rules, it starts by making random moves. Some of them make absolutely no sense, and winning for you is easy.

Homeostasis keeps animals alive; it is a fundamental process that allows animals to adapt quickly to their environment. Artificial homeostasis can be used to help robots adapt to changing environments. Previous attempts at developing artificial homeostasis for robots were driven by mimicry of the biochemical machinery that drives homeostasis in humans. By considering homeostasis from a cognitive perspective, we develop a comparatively simple robot controller named CogSis (COGnitive HomeostaSIS) and demonstrate that it can provide homeostasis to a robot, even when there are conflicting needs. We present experiments showing that a robot running CogSis is able to learn from previous experiences and use them to influence future behaviour; can maintain its charge level while attending to another task (warming itself in an area separate from the charging station); and is able to maintain its charge level while avoiding a conflicting need (keeping cool, when the charging station is placed in a hot region of the environment). Results are presented in simulation and from a real robot platform.