Agents
VIRIS: Simulating indoor airborne transmission combining architectural design and people movement
Xue, Yidan, Jabi, Wassim, Woolley, Thomas E., Kaouri, Katerina
A Viral Infection Risk Indoor Simulator (VIRIS) has been developed to quickly assess and compare mitigations for airborne disease spread. This agent-based simulator combines people movement in an indoor space, viral transmission modelling and detailed architectural design, and it is powered by topologicpy, an open-source Python library. VIRIS generates very fast predictions of the viral concentration and the spatiotemporal infection risk for individuals as they move through a given space. The simulator is validated with data from a courtroom superspreader event. A sensitivity study for unknown parameter values is also performed. We compare several non-pharmaceutical interventions (NPIs) issued in UK government guidance, for two indoor settings: a care home and a supermarket. Additionally, we have developed the user-friendly VIRIS web app that allows quick exploration of diverse scenarios of interest and visualisation, allowing policymakers, architects and space managers to easily design or assess infection risk in an indoor space.
Control-Theoretic Analysis of Shared Control Systems
Aronson, Reuben M., Short, Elaine Schaertl
Users of shared control systems change their behavior in the presence of assistance, which conflicts with assumpts about user behavior that some assistance methods make. In this paper, we propose an analysis technique to evaluate the user's experience with the assistive systems that bypasses required assumptions: we model the assistance as a dynamical system that can be analyzed using control theory techniques. We analyze the shared autonomy assistance algorithm and make several observations: we identify a problem with runaway goal confidence and propose a system adjustment to mitigate it, we demonstrate that the system inherently limits the possible actions available to the user, and we show that in a simplified setting, the effect of the assistance is to drive the system to the convex hull of the goals and, once there, add a layer of indirection between the user control and the system behavior. We conclude by discussing the possible uses of this analysis for the field.
Advancing the Search Frontier with AI Agents
The IR and information science communities have long studied tasks in search26 and many information-seeking models consider the role of tasks directly.3,11 Prior research has explored the different stages of task execution (for example, pre-focus, focus formation, post-focus), task levels, task facets, tasks defined on intents (for example, informational, transactional, and navigational; well-defined or ill-defined; and lookup, learn, or investigate), the hierarchical structure of tasks, the characteristics of tasks, the attributes of task-searcher interaction (for example, task difficulty), and, a focus of this article, task complexity.8 As a useful framing device to help conceptualize tasks and develop system support for them, tasks can be represented as trees comprising macrotasks (high-level goals), subtasks (specific components of those goals), and actions (specific steps taken by searchers toward the completion of those components).26 Figure 1 presents an example of a "task tree" for a task involving an upcoming vacation to Paris. Included are examples of macrotasks, subtasks, and actions.
Range-based Multi-Robot Integrity Monitoring Against Cyberattacks and Faults: An Anchor-Free Approach
Vijay, Vishnu, Pant, Kartik A., Cho, Minhyun, Guo, Yifan, Goppert, James M., Hwang, Inseok
Coordination of multi-robot systems (MRSs) relies on efficient sensing and reliable communication among the robots. However, the sensors and communication channels of these robots are often vulnerable to cyberattacks and faults, which can disrupt their individual behavior and the overall objective of the MRS. In this work, we present a multi-robot integrity monitoring framework that utilizes inter-robot range measurements to (i) detect the presence of cyberattacks or faults affecting the MRS, (ii) identify the affected robot(s), and (iii) reconstruct the resulting localization error of these robot(s). The proposed iterative algorithm leverages sequential convex programming and alternating direction of multipliers method to enable real-time and distributed implementation. Our approach is validated using numerical simulations and demonstrated using PX4-SiTL in Gazebo on an MRS, where certain agents deviate from their desired position due to a GNSS spoofing attack. Furthermore, we demonstrate the scalability and interoperability of our algorithm through mixed-reality experiments by forming a heterogeneous MRS comprising real Crazyflie UAVs and virtual PX4-SiTL UAVs working in tandem.
World Models Increase Autonomy in Reinforcement Learning
Yang, Zhao, Moerland, Thomas M., Preuss, Mike, Plaat, Aske, Hu, Edward S.
Reinforcement learning (RL) is an appealing paradigm for training intelligent agents, enabling policy acquisition from the agent's own autonomously acquired experience. However, the training process of RL is far from automatic, requiring extensive human effort to reset the agent and environments. To tackle the challenging reset-free setting, we first demonstrate the superiority of model-based (MB) RL methods in such setting, showing that a straightforward adaptation of MBRL can outperform all the prior state-of-the-art methods while requiring less supervision. We then identify limitations inherent to this direct extension and propose a solution called model-based reset-free (MoReFree) agent, which further enhances the performance. MoReFree adapts two key mechanisms, exploration and policy learning, to handle reset-free tasks by prioritizing task-relevant states. It exhibits superior data-efficiency across various reset-free tasks without access to environmental reward or demonstrations while significantly outperforming privileged baselines that require supervision. Our findings suggest model-based methods hold significant promise for reducing human effort in RL.
Hokoff: Real Game Dataset from Honor of Kings and its Offline Reinforcement Learning Benchmarks
Qu, Yun, Wang, Boyuan, Shao, Jianzhun, Jiang, Yuhang, Chen, Chen, Ye, Zhenbin, Liu, Lin, Yang, Junfeng, Lai, Lin, Qin, Hongyang, Deng, Minwen, Zhuo, Juchao, Ye, Deheng, Fu, Qiang, Yang, Wei, Yang, Guang, Huang, Lanxiao, Ji, Xiangyang
The advancement of Offline Reinforcement Learning (RL) and Offline Multi-Agent Reinforcement Learning (MARL) critically depends on the availability of high-quality, pre-collected offline datasets that represent real-world complexities and practical applications. However, existing datasets often fall short in their simplicity and lack of realism. To address this gap, we propose Hokoff, a comprehensive set of pre-collected datasets that covers both offline RL and offline MARL, accompanied by a robust framework, to facilitate further research. This data is derived from Honor of Kings, a recognized Multiplayer Online Battle Arena (MOBA) game known for its intricate nature, closely resembling real-life situations. Utilizing this framework, we benchmark a variety of offline RL and offline MARL algorithms. We also introduce a novel baseline algorithm tailored for the inherent hierarchical action space of the game. We reveal the incompetency of current offline RL approaches in handling task complexity, generalization and multi-task learning.
Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework
Han, Xiao, Zhu, Chen, Zhao, Xiangyu, Zhu, Hengshu
Visual geo-localization demands in-depth knowledge and advanced reasoning skills to associate images with real-world geographic locations precisely. In general, traditional methods based on data-matching are hindered by the impracticality of storing adequate visual records of global landmarks. Recently, Large Vision-Language Models (LVLMs) have demonstrated the capability of geo-localization through Visual Question Answering (VQA), enabling a solution that does not require external geo-tagged image records. However, the performance of a single LVLM is still limited by its intrinsic knowledge and reasoning capabilities. Along this line, in this paper, we introduce a novel visual geo-localization framework called \name\ that integrates the inherent knowledge of multiple LVLM agents via inter-agent communication to achieve effective geo-localization of images. Furthermore, our framework employs a dynamic learning strategy to optimize the communication patterns among agents, reducing unnecessary discussions among agents and improving the efficiency of the framework. To validate the effectiveness of the proposed framework, we construct GeoGlobe, a novel dataset for visual geo-localization tasks. Extensive testing on the dataset demonstrates that our approach significantly outperforms state-of-the-art methods.
Multi-Agent Based Simulation for Decentralized Electric Vehicle Charging Strategies and their Impacts
Christensen, Kristoffer, Jørgensen, Bo Nørregaard, Ma, Zheng Grace
The growing shift towards a Smart Grid involves integrating numerous new digital energy solutions into the energy ecosystems to address problems arising from the transition to carbon neutrality, particularly in linking the electricity and transportation sectors. Yet, this shift brings challenges due to mass electric vehicle adoption and the lack of methods to adequately assess various EV charging algorithms and their ecosystem impacts. This paper introduces a multi-agent based simulation model, validated through a case study of a Danish radial distribution network serving 126 households. The study reveals that traditional charging leads to grid overload by 2031 at 67% EV penetration, while decentralized strategies like Real-Time Pricing could cause overloads as early as 2028. The developed multi-agent based simulation demonstrates its ability to offer detailed, hourly analysis of future load profiles in distribution grids, and therefore, can be applied to other prospective scenarios in similar energy systems. Keywords: multi-agent based simulation, multi-agent systems, agent-based modeling, electric vehicle, charging strategies.
Approval-Based Committee Voting under Incomplete Information
Imber, Aviram, Israel, Jonas, Brill, Markus, Kimelfeld, Benny
Approval-based committee (ABC) voting represents a well-studied multiwinner election setting, where a subset of candidates of a predetermined size, a so-called committee, needs to be chosen based on the approval preferences of a set of voters [23]. Traditionally, ABC voting is studied in the context where we know, for each voter and each candidate, whether the voter approves the candidate or not. In this paper, we investigate the situation where the approval information is incomplete. Specifically, we assume that each voter is associated with a set of approved candidates, a set of disapproved candidates, and a set of candidates where the voter's stand is unknown, hereafter referred to as the unknown candidates. Moreover, we may have (partial) ordinal information on voters' preferences among the unknown candidates, restricting the "valid" completions of voters' approval sets. When the number of candidates is large, unknown candidates are likely to exist because voters are not aware of or not familiar with, and therefore cannot evaluate, all candidates. In particular, this holds in scenarios where candidates join the election over time, and voter preferences over new candidates have not been elicited [16].
Optimization of Multi-Agent Flying Sidekick Traveling Salesman Problem over Road Networks
The mixed truck-drone delivery systems have attracted increasing attention for last-mile logistics, but real-world complexities demand a shift from single-agent, fully connected graph models to multi-agent systems operating on actual road networks. We introduce the multi-agent flying sidekick traveling salesman problem (MA-FSTSP) on road networks, extending the single truck-drone model to multiple trucks, each carrying multiple drones while considering full road networks for truck restrictions and flexible drone routes. We propose a mixed-integer linear programming model and an efficient three-phase heuristic algorithm for this NP-hard problem. Our approach decomposes MA-FSTSP into manageable subproblems of one truck with multiple drones. Then, it computes the routes for trucks without drones in subproblems, which are used in the final phase as heuristics to help optimize drone and truck routes simultaneously. Extensive numerical experiments on Manhattan and Boston road networks demonstrate our algorithm's superior effectiveness and efficiency, significantly outperforming both column generation and variable neighborhood search baselines in solution quality and computation time. Notably, our approach scales to more than 300 customers within a 5-minute time limit, showcasing its potential for large-scale, real-world logistics applications.