software stack
Testing and Evaluation of Underwater Vehicle Using Hardware-In-The-Loop Simulation with HoloOcean
Meyers, Braden, Mangelson, Joshua G.
Testing marine robotics systems in controlled environments before field tests is challenging, especially when acoustic-based sensors and control surfaces only function properly underwater. Deploying robots in indoor tanks and pools often faces space constraints that complicate testing of control, navigation, and perception algorithms at scale. Recent developments of high-fidelity underwater simulation tools have the potential to address these problems. We demonstrate the utility of the recently released HoloOcean 2.0 simulator with improved dynamics for torpedo AUV vehicles and a new ROS 2 interface. We have successfully demonstrated a Hardware-in-the-Loop (HIL) and Software-in-the-Loop (SIL) setup for testing and evaluating a CougUV torpedo autonomous underwater vehicle (AUV) that was built and developed in our lab. With this HIL and SIL setup, simulations are run in HoloOcean using a ROS 2 bridge such that simulated sensor data is sent to the CougUV (mimicking sensor drivers) and control surface commands are sent back to the simulation, where vehicle dynamics and sensor data are calculated. We compare our simulated results to real-world field trial results.
- North America > United States > California > Monterey County > Monterey (0.04)
- Europe > France (0.04)
- Asia > Japan > Honshū > Tōhoku > Miyagi Prefecture > Sendai (0.04)
- Asia > Japan > Honshū > Kansai > Kyoto Prefecture > Kyoto (0.04)
TUM Teleoperation: Open Source Software for Remote Driving and Assistance of Automated Vehicles
Kerbl, Tobias, Brecht, David, Gehrke, Nils, Karunainayagam, Nijinshan, Krauss, Niklas, Pfab, Florian, Taupitz, Richard, Trautmannsheimer, Ines, Su, Xiyan, Wolf, Maria-Magdalena, Diermeyer, Frank
Abstract-- T eleoperation is a key enabler for future mobility, supporting Automated V ehicles in rare and complex scenarios beyond the capabilities of their automation. Despite ongoing research, no open source software currently combines Remote Driving, e.g., via steering wheel and pedals, Remote Assistance through high-level interaction with automated driving software modules, and integration with a real-world vehicle for practical testing. T o address this gap, we present a modular, open source teleoperation software stack that can interact with an automated driving software, e.g., Autoware, enabling Remote Assistance and Remote Driving. The software features standardized interfaces for seamless integration with various real-world and simulation platforms, while allowing for flexible design of the human-machine interface. The system is designed for modularity and ease of extension, serving as a foundation for collaborative development on individual software components as well as realistic testing and user studies. T o demonstrate the applicability of our software, we evaluated the latency and performance of different vehicle platforms in simulation and real-world. Teleoperation enables remote support of robots over mobile networks, allowing humans to handle tasks that cannot be fully automated. In the field of intelligent vehicles, tele-operation has gained traction, with companies like Fernride and V ay deploying remote driving solutions for logistics and car sharing, gathering significant funding [1, 2]. Tele-operation also supports Automated V ehicles (A Vs) during disengagements, as seen with Waymo and Zoox, which rely on Remote Operators (ROs) when A Vs cannot resolve a scenario [3, 4].
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- North America > United States > Hawaii (0.04)
- Europe > Switzerland (0.04)
- Transportation > Ground > Road (1.00)
- Automobiles & Trucks (1.00)
- Information Technology > Robotics & Automation (0.69)
- Information Technology > Software (1.00)
- Information Technology > Artificial Intelligence > Robots > Autonomous Vehicles (1.00)
A Modular and Scalable System Architecture for Heterogeneous UAV Swarms Using ROS 2 and PX4-Autopilot
Pommeranz, Robert, Tebbe, Kevin, Heynicke, Ralf, Scholl, Gerd
In this paper a modular and scalable architecture for heterogeneous swarm-based Counter Unmanned Aerial Systems (C-UASs) built on PX4-Autopilot and Robot Operating System 2 (ROS 2) framework is presented. The proposed architecture emphasizes seamless integration of hardware components by introducing independent ROS 2 nodes for each component of a Unmanned Aerial Vehicle (UAV). Communication between swarm participants is abstracted in software, allowing the use of various technologies without architectural changes. Key functionalities are supported, e.g. leader following and formation flight to maneuver the swarm. The system also allows computer vision algorithms to be integrated for the detection and tracking of UAVs. Additionally, a ground station control is integrated for the coordination of swarm operations. Swarm-based Unmanned Aerial System (UAS) architecture is verified within a Gazebo simulation environment but also in real-world demonstrations.
- Europe > Germany > Hamburg (0.05)
- North America > United States > Pennsylvania > Allegheny County > Pittsburgh (0.04)
- Europe > Germany > Lower Saxony > Oldenburg (0.04)
- Asia > Singapore > Central Region > Singapore (0.04)
- Aerospace & Defense (0.90)
- Transportation > Infrastructure & Services (0.70)
- Transportation > Air (0.70)
- Information Technology > Security & Privacy (0.69)
Approaching Current Challenges in Developing a Software Stack for Fully Autonomous Driving
Sagmeister, Simon, Hoffmann, Simon, Betz, Tobias, Ebner, Dominic, Esser, Daniel, Lienkamp, Markus
Personal use of this material is permitted. Abstract -- Autonomous driving is a complex undertaking. A common approach is to break down the driving task into individual subtasks through modularization. These sub-modules are usually developed and published separately. However, if these individually developed algorithms have to be combined again to form a full-stack autonomous driving software, this poses particular challenges. Drawing upon our practical experience in developing the software of TUM Autonomous Motorsport, we have identified and derived these challenges in developing an autonomous driving software stack within a scientific environment. We do not focus on the specific challenges of individual algorithms but on the general difficulties that arise when deploying research algorithms on real-world test vehicles. T o overcome these challenges, we introduce strategies that have been effective in our development approach. We additionally provide open-source implementations that enable these concepts on GitHub. As a result, this paper's contributions will simplify future full-stack autonomous driving projects, which are essential for a thorough evaluation of the individual algorithms. Autonomous driving is a rapidly growing research field with a continuously increasing number of publications [1]. However, only a few algorithms and approaches have been deployed in real-world applications. A recent review paper [2] shows that out of 111 publications in the area of motion planning and vehicle control, only 44 % have been deployed in an autonomous driving software stack.
- Asia > South Korea (0.14)
- North America > United States > California > Los Angeles County > Los Angeles (0.14)
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.05)
- (6 more...)
- Transportation > Ground > Road (1.00)
- Leisure & Entertainment > Sports > Motorsports (1.00)
- Information Technology > Robotics & Automation (1.00)
- Automobiles & Trucks (1.00)
Towards Safe Autonomous Driving: A Real-Time Safeguarding Concept for Motion Planning Algorithms
Moller, Korbinian, Neher, Rafael, Seegert, Marvin, Betz, Johannes
Ensuring the functional safety of motion planning modules in autonomous vehicles remains a critical challenge, especially when dealing with complex or learning-based software. Online verification has emerged as a promising approach to monitor such systems at runtime, yet its integration into embedded real-time environments remains limited. This work presents a safeguarding concept for motion planning that extends prior approaches by introducing a time safeguard. While existing methods focus on geometric and dynamic feasibility, our approach additionally monitors the temporal consistency of planning outputs to ensure timely system response. A prototypical implementation on a real-time operating system evaluates trajectory candidates using constraint-based feasibility checks and cost-based plausibility metrics. Preliminary results show that the safeguarding module operates within real-time bounds and effectively detects unsafe trajectories. However, the full integration of the time safeguard logic and fallback strategies is ongoing. This study contributes a modular and extensible framework for runtime trajectory verification and highlights key aspects for deployment on automotive-grade hardware. Future work includes completing the safeguarding logic and validating its effectiveness through hardware-in-the-loop simulations and vehicle-based testing. The code is available at: https://github.com/TUM-AVS/motion-planning-supervisor
- Europe > Switzerland > Geneva > Geneva (0.04)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- North America > United States > California (0.04)
- Information Technology > Robotics & Automation (1.00)
- Automobiles & Trucks (1.00)
- Transportation > Ground > Road (0.83)
SoccerDiffusion: Toward Learning End-to-End Humanoid Robot Soccer from Gameplay Recordings
Vahl, Florian, Griepenburg, Jörn, Gutsche, Jan, Güldenstein, Jasper, Zhang, Jianwei
This paper introduces SoccerDiffusion, a transformer-based diffusion model designed to learn end-to-end control policies for humanoid robot soccer directly from real-world gameplay recordings. Using data collected from RoboCup competitions, the model predicts joint command trajectories from multi-modal sensor inputs, including vision, proprioception, and game state. We employ a distillation technique to enable real-time inference on embedded platforms that reduces the mul-tistep diffusion process to a single step. Our results demonstrate the model's ability to replicate complex motion behaviors such as walking, kicking, and fall recovery both in simulation and on physical robots. Although high-level tactical behavior remains limited, this work provides a robust foundation for subsequent reinforcement learning or preference optimization methods. We release the dataset, pretrained models, and code under: https://bit-bots.github.io/SoccerDiffusion
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- Europe > Germany > Hamburg (0.04)
- Asia > China (0.04)
Deep Recommender Models Inference: Automatic Asymmetric Data Flow Optimization
Ruggeri, Giuseppe, Andri, Renzo, Pagliari, Daniele Jahier, Cavigelli, Lukas
Deep Recommender Models (DLRMs) inference is a fundamental AI workload accounting for more than 79% of the total AI workload in Meta's data centers. DLRMs' performance bottleneck is found in the embedding layers, which perform many random memory accesses to retrieve small embedding vectors from tables of various sizes. We propose the design of tailored data flows to speedup embedding look-ups. Namely, we propose four strategies to look up an embedding table effectively on one core, and a framework to automatically map the tables asymmetrically to the multiple cores of a SoC. We assess the effectiveness of our method using the Huawei Ascend AI accelerators, comparing it with the default Ascend compiler, and we perform high-level comparisons with Nvidia A100. Results show a speed-up varying from 1.5x up to 6.5x for real workload distributions, and more than 20x for extremely unbalanced distributions. Furthermore, the method proves to be much more independent of the query distribution than the baseline.
- Europe > Switzerland > Zürich > Zürich (0.15)
- Europe > Italy > Piedmont > Turin Province > Turin (0.04)
The Autonomous Software Stack of the FRED-003C: The Development That Led to Full-Scale Autonomous Racing
Demeter, Zalán, Puskás, Levente, Kovács, Balázs, Matkovics, Ádám, Nádas, Martin, Tuba, Balázs, Farkas, Zsolt, Bogár-Németh, Ármin, Bári, Gergely
Scientific development often takes place in the context of research projects carried out by dedicated students during their time at university. In the field of self-driving software research, the Formula Student Driverless competitions are an excellent platform to promote research and attract young engineers. This article presents the software stack developed by BME Formula Racing Team, that formed the foundation of the development that ultimately led us to full-scale autonomous racing. The experience we gained here contributes greatly to our successful participation in the Abu Dhabi Autonomous Racing League. We therefore think it is important to share the system we used, providing a valuable starting point for other ambitious students. We provide a detailed description of the software pipeline we used, including a brief description of the hardware-software architecture. Furthermore, we introduce the methods that we developed for the modules that implement perception; localisation and mapping, planning, and control tasks.
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.24)
- Europe > Germany (0.05)
- North America > United States (0.04)
- (2 more...)
- Automobiles & Trucks (0.68)
- Transportation (0.46)
HALO: Fault-Tolerant Safety Architecture For High-Speed Autonomous Racing
Harder, Aron, Kulkarni, Amar, Behl, Madhur
The field of high-speed autonomous racing has seen significant advances in recent years, with the rise of competitions such as RoboRace and the Indy Autonomous Challenge providing a platform for researchers to develop software stacks for autonomous race vehicles capable of reaching speeds in excess of 170 mph. Ensuring the safety of these vehicles requires the software to continuously monitor for different faults and erroneous operating conditions during high-speed operation, with the goal of mitigating any unreasonable risks posed by malfunctions in sub-systems and components. This paper presents a comprehensive overview of the HALO safety architecture, which has been implemented on a full-scale autonomous racing vehicle as part of the Indy Autonomous Challenge. The paper begins with a failure mode and criticality analysis of the perception, planning, control, and communication modules of the software stack. Specifically, we examine three different types of faults - node health, data health, and behavioral-safety faults. To mitigate these faults, the paper then outlines HALO safety archetypes and runtime monitoring methods. Finally, the paper demonstrates the effectiveness of the HALO safety architecture for each of the faults, through real-world data gathered from autonomous racing vehicle trials during multi-agent scenarios.
- Overview (0.68)
- Research Report (0.50)
- Leisure & Entertainment > Sports > Motorsports (1.00)
- Automobiles & Trucks (1.00)
- Transportation > Ground > Road (0.93)
Toward a Cohesive AI and Simulation Software Ecosystem for Scientific Innovation
Heroux, Michael A., Shende, Sameer, McInnes, Lois Curfman, Gamblin, Todd, Willenbring, James M.
ParaTools, Inc. Sameer Shende, ParaTools, Inc. Lois Curfman McInnes, Argonne National Laboratory Todd Gamblin, Lawrence Livermore National Laboratory James M. Willenbring, Sandia National Laboratories In this document, we outline key considerations for the next-generation software stack that will support scientific applications integrating AI and modeling & simulation (ModSim) to provide a unified AI/ModSim software stack. The scientific computing community needs a cohesive AI/ModSim software stack. This AI/ModSim stack must support binary distributions to enable emerging scientific workflows. A Cohesive Software Stack for AI and Modeling & Simulation To address future scientific challenges, the next-generation scientific software stack must provide a cohesive portfolio of libraries and tools that facilitate AI and ModSim approaches. As scientific research becomes increasingly interdisciplinary, scientists require both of these toolsets to address complex, data-rich problems in problem domains such as climate modeling, material discovery, and energy optimization.
- Energy (1.00)
- Government > Regional Government > North America Government > United States Government (0.49)