Goto

Collaborating Authors

 Drones


Swarm-LIO2: Decentralized, Efficient LiDAR-inertial Odometry for UAV Swarms

arXiv.org Artificial Intelligence

Abstract--Aerial swarm systems possess immense potential in various aspects, such as cooperative exploration, target tracking, search and rescue. Efficient, accurate self and mutual state estimation are the critical preconditions for completing these swarm tasks, which remain challenging research topics. This paper proposes Swarm-LIO2: a fully decentralized, plug-andplay, computationally efficient, and bandwidth-efficient LiDARinertial odometry for aerial swarm systems. Swarm-LIO2 uses a decentralized, plug-and-play network as the communication infrastructure. Only bandwidth-efficient and low-dimensional information is exchanged, including identity, ego-state, mutual observation measurements, and global extrinsic transformations. To support the plug-and-play of new teammate participants, Swarm-LIO2 detects potential teammate UAVs and initializes the temporal offset and global extrinsic transformation all automatically. For state estimation, Swarm-details can be found in the attached video at https://youtu.be/Q7cJ9iRhlrY GPS-denied scenes, degenerated scenes for cameras or LiDARs. GPS and RTK-GPS are commonly used for self-localization in outdoor environments, as reported in previous studies [22, 23]. N recent years, multi-robot systems, especially aerial swarm systems, have exhibited great potential in many for state estimation in multi-robot systems. These methods fields, such as collaborative autonomous exploration[1, 2, 3], [24, 25, 26, 27] often rely on the stationary ground station, target tracking[4, 5, 6, 7], search and rescue[8, 9, 10], etc. resulting in a centralized system that is prone to single-pointof-failure. Although the complementary and observed teammate locations (i.e., mutual observation anchor-free UWB can provide distance measurements, it is measurements), which are enhanced by careful measurement susceptible to multi-path effects and obstacle occlusion in the modeling and temporal compensation.


Zelenskyy questions China's 'true interest' behind plan to end Russia's war

FOX News

Zelenskyy rejected the China-Brazil six-point plan to end Russia's war and questioned'true' intent. Ukrainian President Volodymyr Zelenskyy took to the podium at the 79th United Nations General Assembly (UNGA) for the third time since Russia's deadly invasion began more than two and half years ago, though this time he took direct aim at nations aiding Moscow: China, North Korea and Iran. Zelenskyy – who has long toed the line when it comes to maintaining murky geopolitical relations amid the war – for the first time called out not only the nations supplying direct arms to Moscow, but those who have remained complacent in their refusal to back Ukraine's demands that Russian President Vladimir Putin withdraw his troops. "We need to make it clear the war is over. This is the peace formula – what part of this could be unacceptable to anyone who upholds the U.N. Charter?" he questioned.


Trump assassination attempt: Inexperienced Secret Service agent flying drone called toll-free number for help

FOX News

A preliminary report on the July 13 assassination attempt on former President Trump from the Senate Committee on Homeland Security and Governmental Affairs ripped into newly revealed missteps that went into the Secret Service's planning and execution of security at the event during which a spectator was killed, two others were seriously wounded and the GOP candidate was struck on the ear. Among the key failures, an agent inexperienced with drone equipment called a toll-free tech support hotline for help after a request ahead of time for additional unmanned assets was denied, according to a preliminary summary of findings made public Wednesday. According to the committee, he had just an hour of informal training with the device. "Multiple foreseeable and preventable planning and operational failures by USSS contributed to [Thomas] Crooks' ability to carry out the assassination attempt of former President Trump on July 13," the preliminary report read. "These included unclear roles and responsibilities, insufficient coordination with state and local law enforcement, the lack of effective communications, and inoperable C-UAS systems, among many others."


Multirotor Nonlinear Model Predictive Control based on Visual Servoing of Evolving Features

arXiv.org Artificial Intelligence

This article presents a Visual Servoing Nonlinear Model Predictive Control (NMPC) scheme for autonomously tracking a moving target using multirotor Unmanned Aerial Vehicles (UAVs). The scheme is developed for surveillance and tracking of contour-based areas with evolving features. NMPC is used to manage input and state constraints, while additional barrier functions are incorporated in order to ensure system safety and optimal performance. The proposed control scheme is designed based on the extraction and implementation of the full dynamic model of the features describing the target and the state variables. Real-time simulations and experiments using a quadrotor UAV equipped with a camera demonstrate the effectiveness of the proposed strategy.


Conditional Generative Denoiser for Nighttime UAV Tracking

arXiv.org Artificial Intelligence

State-of-the-art (SOTA) visual object tracking methods have significantly enhanced the autonomy of unmanned aerial vehicles (UAVs). However, in low-light conditions, the presence of irregular real noise from the environments severely degrades the performance of these SOTA methods. Moreover, existing SOTA denoising techniques often fail to meet the real-time processing requirements when deployed as plug-and-play denoisers for UAV tracking. To address this challenge, this work proposes a novel conditional generative denoiser (CGDenoiser), which breaks free from the limitations of traditional deterministic paradigms and generates the noise conditioning on the input, subsequently removing it. To better align the input dimensions and accelerate inference, a novel nested residual Transformer conditionalizer is developed. Furthermore, an innovative multi-kernel conditional refiner is designed to pertinently refine the denoised output. Extensive experiments show that CGDenoiser promotes the tracking precision of the SOTA tracker by 18.18\% on DarkTrack2021 whereas working 5.8 times faster than the second well-performed denoiser. Real-world tests with complex challenges also prove the effectiveness and practicality of CGDenoiser. Code, video demo and supplementary proof for CGDenoier are now available at: \url{https://github.com/vision4robotics/CGDenoiser}.


Precise Interception Flight Targets by Image-based Visual Servoing of Multicopter

arXiv.org Artificial Intelligence

Interception of low-altitude intruding targets with low-cost drones equipped strapdown camera presents a competitive option. However, the malicious maneuvers by the non-cooperative target and the coupling of the camera make the task challenging. To solve this problem, an Image-Based Visual Servoing (IBVS) control algorithm based on proportional navigation guidance with field-of-view holding capability is designed. The proposed controller reduces the miss distance while improving the stability of the visual servo system during interception. Software-in-the-loop (SITL) simulation experiments show a 72.8% reduction in the circular error probability (CEP) compared to the most recent study. This improvement enhances interception accuracy from the decimeter to the centimeter level. Real-world experiments further validate the effectiveness of the proposed algorithm.


Learning with Dynamics: Autonomous Regulation of UAV Based Communication Networks with Dynamic UAV Crew

arXiv.org Artificial Intelligence

Unmanned Aerial Vehicle (UAV) based communication networks (UCNs) are a key component in future mobile networking. To handle the dynamic environments in UCNs, reinforcement learning (RL) has been a promising solution attributed to its strong capability of adaptive decision-making free of the environment models. However, most existing RL-based research focus on control strategy design assuming a fixed set of UAVs. Few works have investigated how UCNs should be adaptively regulated when the serving UAVs change dynamically. This article discusses RL-based strategy design for adaptive UCN regulation given a dynamic UAV set, addressing both reactive strategies in general UCNs and proactive strategies in solar-powered UCNs. An overview of the UCN and the RL framework is first provided. Potential research directions with key challenges and possible solutions are then elaborated. Some of our recent works are presented as case studies to inspire innovative ways to handle dynamic UAV crew with different RL algorithms.


Predictive Covert Communication Against Multi-UAV Surveillance Using Graph Koopman Autoencoder

arXiv.org Artificial Intelligence

Low Probability of Detection (LPD) communication aims to obscure the presence of radio frequency (RF) signals to evade surveillance. In the context of mobile surveillance utilizing unmanned aerial vehicles (UAVs), achieving LPD communication presents significant challenges due to the UAVs' rapid and continuous movements, which are characterized by unknown nonlinear dynamics. Therefore, accurately predicting future locations of UAVs is essential for enabling real-time LPD communication. In this paper, we introduce a novel framework termed predictive covert communication, aimed at minimizing detectability in terrestrial ad-hoc networks under multi-UAV surveillance. Our data-driven method synergistically integrates graph neural networks (GNN) with Koopman theory to model the complex interactions within a multi-UAV network and facilitating long-term predictions by linearizing the dynamics, even with limited historical data. Extensive simulation results substantiate that the predicted trajectories using our method result in at least 63%-75% lower probability of detection when compared to well-known state-of-the-art baseline approaches, showing promise in enabling low-latency covert operations in practical scenarios.


Dashing for the Golden Snitch: Multi-Drone Time-Optimal Motion Planning with Multi-Agent Reinforcement Learning

arXiv.org Artificial Intelligence

Recent innovations in autonomous drones have facilitated time-optimal flight in single-drone configurations and enhanced maneuverability in multi-drone systems through the application of optimal control and learning-based methods. However, few studies have achieved time-optimal motion planning for multi-drone systems, particularly during highly agile maneuvers or in dynamic scenarios. This paper presents a decentralized policy network for time-optimal multi-drone flight using multi-agent reinforcement learning. To strike a balance between flight efficiency and collision avoidance, we introduce a soft collision penalty inspired by optimization-based methods. By customizing PPO in a centralized training, decentralized execution (CTDE) fashion, we unlock higher efficiency and stability in training, while ensuring lightweight implementation. Extensive simulations show that, despite slight performance trade-offs compared to single-drone systems, our multi-drone approach maintains near-time-optimal performance with low collision rates. Real-world experiments validate our method, with two quadrotors using the same network as simulation achieving a maximum speed of 13.65 m/s and a maximum body rate of 13.4 rad/s in a 5.5 m * 5.5 m * 2.0 m space across various tracks, relying entirely on onboard computation.


Multi-UAV Pursuit-Evasion with Online Planning in Unknown Environments by Deep Reinforcement Learning

arXiv.org Artificial Intelligence

Multi-UAV pursuit-evasion, where pursuers aim to capture evaders, poses a key challenge for UAV swarm intelligence. Multi-agent reinforcement learning (MARL) has demonstrated potential in modeling cooperative behaviors, but most RL-based approaches remain constrained to simplified simulations with limited dynamics or fixed scenarios. Previous attempts to deploy RL policy to real-world pursuit-evasion are largely restricted to two-dimensional scenarios, such as ground vehicles or UAVs at fixed altitudes. In this paper, we address multi-UAV pursuit-evasion by considering UAV dynamics and physical constraints. We introduce an evader prediction-enhanced network to tackle partial observability in cooperative strategy learning. Additionally, we propose an adaptive environment generator within MARL training, enabling higher exploration efficiency and better policy generalization across diverse scenarios. Simulations show our method significantly outperforms all baselines in challenging scenarios, generalizing to unseen scenarios with a 100% capture rate. Finally, we derive a feasible policy via a two-stage reward refinement and deploy the policy on real quadrotors in a zero-shot manner. To our knowledge, this is the first work to derive and deploy an RL-based policy using collective thrust and body rates control commands for multi-UAV pursuit-evasion in unknown environments. The open-source code and videos are available at https://sites.google.com/view/pursuit-evasion-rl.