Drones
Real-time Planning of Minimum-time Trajectories for Agile UAV Flight
Teissing, Krystof, Novosad, Matej, Penicka, Robert, Saska, Martin
We address the challenge of real-time planning of minimum-time trajectories over multiple waypoints, onboard multirotor UAVs. Previous works demonstrated that achieving a truly time-optimal trajectory is computationally too demanding to enable frequent replanning during agile flight, especially on less powerful flight computers. Our approach overcomes this stumbling block by utilizing a point-mass model with a novel iterative thrust decomposition algorithm, enabling the UAV to use all of its collective thrust, something previous point-mass approaches could not achieve. The approach enables gravity and drag modeling integration, significantly reducing tracking errors in high-speed trajectories, which is proven through an ablation study. When combined with a new multi-waypoint optimization algorithm, which uses a gradient-based method to converge to optimal velocities in waypoints, the proposed method generates minimum-time multi-waypoint trajectories within milliseconds. The proposed approach, which we provide as open-source package, is validated both in simulation and in real-world, using Nonlinear Model Predictive Control. With accelerations of up to 3.5g and speeds over 100 km/h, trajectories generated by the proposed method yield similar or even smaller tracking errors than the trajectories generated for a full multirotor model.
Onboard Ranging-based Relative Localization and Stability for Lightweight Aerial Swarms
Li, Shushuai, Shan, Feng, Liu, Jiangpeng, Coppola, Mario, de Wagter, Christophe, de Croon, Guido C. H. E.
Lightweight aerial swarms have potential applications in scenarios where larger drones fail to operate efficiently. The primary foundation for lightweight aerial swarms is efficient relative localization, which enables cooperation and collision avoidance. Computing the real-time position is challenging due to extreme resource constraints. This paper presents an autonomous relative localization technique for lightweight aerial swarms without infrastructure by fusing ultra-wideband wireless distance measurements and the shared state information (e.g., velocity, yaw rate, height) from neighbors. This is the first fully autonomous, tiny, fast, and accurate relative localization scheme implemented on a team of 13 lightweight (33 grams) and resource-constrained (168MHz MCU with 192 KB memory) aerial vehicles. The proposed resource-constrained swarm ranging protocol is scalable, and a surprising theoretical result is discovered: the unobservability poses no issues because the state drift leads to control actions that make the state observable again. By experiment, less than 0.2m position error is achieved at the frequency of 16Hz for as many as 13 drones. The code is open-sourced, and the proposed technique is relevant not only for tiny drones but can be readily applied to many other resource-restricted robots. Video and code can be found at \textnormal{\url{https://shushuai3.github.io/autonomous-swarm/}}.
Russia rattles the nuclear sabre again, as Ukraine devastates its munitions
Russia has tailored its nuclear response doctrine to the specific threat of the long-range attacks it faces from Ukraine, even as Kyiv's forces demonstrated during the past week the devastating effect such attacks can have on Moscow's conventional war effort. Russian President Vladimir Putin recently "outlined the approaches" to a new edition of the Fundamentals of State Policy on nuclear weapons use, wrote his right-hand man, deputy head of the National Security Council Dmitry Medvedev, on Telegram on Wednesday. "A massive launch and crossing of our border with enemy aerospace weapons, including aircraft, missiles and UAVs, can under certain conditions become the basis for the use of nuclear weapons," he wrote. "Aggression against Russia by a non-nuclear-weapon state, but with the support or participation of a nuclear-weapon country, will be considered a joint attack," Medvedev added. These threat profiles are exactly tailored to describe Ukraine, which gave up nuclear weapons in 1994, but is supported by nuclear-armed states the United Kingdom, France and the United States, and which has been forbidden to use Western-supplied weapons to attack deep inside Russia.
Russia has a secret war drones project in China, intel sources say
Russia has established a weapons program in China to develop and produce long-range attack drones for use in the war against Ukraine, according to two sources from a European intelligence agency and documents reviewed by Reuters. IEMZ Kupol, a subsidiary of Russian state-owned arms company Almaz-Antey, has developed and flight-tested a new drone model called Garpiya-3 (G3) in China with the help of local specialists, according to one of the documents, a report that Kupol sent to the Russian defense ministry earlier this year outlining its work. Kupol told the defense ministry in a subsequent update that it was able to produce drones including the G3 at scale at a factory in China so the weapons could be deployed in the "special military operation" in Ukraine, the term Moscow uses for the war.
Model-Free versus Model-Based Reinforcement Learning for Fixed-Wing UAV Attitude Control Under Varying Wind Conditions
Olivares, David, Fournier, Pierre, Vasishta, Pavan, Marzat, Julien
This paper evaluates and compares the performance of model-free and model-based reinforcement learning for the attitude control of fixed-wing unmanned aerial vehicles using PID as a reference point. The comparison focuses on their ability to handle varying flight dynamics and wind disturbances in a simulated environment. Our results show that the Temporal Difference Model Predictive Control agent outperforms both the PID controller and other model-free reinforcement learning methods in terms of tracking accuracy and robustness over different reference difficulties, particularly in nonlinear flight regimes. Furthermore, we introduce actuation fluctuation as a key metric to assess energy efficiency and actuator wear, and we test two different approaches from the literature: action variation penalty and conditioning for action policy smoothness. We also evaluate all control methods when subject to stochastic turbulence and gusts separately, so as to measure their effects on tracking performance, observe their limitations and outline their implications on the Markov decision process formalism.
UAV-Assisted Self-Supervised Terrain Awareness for Off-Road Navigation
Fortin, Jean-Michel, Gamache, Olivier, Fecteau, William, Daum, Effie, Larrivรฉe-Hardy, William, Pomerleau, Franรงois, Giguรจre, Philippe
Terrain awareness is an essential milestone to enable truly autonomous off-road navigation. Accurately predicting terrain characteristics allows optimizing a vehicle's path against potential hazards. Recent methods use deep neural networks to predict traversability-related terrain properties in a self-supervised manner, relying on proprioception as a training signal. However, onboard cameras are inherently limited by their point-of-view relative to the ground, suffering from occlusions and vanishing pixel density with distance. This paper introduces a novel approach for self-supervised terrain characterization using an aerial perspective from a hovering drone. We capture terrain-aligned images while sampling the environment with a ground vehicle, effectively training a simple predictor for vibrations, bumpiness, and energy consumption. Our dataset includes 2.8 km of off-road data collected in forest environment, comprising 13 484 ground-based images and 12 935 aerial images. Our findings show that drone imagery improves terrain property prediction by 21.37 % on the whole dataset and 37.35 % in high vegetation, compared to ground robot images. We conduct ablation studies to identify the main causes of these performance improvements. We also demonstrate the real-world applicability of our approach by scouting an unseen area with a drone, planning and executing an optimized path on the ground.
SOAR: Self-supervision Optimized UAV Action Recognition with Efficient Object-Aware Pretraining
Xian, Ruiqi, Wu, Xiyang, Guan, Tianrui, Wang, Xijun, Gong, Boqing, Manocha, Dinesh
We introduce SOAR, a novel Self-supervised pretraining algorithm for aerial footage captured by Unmanned Aerial Vehicles (UAVs). We incorporate human object knowledge throughout the pretraining process to enhance UAV video pretraining efficiency and downstream action recognition performance. This is in contrast to prior works that primarily incorporate object information during the fine-tuning stage. Specifically, we first propose a novel object-aware masking strategy designed to retain the visibility of certain patches related to objects throughout the pretraining phase. Second, we introduce an object-aware loss function that utilizes object information to adjust the reconstruction loss, preventing bias towards less informative background patches. In practice, SOAR with a vanilla ViT backbone, outperforms best UAV action recognition models, recording a 9.7% and 21.4% boost in top-1 accuracy on the NEC-Drone and UAV-Human datasets, while delivering an inference speed of 18.7ms per video, making it 2x to 5x faster. Additionally, SOAR obtains comparable accuracy to prior self-supervised learning (SSL) methods while requiring 87.5% less pretraining time and 25% less memory usage
EvMAPPER: High Altitude Orthomapping with Event Cameras
Cladera, Fernando, Chaney, Kenneth, Hsieh, M. Ani, Taylor, Camillo J., Kumar, Vijay
Traditionally, unmanned aerial vehicles (UAVs) rely on CMOS-based cameras to collect images about the world below. One of the most successful applications of UAVs is to generate orthomosaics or orthomaps, in which a series of images are integrated together to develop a larger map. However, the use of CMOS-based cameras with global or rolling shutters mean that orthomaps are vulnerable to challenging light conditions, motion blur, and high-speed motion of independently moving objects under the camera. Event cameras are less sensitive to these issues, as their pixels are able to trigger asynchronously on brightness changes. This work introduces the first orthomosaic approach using event cameras. In contrast to existing methods relying only on CMOS cameras, our approach enables map generation even in challenging light conditions, including direct sunlight and after sunset.
Multi-UAV Enabled MEC Networks: Optimizing Delay through Intelligent 3D Trajectory Planning and Resource Allocation
Wang, Zhiying, Wei, Tianxi, Sun, Gang, Liu, Xinyue, Yu, Hongfang, Niyato, Dusit
Mobile Edge Computing (MEC) reduces the computational burden on terminal devices by shortening the distance between these devices and computing nodes. Integrating Unmanned Aerial Vehicles (UAVs) with enhanced MEC networks can leverage the high mobility of UAVs to flexibly adjust network topology, further expanding the applicability of MEC. However, in highly dynamic and complex real-world environments, it is crucial to balance task offloading effectiveness with algorithm performance. This paper investigates a multi-UAV communication network equipped with edge computing nodes to assist terminal users in task computation. Our goal is to reduce the task processing delay for users through the joint optimization of discrete computation modes, continuous 3D trajectories, and resource assignment. To address the challenges posed by the mixed action space, we propose a Multi-UAV Edge Computing Resource Scheduling (MUECRS) algorithm, which comprises two key components: 1) trajectory optimization, and 2) computation mode and resource management. Experimental results demonstrate our method effectively designs the 3D flight trajectories of UAVs, enabling rapid terminal coverage. Furthermore, the proposed algorithm achieves efficient resource deployment and scheduling, outperforming comparative algorithms by at least 16.7%, demonstrating superior adaptability and robustness.
Swarm-LIO2: Decentralized, Efficient LiDAR-inertial Odometry for UAV Swarms
Zhu, Fangcheng, Ren, Yunfan, Yin, Longji, Kong, Fanze, Liu, Qingbo, Xue, Ruize, Liu, Wenyi, Cai, Yixi, Lu, Guozheng, Li, Haotian, Zhang, Fu
Abstract--Aerial swarm systems possess immense potential in various aspects, such as cooperative exploration, target tracking, search and rescue. Efficient, accurate self and mutual state estimation are the critical preconditions for completing these swarm tasks, which remain challenging research topics. This paper proposes Swarm-LIO2: a fully decentralized, plug-andplay, computationally efficient, and bandwidth-efficient LiDARinertial odometry for aerial swarm systems. Swarm-LIO2 uses a decentralized, plug-and-play network as the communication infrastructure. Only bandwidth-efficient and low-dimensional information is exchanged, including identity, ego-state, mutual observation measurements, and global extrinsic transformations. To support the plug-and-play of new teammate participants, Swarm-LIO2 detects potential teammate UAVs and initializes the temporal offset and global extrinsic transformation all automatically. For state estimation, Swarm-details can be found in the attached video at https://youtu.be/Q7cJ9iRhlrY GPS-denied scenes, degenerated scenes for cameras or LiDARs. GPS and RTK-GPS are commonly used for self-localization in outdoor environments, as reported in previous studies [22, 23]. N recent years, multi-robot systems, especially aerial swarm systems, have exhibited great potential in many for state estimation in multi-robot systems. These methods fields, such as collaborative autonomous exploration[1, 2, 3], [24, 25, 26, 27] often rely on the stationary ground station, target tracking[4, 5, 6, 7], search and rescue[8, 9, 10], etc. resulting in a centralized system that is prone to single-pointof-failure. Although the complementary and observed teammate locations (i.e., mutual observation anchor-free UWB can provide distance measurements, it is measurements), which are enhanced by careful measurement susceptible to multi-path effects and obstacle occlusion in the modeling and temporal compensation.