Drones
Defining and Evaluating Physical Safety for Large Language Models
Tang, Yung-Chen, Chen, Pin-Yu, Ho, Tsung-Yi
Large Language Models (LLMs) are increasingly used to control robotic systems such as drones, but their risks of causing physical threats and harm in real-world applications remain unexplored. Our study addresses the critical gap in evaluating LLM physical safety by developing a comprehensive benchmark for drone control. We classify the physical safety risks of drones into four categories: (1) human-targeted threats, (2) object-targeted threats, (3) infrastructure attacks, and (4) regulatory violations. Our evaluation of mainstream LLMs reveals an undesirable trade-off between utility and safety, with models that excel in code generation often performing poorly in crucial safety aspects. Furthermore, while incorporating advanced prompt engineering techniques such as In-Context Learning and Chain-of-Thought can improve safety, these methods still struggle to identify unintentional attacks. In addition, larger models demonstrate better safety capabilities, particularly in refusing dangerous commands. Our findings and benchmark can facilitate the design and evaluation of physical safety for LLMs.
Heterogeneous Multi-robot Task Allocation for Long-Endurance Missions in Dynamic Scenarios
We present a framework for Multi-Robot Task Allocation (MRTA) in heterogeneous teams performing long-endurance missions in dynamic scenarios. Given the limited battery of robots, especially in the case of aerial vehicles, we allow for robot recharges and the possibility of fragmenting and/or relaying certain tasks. We also address tasks that must be performed by a coalition of robots in a coordinated manner. Given these features, we introduce a new class of heterogeneous MRTA problems which we analyze theoretically and optimally formulate as a Mixed-Integer Linear Program. We then contribute a heuristic algorithm to compute approximate solutions and integrate it into a mission planning and execution architecture capable of reacting to unexpected events by repairing or recomputing plans online. Our experimental results show the relevance of our newly formulated problem in a realistic use case for inspection with aerial robots. We assess the performance of our heuristic solver in comparison with other variants and with exact optimal solutions in small-scale scenarios. In addition, we evaluate the ability of our replanning framework to repair plans online.
Toward Integrating Semantic-aware Path Planning and Reliable Localization for UAV Operations
Canh, Thanh Nguyen, Ngo, Huy-Hoang, HoangVan, Xiem, Chong, Nak Young
Localization is one of the most crucial tasks for Unmanned Aerial Vehicle systems (UAVs) directly impacting overall performance, which can be achieved with various sensors and applied to numerous tasks related to search and rescue operations, object tracking, construction, etc. However, due to the negative effects of challenging environments, UAVs may lose signals for localization. In this paper, we present an effective path-planning system leveraging semantic segmentation information to navigate around texture-less and problematic areas like lakes, oceans, and high-rise buildings using a monocular camera. We introduce a real-time semantic segmentation architecture and a novel keyframe decision pipeline to optimize image inputs based on pixel distribution, reducing processing time. A hierarchical planner based on the Dynamic Window Approach (DWA) algorithm, integrated with a cost map, is designed to facilitate efficient path planning. The system is implemented in a photo-realistic simulation environment using Unity, aligning with segmentation model parameters. Comprehensive qualitative and quantitative evaluations validate the effectiveness of our approach, showing significant improvements in the reliability and efficiency of UAV localization in challenging environments.
Russia-Ukraine war: List of key events, day 982
Russian forces downed 19 Ukrainian drones overnight โ 16 over the southern Rostov region and the remainder over the Belgorod and Bryansk regions โ Russia's Ministry of Defence said on Sunday. Blasts were heard in Kyiv early on Sunday and smoke was seen rising from above residential buildings after a suspected Russian drone attack on Ukraine's capital. The attack comes after Kyiv's Mayor Vitali Klitschko said on the Telegram channel that Ukraine's air defence units were trying to repel a Russian air attack on the city, ordering people to stay in shelters. Ukrainian forces are restraining one of Russia's "most powerful offensives" since the start of Moscow's full-scale invasion in 2022, Ukraine's top military commander, General Oleksandr Syrskii, has said. Russia troops have taken two more settlements along the Donbas frontline โ Kurakhivka and Pershotravneve โ Russian news agencies reported on Saturday, citing the country's Defence Ministry.
An Aerial Transport System in Marine GNSS-Denied Environment
Sun, Jianjun, Niu, Zhenwei, Dong, Yihao, Zhang, Fenglin, Din, Muhayy Ud, Seneviratne, Lakmal, Lin, Defu, Hussain, Irfan, He, Shaoming
This paper presents an autonomous aerial system specifically engineered for operation in challenging marine GNSS-denied environments, aimed at transporting small cargo from a target vessel. In these environments, characterized by weakly textured sea surfaces with few feature points, chaotic deck oscillations due to waves, and significant wind gusts, conventional navigation methods often prove inadequate. Leveraging the DJI M300 platform, our system is designed to autonomously navigate and transport cargo while overcoming these environmental challenges. In particular, this paper proposes an anchor-based localization method using ultrawideband (UWB) and QR codes facilities, which decouples the UAV's attitude from that of the moving landing platform, thus reducing control oscillations caused by platform movement. Additionally, a motor-driven attachment mechanism for cargo is designed, which enhances the UAV's field of view during descent and ensures a reliable attachment to the cargo upon landing. The system's reliability and effectiveness were progressively enhanced through multiple outdoor experimental iterations and were validated by the successful cargo transport during the 2024 Mohamed BinZayed International Robotics Challenge (MBZIRC2024) competition. Crucially, the system addresses uncertainties and interferences inherent in maritime transportation missions without prior knowledge of cargo locations on the deck and with strict limitations on intervention throughout the transportation.
Ukraine's Zelenskyy urges allies to act before N Korean troops reach front
Ukraine's President Volodymyr Zelenskyy has urged its allies to stop "watching" and take steps before North Korean troops deployed in Russia reach the battlefield, and the country's army chief warned that his troops are facing "one of the most powerful offensives" by Moscow since the all-out war started more than two years ago. Zelenskyy raised the prospect of a preemptive Ukrainian strike on camps where the North Korean troops are being trained and said Kyiv knows their location. But he said Ukraine cannot do it without permission from allies to use Western-made long-range weapons to hit targets deep inside Russia. "But instead โฆ America is watching, Britain is watching, Germany is watching. Everyone is just waiting for the North Korean military to start attacking Ukrainians as well," Zelenskyy said in a post late Friday on the Telegram messaging app. The Biden administration said on Thursday that some 8,000 North Korean soldiers are now in Russia's Kursk region near Ukraine's border and are preparing to help the Kremlin fight against Ukrainian troops in the coming days.
Wireless Federated Learning over UAV-enabled Integrated Sensing and Communication
Shaon, Shaba, Nguyen, Tien, Mohjazi, Lina, Kaushik, Aryan, Nguyen, Dinh C.
This paper studies a new latency optimization problem in unmanned aerial vehicles (UAVs)-enabled federated learning (FL) with integrated sensing and communication. In this setup, distributed UAVs participate in model training using sensed data and collaborate with a base station (BS) serving as FL aggregator to build a global model. The objective is to minimize the FL system latency over UAV networks by jointly optimizing UAVs' trajectory and resource allocation of both UAVs and the BS. The formulated optimization problem is troublesome to solve due to its non-convexity. Hence, we develop a simple yet efficient iterative algorithm to find a high-quality approximate solution, by leveraging block coordinate descent and successive convex approximation techniques. Simulation results demonstrate the effectiveness of our proposed joint optimization strategy under practical parameter settings, saving the system latency up to 68.54\% compared to benchmark schemes.
Explainable few-shot learning workflow for detecting invasive and exotic tree species
Gevaert, Caroline M., Pedro, Alexandra Aguiar, Ku, Ou, Cheng, Hao, Chandramouli, Pranav, Javan, Farzaneh Dadrass, Nattino, Francesco, Georgievska, Sonja
Deep Learning methods are notorious for relying on extensive labeled datasets to train and assess their performance. This can cause difficulties in practical situations where models should be trained for new applications for which very little data is available. While few-shot learning algorithms can address the first problem, they still lack sufficient explanations for the results. This research presents a workflow that tackles both challenges by proposing an explainable few-shot learning workflow for detecting invasive and exotic tree species in the Atlantic Forest of Brazil using Unmanned Aerial Vehicle (UAV) images. By integrating a Siamese network with explainable AI (XAI), the workflow enables the classification of tree species with minimal labeled data while providing visual, case-based explanations for the predictions. Results demonstrate the effectiveness of the proposed workflow in identifying new tree species, even in data-scarce conditions. With a lightweight backbone, e.g., MobileNet, it achieves a F1-score of 0.86 in 3-shot learning, outperforming a shallow CNN. A set of explanation metrics, i.e., correctness, continuity, and contrastivity, accompanied by visual cases, provide further insights about the prediction results. This approach opens new avenues for using AI and UAVs in forest management and biodiversity conservation, particularly concerning rare or under-studied species.
Towards Building Secure UAV Navigation with FHE-aware Knowledge Distillation
Kaushik, Arjun Ramesh, Jutla, Charanjit, Ratha, Nalini
In safeguarding mission-critical systems, such as Unmanned Aerial Vehicles (UAVs), preserving the privacy of path trajectories during navigation is paramount. While the combination of Reinforcement Learning (RL) and Fully Homomorphic Encryption (FHE) holds promise, the computational overhead of FHE presents a significant challenge. This paper proposes an innovative approach that leverages Knowledge Distillation to enhance the practicality of secure UAV navigation. By integrating RL and FHE, our framework addresses vulnerabilities to adversarial attacks while enabling real-time processing of encrypted UAV camera feeds, ensuring data security. To mitigate FHE's latency, Knowledge Distillation is employed to compress the network, resulting in an impressive 18x speedup without compromising performance, as evidenced by an R-squared score of 0.9499 compared to the original model's score of 0.9631. Our methodology underscores the feasibility of processing encrypted data for UAV navigation tasks, emphasizing security alongside performance efficiency and timely processing. These findings pave the way for deploying autonomous UAVs in sensitive environments, bolstering their resilience against potential security threats.
China sanctions US drone maker Skydio in ongoing trade war
China has sanctioned Skydio, America's largest drone maker, for providing unmanned aerial vehicles to Taiwan's national fire service. Skydio CEO Adam Bry publicly acknowledged the sanctions on Wednesday. "A few weeks ago, China announced sanctions on Skydio for selling drones to Taiwan, where our only customer today is the National Fire Agency," Bry wrote in a blog post. As first reported by the Financial Times, the ban has sent Skydio racing to find alternative battery suppliers. Although the company manufactures its drones in the US and sources many of the components that go inside of them from outside of China, Skydio had been wholly dependent on a single Chinese provider for batteries before October 11, when the country's government imposed the embargo.