Drones
FlightForge: Advancing UAV Research with Procedural Generation of High-Fidelity Simulation and Integrated Autonomy
Čapek, David, Hrnčíř, Jan, Báča, Tomáš, Jirkal, Jakub, Vonásek, Vojtěch, Pěnička, Robert, Saska, Martin
Robotic simulators play a crucial role in the development and testing of autonomous systems, particularly in the realm of Uncrewed Aerial Vehicles (UAV). However, existing simulators often lack high-level autonomy, hindering their immediate applicability to complex tasks such as autonomous navigation in unknown environments. This limitation stems from the challenge of integrating realistic physics, photorealistic rendering, and diverse sensor modalities into a single simulation environment. At the same time, the existing photorealistic UAV simulators use mostly hand-crafted environments with limited environment sizes, which prevents the testing of long-range missions. This restricts the usage of existing simulators to only low-level tasks such as control and collision avoidance. To this end, we propose the novel FlightForge UAV open-source simulator. FlightForge offers advanced rendering capabilities, diverse control modalities, and, foremost, procedural generation of environments. Moreover, the simulator is already integrated with a fully autonomous UAV system capable of long-range flights in cluttered unknown environments. The key innovation lies in novel procedural environment generation and seamless integration of high-level autonomy into the simulation environment. Experimental results demonstrate superior sensor rendering capability compared to existing simulators, and also the ability of autonomous navigation in almost infinite environments.
Drone Detection and Tracking with YOLO and a Rule-based Method
Bhattacharya, Purbaditya, Nowak, Patrick
Drones or unmanned aerial vehicles are traditionally used for military missions, warfare, and espionage. However, the usage of drones has significantly increased due to multiple industrial applications involving security and inspection, transportation, research purposes, and recreational drone flying. Such an increased volume of drone activity in public spaces requires regulatory actions for purposes of privacy protection and safety. Hence, detection of illegal drone activities such as boundary encroachment becomes a necessity. Such detection tasks are usually automated and performed by deep learning models which are trained on annotated image datasets. This paper builds on a previous work and extends an already published open source dataset. A description and analysis of the entire dataset is provided. The dataset is used to train the YOLOv7 deep learning model and some of its minor variants and the results are provided. Since the detection models are based on a single image input, a simple cross-correlation based tracker is used to reduce detection drops and improve tracking performance in videos. Finally, the entire drone detection system is summarized.
Drones, cameras and metal detectors: Edison faces new scrutiny over start of Eaton fire
Armed with drones, long-distance camera lenses and metal detectors, a hillside in Eaton Canyon has become the focus of intense scrutiny over the last month by teams of private investigators now seeking clues on whether Southern California Edison equipment caused the massive fire that destroyed large swaths of Altadena. Some of the findings and theories of these privately hired teams of fire investigators and electrical engineers have emerged in more than 40 lawsuits that residents have filed against the utility. Much of the focus has been centered on a group of transmission towers where the first flames were seen just as the Eaton fire exploded. Earlier this week, a new lawsuit alleged that an idle transmission tower on the hillside -- one that has not been in use for more than 50 years -- might have sparked the devastating blaze. With more than 9,000 homes lost and 17 people killed, liability is going to be a costly question that could affect how Altadena is rebuilt.
Dense Fixed-Wing Swarming using Receding-Horizon NMPC
Madabushi, Varun, Kopel, Yocheved, Polevoy, Adam, Moore, Joseph
Abstract-- In this paper, we present an approach for controlling a team of agile fixed-wing aerial vehicles in close proximity to one another. Our approach relies on recedinghorizon nonlinear model predictive control (NMPC) to plan maneuvers across an expanded flight envelope to enable interagent collision avoidance. To facilitate robust collision avoidance and characterize the likelihood of inter-agent collisions, we compute a statistical bound on the probability of the system leaving a tube around the planned nominal trajectory. Finally, we propose a metric for evaluating highly dynamic swarms and use this metric to evaluate our approach. We successfully demonstrated our approach through both simulation and hardware experiments, and to our knowledge, this the first time close-quarters swarming has been achieved with physical aerobatic fixed-wing vehicles.
Enhancing people localisation in drone imagery for better crowd management by utilising every pixel in high-resolution images
Accurate people localisation using drones is crucial for effective crowd management, not only during massive events and public gatherings but also for monitoring daily urban crowd flow. Traditional methods for tiny object localisation using high-resolution drone imagery often face limitations in precision and efficiency, primarily due to constraints in image scaling and sliding window techniques. To address these challenges, a novel approach dedicated to point-oriented object localisation is proposed. Along with this approach, the Pixel Distill module is introduced to enhance the processing of high-definition images by extracting spatial information from individual pixels at once. Additionally, a new dataset named UP-COUNT, tailored to contemporary drone applications, is shared. It addresses a wide range of challenges in drone imagery, such as simultaneous camera and object movement during the image acquisition process, pushing forward the capabilities of crowd management applications. A comprehensive evaluation of the proposed method on the proposed dataset and the commonly used DroneCrowd dataset demonstrates the superiority of our approach over existing methods and highlights its efficacy in drone-based crowd object localisation tasks. These improvements markedly increase the algorithm's applicability to operate in real-world scenarios, enabling more reliable localisation and counting of individuals in dynamic environments.
Efficient variable-length hanging tether parameterization for marsupial robot planning in 3D environments
Martínez-Rozas, S., Alejo, D., Caballero, F., Merino, L., Pérez-Cutiño, M. A., Rodriguez, F., Sánchez-Canales, V., Ventura, I., Díaz-Bañez, J. M.
This paper presents a novel approach to efficiently parameterize and estimate the state of a hanging tether for path and trajectory planning of a UGV tied to a UAV in a marsupial configuration. Most implementations in the state of the art assume a taut tether or make use of the catenary curve to model the shape of the hanging tether. The catenary model is complex to compute and must be instantiated thousands of times during the planning process, becoming a time-consuming task, while the taut tether assumption simplifies the problem, but might overly restrict the movement of the platforms. In order to accelerate the planning process, this paper proposes defining an analytical model to efficiently compute the hanging tether state, and a method to get a tether state parameterization free of collisions. We exploit the existing similarity between the catenary and parabola curves to derive analytical expressions of the tether state.
Reinforcement Learning Based Prediction of PID Controller Gains for Quadrotor UAVs
Sönmez, Serhat, Montecchio, Luca, Martini, Simone, Rutherford, Matthew J., Rizzo, Alessandro, Stefanovic, Margareta, Valavanis, Kimon P.
Unmanned aerial vehicles (UAVs) have experienced tremendous growth over the past two decades, and they have been utilized in diverse civilian and public domain applications like power line inspection [1], monitoring mining areas [2], wildlife conservation and monitoring [3], border protection [4], infrastructure and building inspection [5], and precision agriculture [6], among others. Multirotor UAVs, particularly quadrotors, have become the most widely used platforms due to their vertical take-off and landing (VTOL) capabilities, efficient hovering, and overall flight effectiveness. Although several conventional control techniques have been developed and tested effectively (via simulations and in real time) for quadrotor navigation and control, recently, learning-based algorithms and techniques have gained significant momentum because they improve quadrotor modeling and subsequently navigation and control. The learning-based methodology offers alternatives to parameter tuning and estimation, learning, and understanding of the environment. Representative published surveys on developing and adopting machine learning (ML), deep learning (DL), or reinforcement learning (RL) algorithms for UAV modeling and control include [7], [8], [9], [10], [11], while the recently completed survey in [12] focuses on multirotor navigation and control based on online learning.
A Performance Analysis of You Only Look Once Models for Deployment on Constrained Computational Edge Devices in Drone Applications
Rey, Lucas, Bernardos, Ana M., Dobrzycki, Andrzej D., Carramiñana, David, Bergesio, Luca, Besada, Juan A., Casar, José Ramón
Advancements in embedded systems and Artificial Intelligence (AI) have enhanced the capabilities of Unmanned Aircraft Vehicles (UAVs) in computer vision. However, the integration of AI techniques o-nboard drones is constrained by their processing capabilities. In this sense, this study evaluates the deployment of object detection models (YOLOv8n and YOLOv8s) on both resource-constrained edge devices and cloud environments. The objective is to carry out a comparative performance analysis using a representative real-time UAV image processing pipeline. Specifically, the NVIDIA Jetson Orin Nano, Orin NX, and Raspberry Pi 5 (RPI5) devices have been tested to measure their detection accuracy, inference speed, and energy consumption, and the effects of post-training quantization (PTQ). The results show that YOLOv8n surpasses YOLOv8s in its inference speed, achieving 52 FPS on the Jetson Orin NX and 65 fps with INT8 quantization. Conversely, the RPI5 failed to satisfy the real-time processing needs in spite of its suitability for low-energy consumption applications. An analysis of both the cloud-based and edge-based end-to-end processing times showed that increased communication latencies hindered real-time applications, revealing trade-offs between edge (low latency) and cloud processing (quick processing). Overall, these findings contribute to providing recommendations and optimization strategies for the deployment of AI models on UAVs.
Drone footage of cartel warfare is 'indicative' of danger still present at border, says Rep. Chip Roy
A group of suspected Mexican cartel members fired shots at U.S. Border Patrol agents on Monday afternoon as a group of migrants attempted to cross the Rio Grande. After drone video footage surfaced of an apparent cartel-on-cartel gunfight just south of the U.S. border with Mexico, Republican Congressman Chip Roy of Texas is calling attention to the danger still present at the border. The footage, which Roy obtained from sources on the border, was taken by a cartel drone and shows two sets of vehicles exchanging gunfire near the U.S. border. Video taken by the drone shows the operator eventually drop some type of missile, seeming to eliminate shooters on one side. Speaking with Fox News Digital, Roy said that the knowledge that cartels own drones with weapon capabilities "open[s] up a whole other frontier that we've got to manage and deal with border security."
Aero-LLM: A Distributed Framework for Secure UAV Communication and Intelligent Decision-Making
Dharmalingam, Balakrishnan, Mukherjee, Rajdeep, Piggott, Brett, Feng, Guohuan, Liu, Anyi
Increased utilization of unmanned aerial vehicles (UAVs) in critical operations necessitates secure and reliable communication with Ground Control Stations (GCS). This paper introduces Aero-LLM, a framework integrating multiple Large Language Models (LLMs) to enhance UAV mission security and operational efficiency. Unlike conventional singular LLMs, Aero-LLM leverages multiple specialized LLMs for various tasks, such as inferencing, anomaly detection, and forecasting, deployed across onboard systems, edge, and cloud servers. This dynamic, distributed architecture reduces performance bottleneck and increases security capabilities. Aero-LLM's evaluation demonstrates outstanding task-specific metrics and robust defense against cyber threats, significantly enhancing UAV decision-making and operational capabilities and security resilience against cyber attacks, setting a new standard for secure, intelligent UAV operations.