Goto

Collaborating Authors

 Drones


A New Clustering-based View Planning Method for Building Inspection with Drone

arXiv.org Artificial Intelligence

With the rapid development of drone technology, the application of drones equipped with visual sensors for building inspection and surveillance has attracted much attention. View planning aims to find a set of near-optimal viewpoints for vision-related tasks to achieve the vision coverage goal. This paper proposes a new clustering-based two-step computational method using spectral clustering, local potential field method, and hyper-heuristic algorithm to find near-optimal views to cover the target building surface. In the first step, the proposed method generates candidate viewpoints based on spectral clustering and corrects the positions of candidate viewpoints based on our newly proposed local potential field method. In the second step, the optimization problem is converted into a Set Covering Problem (SCP), and the optimal viewpoint subset is solved using our proposed hyper-heuristic algorithm. Experimental results show that the proposed method is able to obtain better solutions with fewer viewpoints and higher coverage.


Equivariant Symmetries for Aided Inertial Navigation

arXiv.org Artificial Intelligence

Respecting the geometry of the underlying system and exploiting its symmetry have been driving concepts in deriving modern geometric filters for inertial navigation systems (INSs). Despite their success, the explicit treatment of inertial measurement unit (IMU) biases remains challenging, unveiling a gap in the current theory of filter design. In response to this gap, this dissertation builds upon the recent theory of equivariant systems to address and overcome the limitations in existing methodologies. The goal is to identify new symmetries of inertial navigation systems that include a geometric treatment of IMU biases and exploit them to design filtering algorithms that outperform state-of-the-art solutions in terms of accuracy, convergence rate, robustness, and consistency. This dissertation leverages the semi-direct product rule and introduces the tangent group for inertial navigation systems as the first equivariant symmetry that properly accounts for IMU biases. Based on that, we show that it is possible to derive an equivariant filter (EqF) algorithm with autonomous navigation error dynamics. The resulting filter demonstrates superior to state-of-the-art solutions. Through a comprehensive analysis of various symmetries of inertial navigation systems, we formalized the concept that every filter can be derived as an EqF with a specific choice of symmetry. This underlines the fundamental role of symmetry in determining filter performance. This dissertation advances the understanding of equivariant symmetries in the context of inertial navigation systems and serves as a basis for the next generation of equivariant estimators, marking a significant leap toward more reliable navigation solutions.


Santa Monica uses police drone to catch car burglar in the act

Los Angeles Times

Santa Monica Police spotted and stopped a man who was burglarizing vehicles in a parking lot near the pier by using a drone. On July 6, a Santa Monica police officer was directing the department's drone back to the station from a radio call when the officer decided to survey the Fourth of July weekend crowd near the pier and the nearby parking lots. As the drone flew over Lot 1 North, the parking lot next to the pier, he noticed a man wandering the lot, according to a video the department posted on their YouTube account. "As [the pilot] watched, the subject approached an unoccupied parked vehicle, pulled out tools from his sweatshirt and quickly punched open the lock of the driver's side door," the department said in the video. The drone footage shows the suspected burglar break the lock of the driver's side door of a black SUV then climb into the car.


Iran's assassination plot against Trump latest attempt to kill Americans on US soil

FOX News

JERUSALEM - The Iranian regime's plot to assassinate former President Trump is the latest in a string of attempts by Tehran to lethally target American officials and Iranian American dissidents. Iranian Supreme Leader Ali Khamenei has effectively put bounties on the heads of Trump, his former Secretary of State Mike Pompeo and ex-National Security Advisor John Bolton for their roles in the U.S. drone strike that eliminated the global Iranian terrorist Qassem Soleimani in 2020. According to the U.S. government, Soleimani was responsible for the murders of over 600 American military personnel in the Middle East. BOLTON CALLS IRAN ASSASSINATION PLOT AN'ACT OF WAR,' CALLS ON BIDEN ADMIN TO'TERMINATE' NUCLEAR TALKS Former President Trump, left, and Iranian leader Ali Khamenei. Fox News Digital reported on Tuesday that the Department of Homeland Security received intelligence from a human source about the planned Iranian assassination of Trump.


Is That Rain? Understanding Effects on Visual Odometry Performance for Autonomous UAVs and Efficient DNN-based Rain Classification at the Edge

arXiv.org Artificial Intelligence

The development of safe and reliable autonomous unmanned aerial vehicles relies on the ability of the system to recognise and adapt to changes in the local environment based on sensor inputs. State-of-the-art local tracking and trajectory planning are typically performed using camera sensor input to the flight control algorithm, but the extent to which environmental disturbances like rain affect the performance of these systems is largely unknown. In this paper, we first describe the development of an open dataset comprising ~335k images to examine these effects for seven different classes of precipitation conditions and show that a worst-case average tracking error of 1.5 m is possible for a state-of-the-art visual odometry system (VINS-Fusion). We then use the dataset to train a set of deep neural network models suited to mobile and constrained deployment scenarios to determine the extent to which it may be possible to efficiently and accurately classify these `rainy' conditions. The most lightweight of these models (MobileNetV3 small) can achieve an accuracy of 90% with a memory footprint of just 1.28 MB and a frame rate of 93 FPS, which is suitable for deployment in resource-constrained and latency-sensitive systems. We demonstrate a classification latency in the order of milliseconds using typical flight computer hardware. Accordingly, such a model can feed into the disturbance estimation component of an autonomous flight controller. In addition, data from unmanned aerial vehicles with the ability to accurately determine environmental conditions in real time may contribute to developing more granular timely localised weather forecasting.


Navigating the Smog: A Cooperative Multi-Agent RL for Accurate Air Pollution Mapping through Data Assimilation

arXiv.org Artificial Intelligence

The rapid rise of air pollution events necessitates accurate, real-time monitoring for informed mitigation strategies. Data Assimilation (DA) methods provide promising solutions, but their effectiveness hinges heavily on optimal measurement locations. This paper presents a novel approach for air quality mapping where autonomous drones, guided by a collaborative multi-agent reinforcement learning (MARL) framework, act as airborne detectives. Ditching the limitations of static sensor networks, the drones engage in a synergistic interaction, adapting their flight paths in real time to gather optimal data for Data Assimilation (DA). Our approach employs a tailored reward function with dynamic credit assignment, enabling drones to prioritize informative measurements without requiring unavailable ground truth data, making it practical for real-world deployments. Extensive experiments using a real-world dataset demonstrate that our solution achieves significantly improved pollution estimates, even with limited drone resources or limited prior knowledge of the pollution plume. Beyond air quality, this solution unlocks possibilities for tackling diverse environmental challenges like wildfire detection and management through scalable and autonomous drone cooperation.


Fusion Flow-enhanced Graph Pooling Residual Networks for Unmanned Aerial Vehicles Surveillance in Day and Night Dual Visions

arXiv.org Artificial Intelligence

Recognizing unauthorized Unmanned Aerial Vehicles (UAVs) within designated no-fly zones throughout the day and night is of paramount importance, where the unauthorized UAVs pose a substantial threat to both civil and military aviation safety. However, recognizing UAVs day and night with dual-vision cameras is nontrivial, since red-green-blue (RGB) images suffer from a low detection rate under an insufficient light condition, such as on cloudy or stormy days, while black-and-white infrared (IR) images struggle to capture UAVs that overlap with the background at night. In this paper, we propose a new optical flow-assisted graph-pooling residual network (OF-GPRN), which significantly enhances the UAV detection rate in day and night dual visions. The proposed OF-GPRN develops a new optical fusion to remove superfluous backgrounds, which improves RGB/IR imaging clarity. Furthermore, OF-GPRN extends optical fusion by incorporating a graph residual split attention network and a feature pyramid, which refines the perception of UAVs, leading to a higher success rate in UAV detection. A comprehensive performance evaluation is conducted using a benchmark UAV catch dataset. The results indicate that the proposed OF-GPRN elevates the UAV mean average precision (mAP) detection rate to 87.8%, marking a 17.9% advancement compared to the residual graph neural network (ResGCN)-based approach.


Planning and Perception for Unmanned Aerial Vehicles in Object and Environmental Monitoring

arXiv.org Artificial Intelligence

Unmanned Aerial Vehicles (UAVs) equipped with high-resolution sensors enable extensive data collection from previously inaccessible areas at a remarkable spatio-temporal scale, promising to revolutionize fields such as precision agriculture and infrastructure inspection. To fully exploit their potential, developing autonomy algorithms for planning and perception is crucial. This dissertation focuses on developing planning and perception algorithms tailored to UAVs used in monitoring applications. In the first part, we address object monitoring and its associated planning challenges. Object monitoring involves continuous observation, tracking, and analysis of specific objects. We tackle the problem of visual reconstruction where the goal is to maximize visual coverage of an object in an unknown environment efficiently. Leveraging shape prediction deep learning models, we optimize planning for quick information gathering. Extending this to multi-UAV systems, we create efficient paths around objects based on reconstructed 3D models, crucial for close-up inspections aimed at detecting changes. Next, we explore inspection scenarios where an object has changed or no prior information is available, focusing on infrastructure inspection. We validate our planning algorithms through real-world experiments and high-fidelity simulations, integrating defect detection seamlessly into the process. In the second part, we shift focus to monitoring entire environments, distinct from object-specific monitoring. Here, the goal is to maximize coverage to understand spatio-temporal changes. We investigate slow-changing environments like vegetative growth estimation and fast-changing environments such as wildfire management. For wildfires, we employ informative path planning to validate and localize fires early, utilizing LSTM networks for enhanced early detection.


Narrowband, Fast, and Autonomous Drone Radio Mapping for Localization

arXiv.org Artificial Intelligence

This paper explores how a flying drone can autonomously navigate while constructing a narrowband radio map for signal localization. As flying drones become more ubiquitous, their wireless signals will necessitate new wireless technologies and algorithms to provide robust radio infrastructure while preserving radio spectrum usage. A potential solution for this spectrum-sharing localization challenge is to limit the bandwidth of any transmitter beacon. However, location signaling with a narrow bandwidth necessitates improving a wireless aerial system's ability to filter a noisy signal, estimate the transmitter's location, and self-pilot toward the beacon signal. By showing results through simulation, emulation, and a final drone flight experiment, this work provides an algorithm using a Gaussian process for radio signal estimation and Bayesian optimization for drone automatic guidance. This research supports advanced radio and aerial robotics applications in critical areas such as search-and-rescue, last-mile delivery, and large-scale platform digital twin development.


A UAV-assisted Wireless Localization Challenge on AERPAW

arXiv.org Artificial Intelligence

As wireless researchers are tasked to enable wireless communication as infrastructure in more dynamic aerial settings, there is a growing need for large-scale experimental platforms that provide realistic, reproducible, and reliable experimental validation. To bridge the research-to-implementation gap, the Aerial Experimentation and Research Platform for Advanced Wireless (AERPAW) offers open-source tools, reference experiments, and hardware to facilitate and evaluate the development of wireless research in controlled digital twin environments and live testbed flights. The inaugural AERPAW Challenge, "Find a Rover," was issued to spark collaborative efforts and test the platform's capabilities. The task involved localizing a narrowband wireless signal, with teams given ten minutes to find the "rover" within a twenty-acre area. By engaging in this exercise, researchers can validate the platform's value as a tool for innovation in wireless communications research within aerial robotics. This paper recounts the methods and experiences of the top three teams in automating and rapidly locating a wireless signal by automating and controlling an aerial drone in a realistic testbed scenario.