Goto

Collaborating Authors

 Drones


SOAR: Simultaneous Exploration and Photographing with Heterogeneous UAVs for Fast Autonomous Reconstruction

arXiv.org Artificial Intelligence

Unmanned Aerial Vehicles (UAVs) have gained significant popularity in scene reconstruction. This paper presents SOAR, a LiDAR-Visual heterogeneous multi-UAV system specifically designed for fast autonomous reconstruction of complex environments. Our system comprises a LiDAR-equipped explorer with a large field-of-view (FoV), alongside photographers equipped with cameras. To ensure rapid acquisition of the scene's surface geometry, we employ a surface frontier-based exploration strategy for the explorer. As the surface is progressively explored, we identify the uncovered areas and generate viewpoints incrementally. These viewpoints are then assigned to photographers through solving a Consistent Multiple Depot Multiple Traveling Salesman Problem (Consistent-MDMTSP), which optimizes scanning efficiency while ensuring task consistency. Finally, photographers utilize the assigned viewpoints to determine optimal coverage paths for acquiring images. We present extensive benchmarks in the realistic simulator, which validates the performance of SOAR compared with classical and state-of-the-art methods. For more details, please see our project page at https://sysu-star.github.io/SOAR}{sysu-star.github.io/SOAR.


Drone footage shows sunken Greek village re-emerge from lake

BBC News

The ruins of a Greek village that lay submerged for decades have re-appeared after record temperatures caused a major reservoir to partially dry up. Residents of the village of Kallio - which was made up of 80-or-so houses, a church and a school - were forced to evacuate their homes more than 40 years ago to make way for a dam that supplies water to the capital, Athens. But drought conditions in recent months have caused the water level here to drop dramatically, and drone footage shows the ruins of buildings poking out the top of the water.


YoloTag: Vision-based Robust UAV Navigation with Fiducial Markers

arXiv.org Artificial Intelligence

By harnessing fiducial markers as visual landmarks in the environment, Unmanned Aerial Vehicles (UAVs) can rapidly build precise maps and navigate spaces safely and efficiently, unlocking their potential for fluent collaboration and coexistence with humans. Existing fiducial marker methods rely on handcrafted feature extraction, which sacrifices accuracy. On the other hand, deep learning pipelines for marker detection fail to meet real-time runtime constraints crucial for navigation applications. In this work, we propose YoloTag \textemdash a real-time fiducial marker-based localization system. YoloTag uses a lightweight YOLO v8 object detector to accurately detect fiducial markers in images while meeting the runtime constraints needed for navigation. The detected markers are then used by an efficient perspective-n-point algorithm to estimate UAV states. However, this localization system introduces noise, causing instability in trajectory tracking. To suppress noise, we design a higher-order Butterworth filter that effectively eliminates noise through frequency domain analysis. We evaluate our algorithm through real-robot experiments in an indoor environment, comparing the trajectory tracking performance of our method against other approaches in terms of several distance metrics.


Learning Resilient Formation Control of Drones with Graph Attention Network

arXiv.org Artificial Intelligence

The rapid advancement of drone technology has significantly impacted various sectors, including search and rescue, environmental surveillance, and industrial inspection. Multidrone systems offer notable advantages such as enhanced efficiency, scalability, and redundancy over single-drone operations. Despite these benefits, ensuring resilient formation control in dynamic and adversarial environments, such as under communication loss or cyberattacks, remains a significant challenge. Classical approaches to resilient formation control, while effective in certain scenarios, often struggle with complex modeling and the curse of dimensionality, particularly as the number of agents increases. This paper proposes a novel, learning-based formation control for enhancing the adaptability and resilience of multidrone formations using graph attention networks (GATs). By leveraging GAT's dynamic capabilities to extract internode relationships based on the attention mechanism, this GAT-based formation controller significantly improves the robustness of drone formations against various threats, such as Denial of Service (DoS) attacks. Our approach not only improves formation performance in normal conditions but also ensures the resilience of multidrone systems in variable and adversarial environments. Extensive simulation results demonstrate the superior performance of our method over baseline formation controllers. Furthermore, the physical experiments validate the effectiveness of the trained control policy in real-world flights.


Mapping Safe Zones for Co-located Human-UAV Interaction

arXiv.org Artificial Intelligence

Recent advances in robotics bring us closer to the reality of living, co-habiting, and sharing personal spaces with robots. However, it is not clear how close a co-located robot can be to a human in a shared environment without making the human uncomfortable or anxious. This research aims to map safe and comfortable zones for co-located aerial robots. The objective is to identify the distances at which a drone causes discomfort to a co-located human and to create a map showing no-fly, moderate-fly, and safe-fly zones. We recruited a total of 18 participants and conducted two indoor laboratory experiments, one with a single drone and the other set with two drones. Our results show that multiple drones cause more discomfort when close to a co-located human than a single drone. We observed that distances below 200 cm caused discomfort, the moderate fly zone was 200 - 300 cm, and the safe-fly zone was any distance greater than 300 cm in single drone experiments. The safe zones were pushed further away by 100 cm for the multiple drone experiments. In this paper, we present the preliminary findings on safe-fly zones for multiple drones. Further work would investigate the impact of a higher number of aerial robots, the speed of approach, direction of travel, and noise level on co-located humans, and autonomously develop 3D models of trust zones and safe zones for co-located aerial swarms.


Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challenges

arXiv.org Artificial Intelligence

Multispectral imaging and deep learning have emerged as powerful tools supporting diverse use cases from autonomous vehicles, to agriculture, infrastructure monitoring and environmental assessment. The combination of these technologies has led to significant advancements in object detection, classification, and segmentation tasks in the non-visible light spectrum. This paper considers 400 total papers, reviewing 200 in detail to provide an authoritative meta-review of multispectral imaging technologies, deep learning models, and their applications, considering the evolution and adaptation of You Only Look Once (YOLO) methods. Ground-based collection is the most prevalent approach, totaling 63% of the papers reviewed, although uncrewed aerial systems (UAS) for YOLO-multispectral applications have doubled since 2020. The most prevalent sensor fusion is Red-Green-Blue (RGB) with Long-Wave Infrared (LWIR), comprising 39% of the literature. YOLOv5 remains the most used variant for adaption to multispectral applications, consisting of 33% of all modified YOLO models reviewed. 58% of multispectral-YOLO research is being conducted in China, with broadly similar research quality to other countries (with a mean journal impact factor of 4.45 versus 4.36 for papers not originating from Chinese institutions). Future research needs to focus on (i) developing adaptive YOLO architectures capable of handling diverse spectral inputs that do not require extensive architectural modifications, (ii) exploring methods to generate large synthetic multispectral datasets, (iii) advancing multispectral YOLO transfer learning techniques to address dataset scarcity, and (iv) innovating fusion research with other sensor types beyond RGB and LWIR.


Russian barrage targets Kyiv, Ukrainian strike destroys school

Al Jazeera

A Russian air attack has bombarded Kyiv in the latest attack on the Ukrainian capital. Ukraine's air defence units destroyed dozens of cruise and ballistic missiles early on Monday morning, the city's military administration said on the Telegram messaging app. Meanwhile, authorities in the Russian region of Belgorod said a Ukrainian attack destroyed a childcare facility, as the warring pair continue to swap air strikes. Ukrainian forces said that they destroyed 22 out of 35 missiles and 20 out of 23 attack drones over the Kyiv, Kharkiv, Dnipro, Poltava, Mykolaiv and Zaporizhzhia regions. Despite Kyiv's defensive action, the attack on the city produced a series of explosions, forcing residents into bomb shelters.


Russia strikes Kharkiv following Ukraine's mass drone attack

The Japan Times

At least 47 people, including five children, were injured on Sunday after Russian missiles struck a shopping mall and events complex in Ukraine's northeastern city of Kharkiv, officials said. Earlier in the day, Russia said Kyiv had launched one of the biggest drone attacks against it since the full-scale war began, targeting power plants and an oil refinery, while Moscow's forces made further gains toward a key town in eastern Ukraine. The Kharkiv attack prompted Ukrainian President Volodymyr Zelenskyy to renew calls on allies to allow Kyiv to fire Western-supplied missiles deeper into enemy territory and reduce the military threat Russia poses.


DOB-based Wind Estimation of A UAV Using Its Onboard Sensor

arXiv.org Artificial Intelligence

Unmanned Aerial Vehicles (UAVs) play a crucial role in meteorological research, particularly in environmental wind field measurements. However, several challenges exist in current wind measurement methods using UAVs that need to be addressed. Firstly, the accuracy of measurement is low, and the measurement range is limited. Secondly, the algorithms employed lack robustness and adaptability across different UAV platforms. Thirdly, there are limited approaches available for wind estimation during dynamic flight. Finally, while horizontal plane measurements are feasible, vertical direction estimation is often missing. To tackle these challenges, we present and implement a comprehensive wind estimation algorithm. Our algorithm offers several key features, including the capability to estimate the 3-D wind vector, enabling wind estimation even during dynamic flight of the UAV. Furthermore, our algorithm exhibits adaptability across various UAV platforms. Experimental results in the wind tunnel validate the effectiveness of our algorithm, showcasing improvements such as wind speed accuracy of $0.11$ m/s and wind direction errors of less than $2.8^\circ$. Additionally, our approach extends the measurement range to $10$ m/s.


Russia says it intercepted more than 150 Ukrainian drones in 'massive' raid

Al Jazeera

Russia says it has stopped a "massive" Ukrainian air attack by downing at least 158 drones in 15 regions, including two over Russia's capital Moscow. The Russian defence ministry on Sunday said 46 of the drones were shot over the Kursk region, where Ukraine has sent its forces in recent weeks in the largest incursion on Russian soil since World War II. A further 34 drones were shot down over the Bryansk region, 28 over the Voronezh region, and 14 over the Belgorod region – all of which border Ukraine, the ministry said, adding that a total of 15 Russian regions were hit. Moscow's Mayor Sergei Sobyanin on Sunday said falling debris from one of the two drones shot down over the city caused a fire at an oil refinery. Also in Russia, Belgorod Governor Vyacheslav Gladkov said nine people were wounded in Ukrainian aerial missile attacks in the Russian border region.