Goto

Collaborating Authors

 Drones


Leveraging Augmented Reality for Improved Situational Awareness During UAV-Driven Search and Rescue Missions

arXiv.org Artificial Intelligence

In the high-stakes domain of search-and-rescue missions, the deployment of Unmanned Aerial Vehicles (UAVs) has become increasingly pivotal. These missions require seamless, real-time communication among diverse roles within response teams, particularly between Remote Operators (ROs) and On-Site Operators (OSOs). Traditionally, ROs and OSOs have relied on radio communication to exchange critical information, such as the geolocation of victims, hazardous areas, and points of interest. However, radio communication lacks information visualization, suffers from noise, and requires mental effort to interpret information, leading to miscommunications and misunderstandings. To address these challenges, this paper presents VizCom-AR, an Augmented Reality system designed to facilitate visual communication between ROs and OSOs and their situational awareness during UAV-driven search-and-rescue missions. Our experiments, focus group sessions with police officers, and field study showed that VizCom-AR enhances spatial awareness of both ROs and OSOs, facilitate geolocation information exchange, and effectively complement existing communication tools in UAV-driven emergency response missions. Overall, VizCom-AR offers a fundamental framework for designing Augmented Reality systems for large scale UAV-driven rescue missions.


Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation

arXiv.org Artificial Intelligence

In this paper, we address the vision-based autonomous landing problem in complex urban environments using deep neural networks for semantic segmentation and risk assessment. We propose employing the SegFormer, a state-of-the-art visual transformer network, for the semantic segmentation of complex, unstructured urban environments. This approach yields valuable information that can be utilized in smart autonomous landing missions, particularly in emergency landing scenarios resulting from system failures or human errors. The assessment is done in real-time flight, when images of an RGB camera at the Unmanned Aerial Vehicle (UAV) are segmented with the SegFormer into the most common classes found in urban environments. These classes are then mapped into a level of risk, considering in general, potential material damage, damaging the drone itself and endanger people. The proposed strategy is validated through several case studies, demonstrating the huge potential of semantic segmentation-based strategies to determining the safest landing areas for autonomous emergency landing, which we believe will help unleash the full potential of UAVs on civil applications within urban areas.


GyroCopter: Differential Bearing Measuring Trajectory Planner for Tracking and Localizing Radio Frequency Sources

arXiv.org Artificial Intelligence

Autonomous aerial vehicles can provide efficient and effective solutions for radio frequency (RF) source tracking and localizing problems with applications ranging from wildlife conservation to search and rescue operations. Existing lightweight, low-cost, bearing measurements-based methods with a single antenna-receiver sensor system configurations necessitate in situ rotations, leading to substantial measurement acquisition times restricting searchable areas and number of measurements. We propose a GyroCopter for the task. Our approach plans the trajectory of a multi-rotor unmanned aerial vehicle (UAV) whilst utilizing UAV flight dynamics to execute a constant gyration motion to derive "pseudo-bearing" measurements to track RF sources. The gyration-based pseudo-bearing approach: i) significantly reduces the limitations associated with in situ rotation bearing; while ii) capitalizing on the simplicity, affordability, and lightweight nature of signal strength measurement acquisition hardware to estimate bearings. This method distinguishes itself from other pseudo-bearing approaches by eliminating the need for additional hardware to maintain simplicity, lightweightness and cost-effectiveness. To validate our approach, we derived the optimal rotation speed and conducted extensive simulations and field missions with our GyroCopter to track and localize multiple RF sources. The results confirm the effectiveness of our method, highlighting its potential as a practical and rapid solution for RF source localization tasks.


Flex: End-to-End Text-Instructed Visual Navigation with Foundation Models

arXiv.org Artificial Intelligence

End-to-end learning directly maps sensory inputs to actions, creating highly integrated and efficient policies for complex robotics tasks. However, such models are tricky to efficiently train and often struggle to generalize beyond their training scenarios, limiting adaptability to new environments, tasks, and concepts. In this work, we investigate the minimal data requirements and architectural adaptations necessary to achieve robust closed-loop performance with vision-based control policies under unseen text instructions and visual distribution shifts. To this end, we design datasets with various levels of data representation richness, refine feature extraction protocols by leveraging multi-modal foundation model encoders, and assess the suitability of different policy network heads. Our findings are synthesized in Flex (Fly-lexically), a framework that uses pre-trained Vision Language Models (VLMs) as frozen patch-wise feature extractors, generating spatially aware embeddings that integrate semantic and visual information. These rich features form the basis for training highly robust downstream policies capable of generalizing across platforms, environments, and text-specified tasks. We demonstrate the effectiveness of this approach on quadrotor fly-to-target tasks, where agents trained via behavior cloning on a small simulated dataset successfully generalize to real-world scenes, handling diverse novel goals and command formulations.


Drones, threats and explosions: Why Korean tensions are rising

BBC News

On 11 October, North Korea's foreign ministry accused the South of sending drones to Pyongyang at night over the course of two weeks. It said that leaflets dispersed by the drones contained "inflammatory rumours and rubbish". Kim's influential sister, Kim Yo Jong, warned Seoul of "horrible consequences" if the alleged drone flights happened again. She later said there was "clear evidence" that "military gangsters" from the South were behind the alleged provocations. North Korea has released blurry images of what it said were the drones flying in the sky, as well as pictures allegedly showing the leaflets, but there is no way of independently verifying their claims.


'It's scary - but so's giving birth': The female unit downing Russian drones

BBC News

Somewhere on the horizon is a beam of light from another group, scouring the skies for danger over their own patrol zone. There's no public data on the total number of volunteer units โ€“ or how many women are involved. But as Russia sends drones packed with explosives almost every night, they help form an extra shield around big towns and cities. From the Witches' position in a field, Yulia tracks two drones on her tablet. They're over the neighbouring region, so there's no imminent danger for Bucha, but the machine guns will stay in place until the alert ends.


Integrating Artificial Intelligence Models and Synthetic Image Data for Enhanced Asset Inspection and Defect Identification

arXiv.org Artificial Intelligence

In the past utilities relied on in-field inspections to identify asset defects. Recently, utilities have started using drone-based inspections to enhance the field-inspection process. We consider a vast repository of drone images, providing a wealth of information about asset health and potential issues. However, making the collected imagery data useful for automated defect detection requires significant manual labeling effort. We propose a novel solution that combines synthetic asset defect images with manually labeled drone images. This solution has several benefits: improves performance of defect detection, reduces the number of hours spent on manual labeling, and enables the capability to generate realistic images of rare defects where not enough real-world data is available. We employ a workflow that combines 3D modeling tools such as Maya and Unreal Engine to create photorealistic 3D models and 2D renderings of defective assets and their surroundings. These synthetic images are then integrated into our training pipeline augmenting the real data. This study implements an end-to-end Artificial Intelligence solution to detect assets and asset defects from the combined imagery repository. The unique contribution of this research lies in the application of advanced computer vision models and the generation of photorealistic 3D renderings of defective assets, aiming to transform the asset inspection process. Our asset detection model has achieved an accuracy of 92 percent, we achieved a performance lift of 67 percent when introducing approximately 2,000 synthetic images of 2k resolution. In our tests, the defect detection model achieved an accuracy of 73 percent across two batches of images. Our analysis demonstrated that synthetic data can be successfully used in place of real-world manually labeled data to train defect detection model.


Drone swarms targeting US military bases are operated by 'mother ship' UFO, claims top Pentagon official

Daily Mail - Science & tech

A retired, senior Pentagon official has confirmed that UFO'mother ships' were spotted'releasing swarms of smaller craft' -- adding further mystery to the still-unexplained intrusions over multiple US military bases. His statements come amid the release of 50 pages of Air Force records related to provocative'drone' incursions, that one general calls'Close Encounters at Langley.' For at least 17 nights last December, swarms of noisy, small UFOs were seen at dusk'moving at rapid speeds' and displaying'flashing red, green, and white lights' penetrating the highly restricted airspace above Langley Air Force Base in Virginia. Senior ex-Pentagon security official Chris Mellon told DailyMail.com'Two of the notable aspects,' he said, 'are the fact our drone signal-jamming devices have proven ineffective and these craft are making no effort to remain concealed.'


Drone attack on Israel puts spotlight on Iron Dome's limitations

BBC News

Here in northern Israel we hear booms at regular intervals as Iron Dome intercept rockets that Hezbollah fires from southern Lebanon. Israel says it hits more than 90% of its targets. But Iron Dome works because Hezbollah's rockets are crude โ€“ and it's possible to calculate where it's rockets will go at take-off and then intercept them. Stopping drones is more complicated. And has in this war become a recurring problem.


Deadly Hezbollah Attack Shows Israel's Weakness Against Drones

NYT > Middle East

One of the civilians who spotted the drone, Viki Kadosh, said she was "so frustrated, because 10 minutes before the hit, we had called in to warn about it." Speaking on Monday to Galei Tzahal, a radio station run by the Israeli military, Ms. Kadosh said: "We spotted it flying very low, right above our home. We heard the sound it was making and immediately noticed there was something strange about it." The Israeli military declined to comment. The sequence of drone attacks has caused alarm in Israel as it prepares for a potential escalation with Iran.