Goto

Collaborating Authors

 Drones


Unsupervised UAV 3D Trajectories Estimation with Sparse Point Clouds

arXiv.org Artificial Intelligence

Compact UAV systems, while advancing delivery and surveillance, pose significant security challenges due to their small size, which hinders detection by traditional methods. This paper presents a cost-effective, unsupervised UAV detection method using spatial-temporal sequence processing to fuse multiple LiDAR scans for accurate UAV tracking in real-world scenarios. Our approach segments point clouds into foreground and background, analyzes spatial-temporal data, and employs a scoring mechanism to enhance detection accuracy. Tested on a public dataset, our solution placed 4th in the CVPR 2024 UG2+ Challenge, demonstrating its practical effectiveness. We plan to open-source all designs, code, and sample data for the research community github.com/lianghanfang/UnLiDAR-UAV-Est.


Audio Array-Based 3D UAV Trajectory Estimation with LiDAR Pseudo-Labeling

arXiv.org Artificial Intelligence

As small unmanned aerial vehicles (UAVs) become increasingly prevalent, there is growing concern regarding their impact on public safety and privacy, highlighting the need for advanced tracking and trajectory estimation solutions. In response, this paper introduces a novel framework that utilizes audio array for 3D UAV trajectory estimation. Our approach incorporates a self-supervised learning model, starting with the conversion of audio data into mel-spectrograms, which are analyzed through an encoder to extract crucial temporal and spectral information. Simultaneously, UAV trajectories are estimated using LiDAR point clouds via unsupervised methods. These LiDAR-based estimations act as pseudo labels, enabling the training of an Audio Perception Network without requiring labeled data. In this architecture, the LiDAR-based system operates as the Teacher Network, guiding the Audio Perception Network, which serves as the Student Network. Once trained, the model can independently predict 3D trajectories using only audio signals, with no need for LiDAR data or external ground truth during deployment. To further enhance precision, we apply Gaussian Process modeling for improved spatiotemporal tracking. Our method delivers top-tier performance on the MMAUD dataset, establishing a new benchmark in trajectory estimation using self-supervised learning techniques without reliance on ground truth annotations.


Integrated Sensing and Communications for Low-Altitude Economy: A Deep Reinforcement Learning Approach

arXiv.org Artificial Intelligence

This paper studies an integrated sensing and communications (ISAC) system for low-altitude economy (LAE), where a ground base station (GBS) provides communication and navigation services for authorized unmanned aerial vehicles (UAVs), while sensing the low-altitude airspace to monitor the unauthorized mobile target. The expected communication sum-rate over a given flight period is maximized by jointly optimizing the beamforming at the GBS and UAVs' trajectories, subject to the constraints on the average signal-to-noise ratio requirement for sensing, the flight mission and collision avoidance of UAVs, as well as the maximum transmit power at the GBS. Typically, this is a sequential decision-making problem with the given flight mission. Thus, we transform it to a specific Markov decision process (MDP) model called episode task. Based on this modeling, we propose a novel LAE-oriented ISAC scheme, referred to as Deep LAE-ISAC (DeepLSC), by leveraging the deep reinforcement learning (DRL) technique. In DeepLSC, a reward function and a new action selection policy termed constrained noise-exploration policy are judiciously designed to fulfill various constraints. To enable efficient learning in episode tasks, we develop a hierarchical experience replay mechanism, where the gist is to employ all experiences generated within each episode to jointly train the neural network. Besides, to enhance the convergence speed of DeepLSC, a symmetric experience augmentation mechanism, which simultaneously permutes the indexes of all variables to enrich available experience sets, is proposed. Simulation results demonstrate that compared with benchmarks, DeepLSC yields a higher sum-rate while meeting the preset constraints, achieves faster convergence, and is more robust against different settings.


Towards Real-Time 2D Mapping: Harnessing Drones, AI, and Computer Vision for Advanced Insights

arXiv.org Artificial Intelligence

This paper presents an advanced mapping system that combines drone imagery with machine learning and computer vision to overcome challenges in speed, accuracy, and adaptability across diverse terrains. By automating processes like feature detection, image matching, and stitching, the system produces seamless, high-resolution maps with minimal latency, offering strategic advantages in defense operations. Developed in Python, the system utilizes OpenCV for image processing, NumPy for efficient computations, and Concurrent[dot]futures for parallel execution. ORB (Oriented FAST and Rotated BRIEF) is employed for feature detection, while FLANN (Fast Library for Approximate Nearest Neighbors) ensures accurate keypoint matching. Homography transformations align overlapping images, resulting in distortion-free maps in real time. This automation eliminates manual intervention, enabling live updates essential in rapidly changing environments. Designed for versatility, the system performs reliably under various lighting conditions and rugged terrains, making it highly suitable for aerospace and defense applications. Testing has shown notable improvements in processing speed and accuracy compared to conventional methods, enhancing situational awareness and informed decision-making. This scalable solution leverages cutting-edge technologies to provide actionable, reliable data for mission-critical operations.


Drone footage shows destruction of Zabadani from Syria's war

Al Jazeera

Exclusive drone footage reveals the extensive destruction in Zabadani, a city near Damascus, which endured heavy shelling from Bashar al-Assad's forces during Syria's war.


Russia's Putin apologizes to Azerbaijan over 'tragic' airliner crash

The Japan Times

President Vladimir Putin on Saturday apologized to Azerbaijan's leader for what the Kremlin called a "tragic incident" over Russia in which an Azerbaijan Airlines plane crashed after Russian air defences were fired against Ukrainian drones. The extremely rare publicized apology from Putin was the closest Moscow had come to accepting some blame for Wednesday's disaster, although the Kremlin statement did not say Russia had shot down the plane, only noting that a criminal case had been opened. Flight J2-8243, en route from Baku to the Chechen capital Grozny, crash-landed on Wednesday near Aktau in Kazakhstan after diverting from southern Russia, where Ukrainian drones were reported to be attacking several cities. At least 38 people were killed.


Air-Ground Collaborative Robots for Fire and Rescue Missions: Towards Mapping and Navigation Perspective

arXiv.org Artificial Intelligence

Air-ground collaborative robots have shown great potential in the field of fire and rescue, which can quickly respond to rescue needs and improve the efficiency of task execution. Mapping and navigation, as the key foundation for air-ground collaborative robots to achieve efficient task execution, have attracted a great deal of attention. This growing interest in collaborative robot mapping and navigation is conducive to improving the intelligence of fire and rescue task execution, but there has been no comprehensive investigation of this field to highlight their strengths. In this paper, we present a systematic review of the ground-to-ground cooperative robots for fire and rescue from a new perspective of mapping and navigation. First, an air-ground collaborative robots framework for fire and rescue missions based on unmanned aerial vehicle (UAV) mapping and unmanned ground vehicle (UGV) navigation is introduced. Then, the research progress of mapping and navigation under this framework is systematically summarized, including UAV mapping, UAV/UGV co-localization, and UGV navigation, with their main achievements and limitations. Based on the needs of fire and rescue missions, the collaborative robots with different numbers of UAVs and UGVs are classified, and their practicality in fire and rescue tasks is elaborated, with a focus on the discussion of their merits and demerits. In addition, the application examples of air-ground collaborative robots in various firefighting and rescue scenarios are given. Finally, this paper emphasizes the current challenges and potential research opportunities, rounding up references for practitioners and researchers willing to engage in this vibrant area of air-ground collaborative robots.


CoCap: Coordinated motion Capture for multi-actor scenes in outdoor environments

arXiv.org Artificial Intelligence

Motion capture has become increasingly important, not only in computer animation but also in emerging fields like the virtual reality, bioinformatics, and humanoid training. Capturing outdoor environments offers extended horizon scenes but introduces challenges with occlusions and obstacles. Recent approaches using multi-drone systems to capture multiple actor scenes often fail to account for multi-view consistency and reasoning across cameras in cluttered environments. Coordinated motion Capture (CoCap), inspired by Conflict-Based Search (CBS), addresses this issue by coordinating view planning to ensure multi-view reasoning during conflicts. In scenarios with high occlusions and obstacles, where the likelihood of inter-robot collisions increases, CoCap demonstrates performance that approaches the ideal outcomes of unconstrained planning, outperforming existing sequential planning methods. Additionally, CoCap offers a single-robot view search approach for real-time applications in dense environments.


Putin apologises to Azerbaijan's president over 'tragic' plane crash

Al Jazeera

Russian President Vladimir Putin has apologised to his Azerbaijani counterpart Ilham Aliyev for what he called a "tragic incident" following the deadly crash of an Azerbaijan Airlines plane this week in Kazakhstan. The plane was flying on Wednesday from Azerbaijan's capital of Baku to Grozny, the regional capital of the Russian republic of Chechnya, when it turned towards Kazakhstan and crashed while attempting to land. In a statement on Saturday, the Kremlin said Russian air defence systems were firing near Grozny due to a Ukrainian drone strike, but stopped short of saying one of these hit the plane. "Vladimir Putin apologised for the tragic incident that occurred in Russian airspace and once again expressed his deep and sincere condolences to the families of the victims and wished a speedy recovery to the injured," the Kremlin said. "At that time, Grozny, Mozdok and Vladikavkaz were being attacked by Ukrainian unmanned aerial vehicles, and Russian air defence systems repelled these attacks."


Putin apologises for plane crash, without saying Russia at fault

BBC News

The Kremlin released a statement on Saturday noting Putin had spoken to Azerbaijan's president Ilham Aliyev by phone. "(President) Vladimir Putin apologised for the tragic incident that occurred in Russian airspace and once again expressed his deep and sincere condolences to the families of the victims and wished a speedy recovery to the injured," the statement said. Prior to Saturday, the Kremlin had not yet commented on the crash. But Russian aviation authorities had said the situation in the region was "very complicated" due to Ukrainian drone strikes on Chechnya. Aviation experts and others in Azerbaijan believe the plane's GPS systems were affected by electronic jamming and it was then damaged by shrapnel from Russian air defence missile blasts.