Drones
HEPP: Hyper-efficient Perception and Planning for High-speed Obstacle Avoidance of UAVs
Lu, Minghao, Fan, Xiyu, Xu, Bowen, Yan, Zexuan, Peng, Rui, Chen, Han, Zhang, Lixian, Lu, Peng
High-speed obstacle avoidance of uncrewed aerial vehicles (UAVs) in cluttered environments is a significant challenge. Existing UAV planning and obstacle avoidance systems can only fly at moderate speeds or at high speeds over empty or sparse fields. In this article, we propose a hyper-efficient perception and planning system for the high-speed obstacle avoidance of UAVs. The system mainly consists of three modules: 1) A novel incremental robocentric mapping method with distance and gradient information, which takes 89.5% less time compared to existing methods. 2) A novel obstacle-aware topological path search method that generates multiple distinct paths. 3) An adaptive gradient-based high-speed trajectory generation method with a novel time pre-allocation algorithm. With these innovations, the system has an excellent real-time performance with only milliseconds latency in each iteration, taking 79.24% less time than existing methods at high speeds (15 m/s in cluttered environments), allowing UAVs to fly swiftly and avoid obstacles in cluttered environments. The planned trajectory of the UAV is close to the global optimum in both temporal and spatial domains. Finally, extensive validations in both simulation and real-world experiments demonstrate the effectiveness of our proposed system for high-speed navigation in cluttered environments.
UAV Control with Vision-based Hand Gesture Recognition over Edge-Computing
Abdalla, Sousannah, Baidya, Sabur
Gesture recognition presents a promising avenue for interfacing with unmanned aerial vehicles (UAVs) due to its intuitive nature and potential for precise interaction. This research conducts a comprehensive comparative analysis of vision-based hand gesture detection methodologies tailored for UAV Control. The existing gesture recognition approaches involving cropping, zooming, and color-based segmentation, do not work well for this kind of applications in dynamic conditions and suffer in performance with increasing distance and environmental noises. We propose to use a novel approach leveraging hand landmarks drawing and classification for gesture recognition based UAV control. With experimental results we show that our proposed method outperforms the other existing methods in terms of accuracy, noise resilience, and efficacy across varying distances, thus providing robust control decisions. However, implementing the deep learning based compute intensive gesture recognition algorithms on the UAV's onboard computer is significantly challenging in terms of performance. Hence, we propose to use a edge-computing based framework to offload the heavier computing tasks, thus achieving closed-loop real-time performance. With implementation over AirSim simulator as well as over a real-world UAV, we showcase the advantage of our end-to-end gesture recognition based UAV control system.
WildLive: Near Real-time Visual Wildlife Tracking onboard UAVs
Dat, Nguyen Ngoc, Richardson, Tom, Watson, Matthew, Meier, Kilian, Kline, Jenna, Reid, Sid, Maalouf, Guy, Hine, Duncan, Mirmehdi, Majid, Burghardt, Tilo
Live tracking of wildlife via high-resolution video processing directly onboard drones is widely unexplored and most existing solutions rely on streaming video to ground stations to support navigation. Yet, both autonomous animal-reactive flight control beyond visual line of sight and/or mission-specific individual and behaviour recognition tasks rely to some degree on this capability. In response, we introduce WildLive - a near real-time animal detection and tracking framework for high-resolution imagery running directly onboard uncrewed aerial vehicles (UAVs). The system performs multi-animal detection and tracking at 17.81fps for HD and 7.53fps on 4K video streams suitable for operation during higher altitude flights to minimise animal disturbance. Our system is optimised for Jetson Orin AGX onboard hardware. It integrates the efficiency of sparse optical flow tracking and mission-specific sampling with device-optimised and proven YOLO-driven object detection and segmentation techniques. Essentially, computational resource is focused onto spatio-temporal regions of high uncertainty to significantly improve UAV processing speeds. Alongside, we introduce our WildLive dataset, which comprises 200K+ annotated animal instances across 19K+ frames from 4K UAV videos collected at the Ol Pejeta Conservancy in Kenya. All frames contain ground truth bounding boxes, segmentation masks, as well as individual tracklets and tracking point trajectories. We compare our system against current object tracking approaches including OC-SORT, ByteTrack, and SORT. Our multi-animal tracking experiments with onboard hardware confirm that near real-time high-resolution wildlife tracking is possible on UAVs whilst maintaining high accuracy levels as needed for future navigational and mission-specific animal-centric operational autonomy. Our materials are available at: https://dat-nguyenvn.github.io/WildLive/
Ukraine under Russian missile, drone attacks for second night, 12 killed
Russia has targeted Ukraine for a second consecutive night with drones and missiles, killing at least 12 people as the two countries pursue a major prisoner swap. Ukraine's air force said on Sunday that Russian forces attacked Ukrainian regions with 298 drones and 69 missiles overnight, one of the largest aerial attacks of the war. "Most regions of Ukraine were affected by the hostile attack. Enemy air strikes were recorded in 22 areas, and downed cruise missiles and attack UAVs (drones) fell in 15 locations," the air force said on Telegram. Ukraine's security service reported that at least four people were killed and 16 were injured in the capital, Kyiv.
How commercial drones turn deadly in Gaza
In Gaza, the sound of drones can be heard everywhere. An analysis by Al Jazeera's digital investigations team, Sanad, has revealed that Israel is repurposing commercial drones to use as weapons of war in the Strip. And as drones become ever more accessible, the line between their civilian use and their military use is becoming increasingly blurred.
DJI Mavic Pro Review: Powerful and Easy to Use
Having reviewed dozens of drones of all shapes, sizes, and prices, I'd recently come to the conclusion that smaller, lighter, and cheaper drones were the way to go for 90 percent of consumers. But then DJI launched its new premium-priced, jumbo-size flagship consumer drone, the Mavic 4 Pro, and made me fall in love all over again. Yes, this drone is seriously impressive. But before I deep-dive the phenomenally good camera and ridiculously long range, it's important to note that the Mavic 4 Pro will not be officially available in the US. As well as ongoing issues around flight restrictions and security, a DJI spokesperson told WIRED, "Like many global companies, we have had to adjust our market strategy as local conditions and the industry environment have evolved. While we do not have a timeline for when we can introduce the product to the US market, we are closely monitoring the situation and actively exploring every possible solution."
Ukraine calls for new sanctions as Russia hits Kyiv amid prisoner exchanges
Ukrainian officials have renewed their calls for more sanctions on Russia after Russian forces launched dozens of attack drones and ballistic missiles at Kyiv overnight ahead of a second exchange of soldiers and civilians. Ukraine's military on Saturday said overnight attacks launched from multiple Russian regions used 250 drones and 14 ballistic missiles to hit Kyiv, damaging several apartment buildings and a shopping mall, and injuring at least 15 people. Sites in the Ukrainian regions of Dnipropetrovsk, Odesa and Zaporizhia were also hit, with Ukrainian forces saying six of the ballistic missiles were shot down by its air defences, along with 245 drones, many of which were said to be Iranian-designed. Oleh Syniehubov, head of Kharkiv's regional state administration, said on Saturday morning that four Ukrainians were killed and several others injured over the past 24 hours in the region as a result of multiple Russian attacks. Meanwhile, Russia's Ministry of Defence on Saturday said at least 100 Ukrainian drones attempted to strike Russian targets overnight.
Robot Talk Episode 122 – Bio-inspired flying robots, with Jane Pauline Ramos Ramirez
Claire chatted to Jane Pauline Ramos Ramirez from Delft University of Technology about drones that can move on land and in the air. Jane Pauline Ramos Ramirez is a licensed engineer with a multidisciplinary background in bionics, mechanical, and aerospace engineering, and international research experience. Her life's work is rooted in designing inclusive, socially accessible systems that work in synergy with nature and create meaningful impact in communities. As part of this mission, she has been developing nature-inspired drones that can move on both land and in the air -- blending her appreciation for nature, design, and the mechanics of how things work.
NTT develops world's first 'flying lightning rod' using drones
Telecom giant NTT has developed what it describes as the world's first "flying lightning rod," or drones that will trigger lightning and redirect it safely to the ground to prevent it from striking people or vital infrastructure. In multiple field tests in the mountainous areas of Hamada, Shimane Prefecture, between December and January, the company flew a drone equipped with a proprietary lightning-resistant cage to an approaching thundercloud when it noted the electric field intensity at ground level had increased, signaling an impending lightning strike. The drone, which was connected to the ground with a wire, triggered a lightning strike -- marking the first time such a feat has been achieved globally, according to NTT -- with the 2,000 volts of electric current flowing through the wire.
MEbots: Integrating a RISC-V Virtual Platform with a Robotic Simulator for Energy-aware Design
Pollo, Giovanni, Hamdi, Mohamed Amine, Risso, Matteo, Ruotolo, Lorenzo, Furbatto, Pietro, Isoldi, Matteo, Chen, Yukai, Burrello, Alessio, Macii, Enrico, Poncino, Massimo, Pagliari, Daniele Jahier, Vinco, Sara
Personal use of this material is permitted. Abstract --Virtual Platforms (VPs) enable early software validation of autonomous systems' electronics, reducing costs and time-to-market. While many VPs support both functional and non-functional simulation (e.g., timing, power), they lack the capability of simulating the environment in which the system operates. In contrast, robotics simulators lack accurate timing and power features. This twofold shortcoming limits the effectiveness of the design flow, as the designer can not fully evaluate the features of the solution under development. This paper presents a novel, fully open-source framework bridging this gap by integrating a robotics simulator (Webots) with a VP for RISC-V-based systems (MESSY). The framework enables a holistic, mission-level, energy-aware co-simulation of electronics in their surrounding environment, streamlining the exploration of design configurations and advanced power management policies. Virtual Platforms (VPs) enable comprehensive system modeling and simulation before physical production [1] and are thus a crucial resource in the design of modern embedded systems, characterized by heterogeneity and tight integration with the physical environment.