Drones
Battlefield demands spark AI race in Ukraine as war with Russia rages on
It's a scenario that has played out many times both on Russian and Western social media platforms. A video of a soldier, either Ukrainian or Russian, set in a ravaged and often exposed position who is spotted before he even knows he is being tracked. The soldier attempts to run, hide or out-maneuver the relentless robot in the sky. Some react in panic, others give in to their seemingly inevitable fate. But even watching from poor-quality video feed, the viewer can see the moment when the hunted man realizes he's been bested, and there is no escape.
Zelenskyy vows drone strikes on Russia despite U.S. dissent
Ukraine will keep targeting Russian oil-refining facilities despite U.S. discontent with its campaign, according to President Volodymyr Zelenskyy, who warned that Kyiv's forces may be forced to retreat "step by step" without more military aid from allies. The drone attacks are in retaliation against Kremlin strikes on Ukraine's energy grid and part of an effort to compel Moscow to stop them, The Washington Post's David Ignatius wrote in a column, citing an interview with Zelenskyy done Thursday in Kyiv. Ukrainian forces have attacked more than a dozen refineries inside Russia with explosive-laden drones over the past month, slashing fuel production. But the strikes irked Kyiv's allies in U.S. who are concerned about rising domestic fuel prices in an election year, the Financial Times reported last week, citing people familiar with the issue.
Russia-Ukraine war: List of key events, day 765
At least one person has been killed and two were injured after a drone crashed into an apartment building in Russia's Belgorod region. Authorities there said they evacuated more than 3,500 children following a spate of Ukrainian attacks. Russia targeted Ukraine's key energy infrastructure in escalated shelling, firing dozens of drones and missiles and injuring at least six people, according to Ukrainian officials. Ukraine's Air Force said 99 missiles and drones were fired, but 84 of them were intercepted. Ukraine introduced emergency blackouts in three regions – Dnipropetrovsk, Zaporizhia and Kirovograd – because of the attacks, and the authorities urged consumers in other regions to limit electricity consumption.
Multi-Stage Fusion Architecture for Small-Drone Localization and Identification Using Passive RF and EO Imagery: A Case Study
Wewelwala, Thakshila Wimalajeewa, Tedesso, Thomas W., Davis, Tony
Reliable detection, localization and identification of small drones is essential to promote safe, secure and privacy-respecting operation of Unmanned-Aerial Systems (UAS), or simply, drones. This is an increasingly challenging problem with only single modality sensing, especially, to detect and identify small drones. In this work, a multi-stage fusion architecture using passive radio frequency (RF) and electro-optic (EO) imagery data is developed to leverage the synergies of the modalities to improve the overall tracking and classification capabilities. For detection with EO-imagery, supervised deep learning based techniques as well as unsupervised foreground/background separation techniques are explored to cope with challenging environments. Using real collected data for Group 1 and 2 drones, the capability of each algorithm is quantified. In order to compensate for any performance gaps in detection with only EO imagery as well as to provide a unique device identifier for the drones, passive RF is integrated with EO imagery whenever available. In particular, drone detections in the image plane are combined with passive RF location estimates via detection-to-detection association after 3D to 2D transformation. Final tracking is performed on the composite detections in the 2D image plane. Each track centroid is given a unique identification obtained via RF fingerprinting. The proposed fusion architecture is tested and the tracking and performance is quantified over the range to illustrate the effectiveness of the proposed approaches using simultaneously collected passive RF and EO data at the Air Force Research Laboratory (AFRL) through ESCAPE-21 (Experiments, Scenarios, Concept of Operations, and Prototype Engineering) data collect
Self-Corrective Sensor Fusion for Drone Positioning in Indoor Facilities
González-Castaño, Francisco Javier, Gil-Castiñeira, Felipe, Rodríguez-Pereira, David, Regueiro-Janeiro, José Ángel, García-Méndez, Silvia, Candal-Ventureira, David
Drones may be more advantageous than fixed cameras for quality control applications in industrial facilities, since they can be redeployed dynamically and adjusted to production planning. The practical scenario that has motivated this paper, image acquisition with drones in a car manufacturing plant, requires drone positioning accuracy in the order of 5 cm. During repetitive manufacturing processes, it is assumed that quality control imaging drones will follow highly deterministic periodic paths, stop at predefined points to take images and send them to image recognition servers. Therefore, by relying on prior knowledge about production chain schedules, it is possible to optimize the positioning technologies for the drones to stay at all times within the boundaries of their flight plans, which will be composed of stopping points and the paths in between. This involves mitigating issues such as temporary blocking of line-of-sight between the drone and any existing radio beacons; sensor data noise; and the loss of visual references. We present a self-corrective solution for this purpose. It corrects visual odometer readings based on filtered and clustered Ultra-Wide Band (UWB) data, as an alternative to direct Kalman fusion. The approach combines the advantages of these technologies when at least one of them works properly at any measurement spot. It has three method components: independent Kalman filtering, data association by means of stream clustering and mutual correction of sensor readings based on the generation of cumulative correction vectors. The approach is inspired by the observation that UWB positioning works reasonably well at static spots whereas visual odometer measurements reflect straight displacements correctly but can underestimate their length. Our experimental results demonstrate the advantages of the approach in the application scenario over Kalman fusion.
Britain's 'drone superhighway' will be completed this SUMMER: 165-mile long network will let pilotless devices fly between the Midlands and the Southeast - but sceptics warn it will be 'annoying and intrusive' for people living under the flight path
While a drone superhighway might sound better suited to a science-fiction blockbuster than the Midlands, it's set to become a reality this summer. The world's first drone superhighway will open in the UK between June and early July, allowing pilotless drones to make high-speed deliveries across the country. Developed by drone software provider Altitude Angel, the 165-mile-long Skyway network will connect Coventry in the Midlands to Milton Keynes in the Southeast. However, sceptics have warned that the drone highway'inevitably poses risk' for the privacy and safety of Britons living in its flight path. Speaking to MailOnline, Chris Cole, director of campaign group Drone Wars, said: 'While the drone industry are incredibly happy about this, for people who end up living under the drones it may well end up being super annoying and super intrusive.'
OmniNxt: A Fully Open-source and Compact Aerial Robot with Omnidirectional Visual Perception
Liu, Peize, Feng, Chen, Xu, Yang, Ning, Yan, Xu, Hao, Shen, Shaojie
Adopting omnidirectional Field of View (FoV) cameras in aerial robots vastly improves perception ability, significantly advancing aerial robotics's capabilities in inspection, reconstruction, and rescue tasks. However, such sensors also elevate system complexity, e.g., hardware design, and corresponding algorithm, which limits researchers from utilizing aerial robots with omnidirectional FoV in their research. To bridge this gap, we propose OmniNxt, a fully open-source aerial robotics platform with omnidirectional perception. We design a high-performance flight controller NxtPX4 and a multi-fisheye camera set for OmniNxt. Meanwhile, the compatible software is carefully devised, which empowers OmniNxt to achieve accurate localization and real-time dense mapping with limited computation resource occupancy. We conducted extensive real-world experiments to validate the superior performance of OmniNxt in practical applications. All the hardware and software are open-access at https://github.com/HKUST-Aerial-Robotics/OmniNxt, and we provide docker images of each crucial module in the proposed system. Project page: https://hkust-aerial-robotics.github.io/OmniNxt.
A PPO-based DRL Auto-Tuning Nonlinear PID Drone Controller for Robust Autonomous Flights
Zhang, Junyang, Rivera, Cristian Emanuel Ocampo, Tyni, Kyle, Nguyen, Steven
This project aims to revolutionize drone flight control by implementing a nonlinear Deep Reinforcement Learning (DRL) agent as a replacement for traditional linear Proportional Integral Derivative (PID) controllers. The primary objective is to seamlessly transition drones between manual and autonomous modes, enhancing responsiveness and stability. We utilize the Proximal Policy Optimization (PPO) reinforcement learning strategy within the Gazebo simulator to train the DRL agent. Adding a $20,000 indoor Vicon tracking system offers <1mm positioning accuracy, which significantly improves autonomous flight precision. To navigate the drone in the shortest collision-free trajectory, we also build a 3 dimensional A* path planner and implement it into the real flight successfully.
FPGA-Based Neural Thrust Controller for UAVs
Azem, Sharif, Scheunert, David, Li, Mengguang, Gehrunger, Jonas, Cui, Kai, Hochberger, Christian, Koeppl, Heinz
The advent of unmanned aerial vehicles (UAVs) has improved a variety of fields by providing a versatile, cost-effective and accessible platform for implementing state-of-the-art algorithms. To accomplish a broader range of tasks, there is a growing need for enhanced on-board computing to cope with increasing complexity and dynamic environmental conditions. Recent advances have seen the application of Deep Neural Networks (DNNs), particularly in combination with Reinforcement Learning (RL), to improve the adaptability and performance of UAVs, especially in unknown environments. However, the computational requirements of DNNs pose a challenge to the limited computing resources available on many UAVs. This work explores the use of Field Programmable Gate Arrays (FPGAs) as a viable solution to this challenge, offering flexibility, high performance, energy and time efficiency. We propose a novel hardware board equipped with an Artix-7 FPGA for a popular open-source micro-UAV platform. We successfully validate its functionality by implementing an RL-based low-level controller using real-world experiments.
Should I Help a Delivery Robot? Cultivating Prosocial Norms through Observations
Chi, Vivienne Bihe, Mehrotra, Shashank, Misu, Teruhisa, Akash, Kumar
We propose leveraging prosocial observations to cultivate new social norms to encourage prosocial behaviors toward delivery robots. With an online experiment, we quantitatively assess updates in norm beliefs regarding human-robot prosocial behaviors through observational learning. Results demonstrate the initially perceived normativity of helping robots is influenced by familiarity with delivery robots and perceptions of robots' social intelligence. Observing human-robot prosocial interactions notably shifts peoples' normative beliefs about prosocial actions; thereby changing their perceived obligations to offer help to delivery robots. Additionally, we found that observing robots offering help to humans, rather than receiving help, more significantly increased participants' feelings of obligation to help robots. Our findings provide insights into prosocial design for future mobility systems. Improved familiarity with robot capabilities and portraying them as desirable social partners can help foster wider acceptance. Furthermore, robots need to be designed to exhibit higher levels of interactivity and reciprocal capabilities for prosocial behavior.