Drones
Russia says 13 Ukrainian drones downed on way to attack Sevastopol, Moscow
Russian forces took down more than a dozen Ukrainian drones flying towards the capital Moscow and the city of Sevastopol in the annexed Crimean peninsula, according to the country's defence ministry. The attack on Moscow on Thursday is the latest in a series of Ukrainian drone raids deep inside Russian territory. The defence ministry said in a statement that two drones "flying in the direction of the city of Moscow were destroyed", while 11 others were brought down near the city of Sevastopol. Two of the Ukrainian drones were "hit by on-duty anti-aircraft defence equipment, another nine were suppressed by means of electronic warfare and crashed in the Black Sea before reaching the target", the ministry said of the attack. There was no immediate comment from Ukraine.
Follow Anything: Open-set detection, tracking, and following in real-time
Maalouf, Alaa, Jadhav, Ninad, Jatavallabhula, Krishna Murthy, Chahine, Makram, Vogt, Daniel M., Wood, Robert J., Torralba, Antonio, Rus, Daniela
Tracking and following objects of interest is critical to several robotics use cases, ranging from industrial automation to logistics and warehousing, to healthcare and security. In this paper, we present a robotic system to detect, track, and follow any object in real-time. Our approach, dubbed ``follow anything'' (FAn), is an open-vocabulary and multimodal model -- it is not restricted to concepts seen at training time and can be applied to novel classes at inference time using text, images, or click queries. Leveraging rich visual descriptors from large-scale pre-trained models (foundation models), FAn can detect and segment objects by matching multimodal queries (text, images, clicks) against an input image sequence. These detected and segmented objects are tracked across image frames, all while accounting for occlusion and object re-emergence. We demonstrate FAn on a real-world robotic system (a micro aerial vehicle) and report its ability to seamlessly follow the objects of interest in a real-time control loop. FAn can be deployed on a laptop with a lightweight (6-8 GB) graphics card, achieving a throughput of 6-20 frames per second. To enable rapid adoption, deployment, and extensibility, we open-source all our code on our project webpage at https://github.com/alaamaalouf/FollowAnything . We also encourage the reader the watch our 5-minutes explainer video in this https://www.youtube.com/watch?v=6Mgt3EPytrw .
Collaborative Learning with a Drone Orchestrator
Mashhadi, Mahdi Boloursaz, Mahdavimoghadam, Mahnoosh, Tafazolli, Rahim, Saad, Walid
In this paper, the problem of drone-assisted collaborative learning is considered. In this scenario, swarm of intelligent wireless devices train a shared neural network (NN) model with the help of a drone. Using its sensors, each device records samples from its environment to gather a local dataset for training. The training data is severely heterogeneous as various devices have different amount of data and sensor noise level. The intelligent devices iteratively train the NN on their local datasets and exchange the model parameters with the drone for aggregation. For this system, the convergence rate of collaborative learning is derived while considering data heterogeneity, sensor noise levels, and communication errors, then, the drone trajectory that maximizes the final accuracy of the trained NN is obtained. The proposed trajectory optimization approach is aware of both the devices data characteristics (i.e., local dataset size and noise level) and their wireless channel conditions, and significantly improves the convergence rate and final accuracy in comparison with baselines that only consider data characteristics or channel conditions. Compared to state-of-the-art baselines, the proposed approach achieves an average 3.85% and 3.54% improvement in the final accuracy of the trained NN on benchmark datasets for image recognition and semantic segmentation tasks, respectively. Moreover, the proposed framework achieves a significant speedup in training, leading to an average 24% and 87% saving in the drone hovering time, communication overhead, and battery usage, respectively for these tasks.
Russia shoots down drones near Moscow in alleged Ukrainian attack
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. Russia claims it shot down two drones attempting to attack targets in Moscow on Wednesday, the third such incident in recent months. Russia's Defense Ministry released a statement blaming the attack on Ukraine and framing the incident as an attempted "terrorist attack." Russian officials said the drones were destroyed without causing any damage or casualties.
Russia shoots down two armed drones headed for Moscow
Russian air defences have shot down two armed drones headed for Moscow, the city's mayor said, the latest in a surge of drone attacks on Russia's capital city. Moscow Mayor Sergei Sobyanin said early on Wednesday that one drone was downed in the Domodedovo area on the southern outskirts of the city, while the second was shot down in the Minsk highway area, west of the capital. "Two combat drones' attempt to fly into the city was recorded. Both were shot down by air defence," Sobyanin said on the Telegram messaging channel, without naming an attacker. "At the moment, there is no information about victims of the fall of the wreckage," he said, adding that emergency services were on the ground.
Autonomous Power Line Inspection with Drones via Perception-Aware MPC
Xing, Jiaxu, Cioffi, Giovanni, Hidalgo-Carrió, Javier, Scaramuzza, Davide
Drones have the potential to revolutionize power line inspection by increasing productivity, reducing inspection time, improving data quality, and eliminating the risks for human operators. Current state-of-the-art systems for power line inspection have two shortcomings: (i) control is decoupled from perception and needs accurate information about the location of the power lines and masts; (ii) obstacle avoidance is decoupled from the power line tracking, which results in poor tracking in the vicinity of the power masts, and, consequently, in decreased data quality for visual inspection. In this work, we propose a model predictive controller (MPC) that overcomes these limitations by tightly coupling perception and action. Our controller generates commands that maximize the visibility of the power lines while, at the same time, safely avoiding the power masts. For power line detection, we propose a lightweight learning-based detector that is trained only on synthetic data and is able to transfer zero-shot to real-world power line images. We validate our system in simulation and real-world experiments on a mock-up power line infrastructure. We release our code and datasets to the public.
Open Problems in Computer Vision for Wilderness SAR and The Search for Patricia Wu-Murad
Manzini, Thomas, Murphy, Robin
This paper details the challenges in applying two computer vision systems, an EfficientDET supervised learning model and the unsupervised RX spectral classifier, to 98.9 GB of drone imagery from the Wu-Murad wilderness search and rescue (WSAR) effort in Japan and identifies 3 directions for future research. There have been at least 19 proposed approaches and 3 datasets aimed at locating missing persons in drone imagery, but only 3 approaches (2 unsupervised and 1 of an unknown structure) are referenced in the literature as having been used in an actual WSAR operation. Of these proposed approaches, the EfficientDET architecture and the unsupervised spectral RX classifier were selected as the most appropriate for this setting. The EfficientDET model was applied to the HERIDAL dataset and despite achieving performance that is statistically equivalent to the state-of-the-art, the model fails to translate to the real world in terms of false positives (e.g., identifying tree limbs and rocks as people), and false negatives (e.g., failing to identify members of the search team). The poor results in practice for algorithms that showed good results on datasets suggest 3 areas of future research: more realistic datasets for wilderness SAR, computer vision models that are capable of seamlessly handling the variety of imagery that can be collected during actual WSAR operations, and better alignment on performance measures.
Drones4Good: Supporting Disaster Relief Through Remote Sensing and AI
Merkle, Nina, Bahmanyar, Reza, Henry, Corentin, Azimi, Seyed Majid, Yuan, Xiangtian, Schopferer, Simon, Gstaiger, Veronika, Auer, Stefan, Schneibel, Anne, Wieland, Marc, Kraft, Thomas
In order to respond effectively in the aftermath of a disaster, emergency services and relief organizations rely on timely and accurate information about the affected areas. Remote sensing has the potential to significantly reduce the time and effort required to collect such information by enabling a rapid survey of large areas. To achieve this, the main challenge is the automatic extraction of relevant information from remotely sensed data. In this work, we show how the combination of drone-based data with deep learning methods enables automated and large-scale situation assessment. In addition, we demonstrate the integration of onboard image processing techniques for the deployment of autonomous drone-based aid delivery. The results show the feasibility of a rapid and large-scale image analysis in the field, and that onboard image processing can increase the safety of drone-based aid deliveries.
Collaborative Wideband Spectrum Sensing and Scheduling for Networked UAVs in UTM Systems
Chintareddy, Sravan Reddy, Roach, Keenan, Cheung, Kenny, Hashemi, Morteza
In this paper, we propose a data-driven framework for collaborative wideband spectrum sensing and scheduling for networked unmanned aerial vehicles (UAVs), which act as the secondary users to opportunistically utilize detected spectrum holes. To this end, we propose a multi-class classification problem for wideband spectrum sensing to detect vacant spectrum spots based on collected I/Q samples. To enhance the accuracy of the spectrum sensing module, the outputs from the multi-class classification by each individual UAV are fused at a server in the unmanned aircraft system traffic management (UTM) ecosystem. In the spectrum scheduling phase, we leverage reinforcement learning (RL) solutions to dynamically allocate the detected spectrum holes to the secondary users (i.e., UAVs). To evaluate the proposed methods, we establish a comprehensive simulation framework that generates a near-realistic synthetic dataset using MATLAB LTE toolbox by incorporating base-station~(BS) locations in a chosen area of interest, performing ray-tracing, and emulating the primary users channel usage in terms of I/Q samples. This evaluation methodology provides a flexible framework to generate large spectrum datasets that could be used for developing ML/AI-based spectrum management solutions for aerial devices.
How to Communicate Robot Motion Intent: A Scoping Review
Pascher, Max, Gruenefeld, Uwe, Schneegass, Stefan, Gerken, Jens
Robots are becoming increasingly omnipresent in our daily lives, supporting us and carrying out autonomous tasks. In Human-Robot Interaction, human actors benefit from understanding the robot's motion intent to avoid task failures and foster collaboration. Finding effective ways to communicate this intent to users has recently received increased research interest. However, no common language has been established to systematize robot motion intent. This work presents a scoping review aimed at unifying existing knowledge. Based on our analysis, we present an intent communication model that depicts the relationship between robot and human through different intent dimensions (intent type, intent information, intent location). We discuss these different intent dimensions and their interrelationships with different kinds of robots and human roles. Throughout our analysis, we classify the existing research literature along our intent communication model, allowing us to identify key patterns and possible directions for future research.