Drones
ORBSLAM3-Enhanced Autonomous Toy Drones: Pioneering Indoor Exploration
Tukan, Murad, Fares, Fares, Grufinkle, Yotam, Talmor, Ido, Mualem, Loay, Braverman, Vladimir, Feldman, Dan
Navigating toy drones through uncharted GPS-denied indoor spaces poses significant difficulties due to their reliance on GPS for location determination. In such circumstances, the necessity for achieving proper navigation is a primary concern. In response to this formidable challenge, we introduce a real-time autonomous indoor exploration system tailored for drones equipped with a monocular \emph{RGB} camera. Our system utilizes \emph{ORB-SLAM3}, a state-of-the-art vision feature-based SLAM, to handle both the localization of toy drones and the mapping of unmapped indoor terrains. Aside from the practicability of \emph{ORB-SLAM3}, the generated maps are represented as sparse point clouds, making them prone to the presence of outlier data. To address this challenge, we propose an outlier removal algorithm with provable guarantees. Furthermore, our system incorporates a novel exit detection algorithm, ensuring continuous exploration by the toy drone throughout the unfamiliar indoor environment. We also transform the sparse point to ensure proper path planning using existing path planners. To validate the efficacy and efficiency of our proposed system, we conducted offline and real-time experiments on the autonomous exploration of indoor spaces. The results from these endeavors demonstrate the effectiveness of our methods.
Task-oriented Semantics-aware Communications for Robotic Waypoint Transmission: the Value and Age of Information Approach
Wu, Wenchao, Yang, Yuanqing, Deng, Yansha, Aghvami, A. Hamid
The ultra-reliable and low-latency communication (URLLC) service of the fifth-generation (5G) mobile communication network struggles to support safe robot operation. Nowadays, the sixth-generation (6G) mobile communication network is proposed to provide hyper-reliable and low-latency communication to enable safer control for robots. However, current 5G/ 6G research mainly focused on improving communication performance, while the robotics community mostly assumed communication to be ideal. To jointly consider communication and robotic control with a focus on the specific robotic task, we propose task-oriented and semantics-aware communication in robotic control (TSRC) to exploit the context of data and its importance in achieving the task at both transmitter and receiver. At the transmitter, we propose a deep reinforcement learning algorithm to generate optimal control and command (C&C) data and a proactive repetition scheme (DeepPro) to increase the successful transmission probability. At the receiver, we design the value of information (VoI) and age of information (AoI) based queue ordering mechanism (VA-QOM) to reorganize the queue based on the semantic information extracted from the AoI and the VoI. The simulation results validate that our proposed TSRC framework achieves a 91.5% improvement in the mean square error compared to the traditional unmanned aerial vehicle control framework.
US imposes new round of sanctions on network involved in Iran's drone production
The United States on Tuesday imposed a new round of sanctions against 10 entities and four individuals for their involvement in procuring materials for the production of drones in Iran. The sanctions target a network spanning Iran, Malaysia, Hong Kong, and Indonesia led by Hossein Hatefi Ardakani, according to the U.S. State and Treasury Department. Ardakani and Gary Lam, who worked for a Chinese company, and their co-conspirators were named as defendants in a Justice Department press release. Unmanned aerial vehicles (UAV) drill held by Iranian army in Semnan, Iran on January 5, 2021. The U.S. said these individuals and entities were involved in the procurement of sensitive goods, including U.S.-origin electronic components, for one-way attack drones produced by the Islamic Revolutionary Guard Corps Aerospace Force Self Sufficiency Jihad Organization and its drone program.
Multi-Agent Reinforcement Learning with Action Masking for UAV-enabled Mobile Communications
Unmanned Aerial Vehicles (UAVs) are increasingly used as aerial base stations to provide ad hoc communications infrastructure. Building upon prior research efforts which consider either static nodes, 2D trajectories or single UAV systems, this paper focuses on the use of multiple UAVs for providing wireless communication to mobile users in the absence of terrestrial communications infrastructure. In particular, we jointly optimize UAV 3D trajectory and NOMA power allocation to maximize system throughput. Firstly, a weighted K-means-based clustering algorithm establishes UAV-user associations at regular intervals. The efficacy of training a novel Shared Deep Q-Network (SDQN) with action masking is then explored. Unlike training each UAV separately using DQN, the SDQN reduces training time by using the experiences of multiple UAVs instead of a single agent. We also show that SDQN can be used to train a multi-agent system with differing action spaces. Simulation results confirm that: 1) training a shared DQN outperforms a conventional DQN in terms of maximum system throughput (+20%) and training time (-10%); 2) it can converge for agents with different action spaces, yielding a 9% increase in throughput compared to mutual learning algorithms; and 3) combining NOMA with an SDQN architecture enables the network to achieve a better sum rate compared with existing baseline schemes.
Pitch-axis supermanoeuvrability in a biomimetic morphing-wing UAV
Birds and bats are extraordinarily adept flyers: whether in hunting prey, or evading predators, agility and manoeuvrability in flight are vital. In conventional high-performance aircraft, approaches to extreme manoeuvrability, such as post-stall manoeuvring, have often focused on thrust-vectoring technology - the domain of classical supermanoeuvrability - rather than biomimicry. In this work, however, we show that these approaches are not incompatible: biomimetic wing morphing is an avenue both to classical supermanoeuvrability, and to new forms of biologically-inspired supermanoeuvrability. Using a flight simulator equipped with a multibody model of lifting surface motion and a Goman-Khrabrov dynamic stall model for all lifting surfaces, we demonstrate the capability of a biomimetic morphing-wing unmanned aerial vehicles (UAV) for two key forms of supermanoeuvrability: the Pugachev cobra, and ballistic transition. Conclusions are drawn as to the mechanism by which these manoeuvres can be performed, and their feasibility in practical biomimetic unmanned aerial vehicle (UAV). These conclusions have wide relevance to both the design of supermanoeuvrable UAVs, and the study of biological flight dynamics across species.
Multi-Armed Bandit Learning for Content Provisioning in Network of UAVs
Bhuyan, Amit Kumar, Dutta, Hrishikesh, Biswas, Subir
This paper proposes an unmanned aerial vehicle (UAV) aided content management system in communication-challenged disaster scenarios. Without cellular infrastructure in such scenarios, community of stranded users can be provided access to situation-critical contents using a hybrid network of static and traveling UAVs. A set of relatively static anchor UAVs can download content from central servers and provide content access to its local users. A set of ferrying UAVs with wider mobility can provision content to users by shuffling them across different anchor UAVs while visiting different communities of users. The objective is to design a content dissemination system that on-the-fly learns content caching policies for maximizing content availability to the stranded users. This paper proposes a decentralized Top-k Multi-Armed Bandit Learning model for UAV-caching decision-making that takes geo-temporal differences in content popularity and heterogeneity in content demands into consideration. The proposed paradigm is able to combine the expected reward maximization attribute and a proposed multi-dimensional reward structure of Top-k Multi-Armed Bandit, for caching decision at the UAVs. This study is done for different user-specified tolerable access delay, heterogeneous popularity distributions, and inter-community geographical characteristics. Functional verification and performance evaluation of the proposed caching framework is done for a wide range of network size, UAV distribution, and content popularity.
Human-Machine Teaming for UAVs: An Experimentation Platform
Moujtahid, Laila El, Gottipati, Sai Krishna, Mars, Clodéric, Taylor, Matthew E.
Full automation is often not achievable or desirable in critical systems with high-stakes decisions. Instead, human-AI teams can achieve better results. To research, develop, evaluate, and validate algorithms suited for such teaming, lightweight experimentation platforms that enable interactions between humans and multiple AI agents are necessary. However, there are limited examples of such platforms for defense environments. To address this gap, we present the Cogment human-machine teaming experimentation platform, which implements human-machine teaming (HMT) use cases that features heterogeneous multi-agent systems and can involve learning AI agents, static AI agents, and humans. It is built on the Cogment platform and has been used for academic research, including work presented at the ALA workshop at AAMAS this year [1]. With this platform, we hope to facilitate further research on human-machine teaming in critical systems and defense environments.
3D exploration-based search for multiple targets using a UAV
Yousuf, Bilal, Lendek, Zsofia, Busoniu, Lucian
Consider an unmanned aerial vehicle (UAV) that searches for an unknown number of targets at unknown positions in 3D space. A particle filter uses imperfect measurements about the targets to update an intensity function that represents the expected number of targets. We propose a receding-horizon planner that selects the next UAV position by maximizing a joint, exploration and target-refinement objective. Confidently localized targets are saved and removed from consideration. A nonlinear controller with an obstacle-avoidance component is used to reach the desired waypoints. We demonstrate the performance of our approach through a series of simulations, as well as in real-robot experiments with a Parrot Mambo drone that searches for targets from a constant altitude. The proposed planner works better than a lawnmower and a target-refinement-only method.
Coordinated Navigation Control of Cross-Domain Unmanned Systems via Guiding Vector Fields
Hu, Bin-Bin, Zhang, Hai-Tao, Liu, Bin, Ding, Jianing, Xu, Yifan, Luo, Chuanshang, Cao, Haosen
This paper proposes a distributed guiding-vector-field (DGVF) controller for cross-domain unmanned systems (CDUSs) consisting of heterogeneous unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs), to achieve coordinated navigation whereas maneuvering along their prescribed paths. In particular, the DGVF controller provides a hierarchical architecture of an upper-level heterogeneous guidance velocity controller and a lower-level signal tracking regulator. Therein, the upper-level controller is to govern multiple heterogeneous USVs and UAVs to approach and maneuver along the prescribed paths and coordinate the formation simultaneously, whereas the low-level regulator is to track the corresponding desired guidance signals provided by the upper-level module. Significantly, the heterogeneous coordination among neighboring UAVs and USVs is achieved merely by the lightweight communication of a scalar (i.e., the additional virtual coordinate), which substantially decreases the communication and computational costs. Sufficient conditions assuring asymptotical convergence of the closed-loop system are derived in presence of the exponentially vanishing tracking errors. Finally, real-lake experiments are conducted on a self-established cross-domain heterogeneous platform consisting of three M-100 UAVs, two HUSTER-16 USVs, a HUSTER-12C USV, and a WiFi 5G wireless communication station to verify the effectiveness of the present DGVF controller.
Decentralized traffic management of autonomous drones
Balázs, Boldizsár, Vicsek, Tamás, Somorjai, Gergő, Nepusz, Tamás, Vásárhelyi, Gábor
Coordination of local and global aerial traffic has become a legal and technological bottleneck as the number of unmanned vehicles in the common airspace continues to grow. To meet this challenge, automation and decentralization of control is an unavoidable requirement. In this paper, we present a solution that enables self-organization of cooperating autonomous agents into an effective traffic flow state in which the common aerial coordination task - filled with conflicts - is resolved. Using realistic simulations, we show that our algorithm is safe, efficient, and scalable regarding the number of drones and their speed range, while it can also handle heterogeneous agents and even pairwise priorities between them. The algorithm works in any sparse or dense traffic scenario in two dimensions and can be made increasingly efficient by a layered flight space structure in three dimensions. To support the feasibility of our solution, we experimentally demonstrate coordinated aerial traffic of 100 autonomous drones within a circular area with a radius of 125 meters.