Drones
Energy-Aware Multi-Agent Reinforcement Learning for Collaborative Execution in Mission-Oriented Drone Networks
Li, Ying, Li, Changling, Chen, Jiyao, Roinou, Christine
Mission-oriented drone networks have been widely used for structural inspection, disaster monitoring, border surveillance, etc. Due to the limited battery capacity of drones, mission execution strategy impacts network performance and mission completion. However, collaborative execution is a challenging problem for drones in such a dynamic environment as it also involves efficient trajectory design. We leverage multi-agent reinforcement learning (MARL) to manage the challenge in this study, letting each drone learn to collaboratively execute tasks and plan trajectories based on its current status and environment. Simulation results show that the proposed collaborative execution model can successfully complete the mission at least 80% of the time, regardless of task locations and lengths, and can even achieve a 100% success rate when the task density is not way too sparse. To the best of our knowledge, our work is one of the pioneer studies on leveraging MARL on collaborative execution for mission-oriented drone networks; the unique value of this work lies in drone battery level driving our model design.
Environment as Policy: Learning to Race in Unseen Tracks
Wang, Hongze, Xing, Jiaxu, Messikommer, Nico, Scaramuzza, Davide
Reinforcement learning (RL) has achieved outstanding success in complex robot control tasks, such as drone racing, where the RL agents have outperformed human champions in a known racing track. However, these agents fail in unseen track configurations, always requiring complete retraining when presented with new track layouts. This work aims to develop RL agents that generalize effectively to novel track configurations without retraining. The naive solution of training directly on a diverse set of track layouts can overburden the agent, resulting in suboptimal policy learning as the increased complexity of the environment impairs the agent's ability to learn to fly. To enhance the generalizability of the RL agent, we propose an adaptive environment-shaping framework that dynamically adjusts the training environment based on the agent's performance. We achieve this by leveraging a secondary RL policy to design environments that strike a balance between being challenging and achievable, allowing the agent to adapt and improve progressively. Using our adaptive environment shaping, one single racing policy efficiently learns to race in diverse challenging tracks. Experimental results validated in both simulation and the real world show that our method enables drones to successfully fly complex and unseen race tracks, outperforming existing environment-shaping techniques. Project page: http://rpg.ifi.uzh.ch/env_as_policy/index.html
A Time and Place to Land: Online Learning-Based Distributed MPC for Multirotor Landing on Surface Vessel in Waves
Stephenson, Jess, Stewart, William S., Greeff, Melissa
Landing a multirotor unmanned aerial vehicle (UAV) on an uncrewed surface vessel (USV) extends the operational range and offers recharging capabilities for maritime and limnology applications, such as search-and-rescue and environmental monitoring. However, autonomous UAV landings on USVs are challenging due to the unpredictable tilt and motion of the vessel caused by waves. This movement introduces spatial and temporal uncertainties, complicating safe, precise landings. Existing autonomous landing techniques on unmanned ground vehicles (UGVs) rely on shared state information, often causing time delays due to communication limits. This paper introduces a learning-based distributed Model Predictive Control (MPC) framework for autonomous UAV landings on USVs in wave-like conditions. Each vehicle's MPC optimizes for an artificial goal and input, sharing only the goal with the other vehicle. These goals are penalized by coupling and platform tilt costs, learned as a Gaussian Process (GP). We validate our framework in comprehensive indoor experiments using a custom-designed platform attached to a UGV to simulate USV tilting motion. Our approach achieves a 53% increase in landing success compared to an approach that neglects the impact of tilt motion on landing.
AI-Driven Human-Autonomy Teaming in Tactical Operations: Proposed Framework, Challenges, and Future Directions
Hagos, Desta Haileselassie, Alami, Hassan El, Rawat, Danda B.
Artificial Intelligence (AI) techniques, particularly machine learning techniques, are rapidly transforming tactical operations by augmenting human decision-making capabilities. This paper explores AI-driven Human-Autonomy Teaming (HAT) as a transformative approach, focusing on how it empowers human decision-making in complex environments. While trust and explainability continue to pose significant challenges, our exploration focuses on the potential of AI-driven HAT to transform tactical operations. By improving situational awareness and supporting more informed decision-making, AI-driven HAT can enhance the effectiveness and safety of such operations. To this end, we propose a comprehensive framework that addresses the key components of AI-driven HAT, including trust and transparency, optimal function allocation between humans and AI, situational awareness, and ethical considerations. The proposed framework can serve as a foundation for future research and development in the field. By identifying and discussing critical research challenges and knowledge gaps in this framework, our work aims to guide the advancement of AI-driven HAT for optimizing tactical operations. We emphasize the importance of developing scalable and ethical AI-driven HAT systems that ensure seamless human-machine collaboration, prioritize ethical considerations, enhance model transparency through Explainable AI (XAI) techniques, and effectively manage the cognitive load of human operators.
Sensor Fusion for Autonomous Indoor UAV Navigation in Confined Spaces
James, Alice, Seth, Avishkar, Kuantama, Endrowednes, Mukhopadhyay, Subhas, Han, Richard
In this paper, we address the challenge of navigating through unknown indoor environments using autonomous aerial robots within confined spaces. The core of our system involves the integration of key sensor technologies, including depth sensing from the ZED 2i camera, IMU data, and LiDAR measurements, facilitated by the Robot Operating System (ROS) and RTAB-Map. Through custom designed experiments, we demonstrate the robustness and effectiveness of this approach. Our results showcase a promising navigation accuracy, with errors as low as 0.4 meters, and mapping quality characterized by a Root Mean Square Error (RMSE) of just 0.13 m. Notably, this performance is achieved while maintaining energy efficiency and balanced resource allocation, addressing a crucial concern in UAV applications. Flight tests further underscore the precision of our system in maintaining desired flight orientations, with a remarkable error rate of only 0.1%. This work represents a significant stride in the development of autonomous indoor UAV navigation systems, with potential applications in search and rescue, facility inspection, and environmental monitoring within GPS-denied indoor environments.
Aerodynamics and Sensing Analysis for Efficient Drone-Based Parcel Delivery
Seth, Avishkar, James, Alice, Kuantama, Endrowednes, Mukhopadhyay, Subhas, Han, Richard
In an era of rapid urbanization and e-commerce growth, efficient parcel delivery methods are crucial. This paper presents a detailed study of the aerodynamics and sensing analysis of drones for parcel delivery. Utilizing Computational Fluid Dynamics (CFD), the study offers a comprehensive airflow analysis, revealing the aerodynamic forces affecting drone stability due to payload capacity. A multidisciplinary approach is employed, integrating mechanical design, control theory, and sensing systems to address the complex issue of parcel positioning. The experimental validation section rigorously tests different size payloads and their positions and impact on drones with maximum thrusts of 2000 gf. The findings prove the drone's capacity to lift a large payload that covers up to 50 percent of the propeller, thereby contributing to optimizing drone designs and sustainable parcel delivery systems. It has been observed that the drone can lift a large payload smoothly when placed above the drone, with an error rate as low as 0.1 percent for roll, pitch, and yaw. This work paved the way for more versatile, real-world applications of drone technology, setting a new standard in the field.
Russia is supplying Houthis with satellite data to attack ships in the Red Sea: report
Israel launched its first-ever strikes against Houthi rebels in Yemen just days after Jerusalem vowed revenge for a drone strike on Tel Aviv. Russia has been aiding the Houthis' assault on Western shipping lanes in the Red Sea by providing them targeting data. As the Houthis ramped up their strikes on the U.S. and other nations' postures in the region after the Oct. 7 attack on Israel, Russians offered satellite data allowing them to expand their strikes, take out multimillion-dollar U.S. drones and hit ships sailing through the Red Sea and the Suez Canal, through which 12% of global trade passes, according to a Wall Street Journal report. Each munition used to intercept a Houthi strike costs the U.S. upwards of between 1 million and 4 million. The data passed through Iran's Revolutionary Guard Corps (IRGC).
PKK claims attack on Turkish defence company near Ankara that killed five
The outlawed Kurdistan Workers' Party (PKK) has claimed responsibility for an attack on a Turkish state-run defence company near the capital, Ankara, that killed five people and wounded 22. The "act of sacrifice" in Ankara "was carried out by a team of the immortals battalion" of the PKK, the group said on the Telegram messaging app on Friday. Turkish Aerospace Industries (TUSAS) was attacked on Wednesday with fighters setting off explosives and opening fire using automatic rifles at the campus of the company that designs and manufactures civilian and military aircraft, unmanned aerial vehicles (UAVs) and other defence industry and space systems. On Friday, Turkey's Ministry of National Defence said it carried out air strikes for the second night in a row in northern Iraq, hitting 34 PKK targets in Hakurk, Gara, Qandil and Sinjar, destroying shelters, warehouses and other facilities. The overnight strikes followed a security meeting that Turkish President Recep Tayyip Erdogan chaired with key ministers and chiefs of the armed forces and intelligence agency in Istanbul. The Turkish government said earlier it had proof that the PKK, listed as a terror group by Turkey, the United States and the European Union, was behind the attack.
Meet the perfect holiday gift: A drone that's half off!
This year has flown by so quickly that gifting season is only weeks away. You better believe it's time to brainstorm gifting ideas and place some orders if you aren't the procrastinating type. Here's a gift that anyone would love to see under the tree: A camera drone. Imagine their face as they unwrap the box, revealing years of aerial adventures, explorations, and photography to come. The Ninja Dragon Sky 8 drone is 50 percent off right now, making it just 99.99.