Drones
Israeli-deployed AI in Gaza likely helps IDF reduce civilian casualties, expert says
After loudly touting the use of artificial intelligence (AI) during their 11-day conflict against Hamas in 2021, the Israel Defense Forces (IDF) have been fairly tight-lipped about the AI systems they've employed in the post-Oct. Numerous media outlets have speculated that Israel's AI platforms are being used recklessly, but Blaise Misztal, Vice President for Policy at the Jewish Institute for National Security of America (JINSA), told Fox News Digital that he believes Israel is using AI-powered drone swarms, mapping drones and targeting systems as a means to minimize civilian casualties as they seek out Hamas terrorists hiding among the populace or holed up in tunnel systems laced beneath civilian architecture. Misztal says that available evidence implies drones are a "near constant companion for ground troops as they're maneuvering through Gaza," with the IDF telling JINSA researchers that "each unit has its own mini-Air Force" supporting troop movements. A number of AI-powered drones may be mapping the underground tunnels built below Gaza, or protecting those who are traversing them as they seek out terrorists or hostages. Iris, a ground-based, throwable unit manufactured by Elbit Systems "can enter small and confined spaces, above or underground, to explore hazardous areas while relaying intelligence and reconnaissance information in real-time."
A Hybrid Controller Design for Human-Assistive Piloting of an Underactuated Blimp
Meng, Wugang, Wu, Tianfu, Tao, Qiuyang, Zhang, Fumin
Abstract--This paper introduces a novel solution to the manual control challenge for indoor blimps. The problem's complexity arises from the conflicting demands of executing human commands while maintaining stability through automatic control for underactuated robots. To tackle this challenge, we introduced an assisted piloting hybrid controller with a preemptive mechanism, that seamlessly switches between executing human commands and activating automatic stabilization control. Our algorithm ensures that the automatic stabilization controller operates within the time delay between human observation and perception, providing assistance to the driver in a way that remains imperceptible. Unmanned aerial vehicles (UAVs) have become increasingly popular in various fields including military, agriculture, and significantly impact human perceptions of event causation transportation.
Public Computer Vision Datasets for Precision Livestock Farming: A Systematic Survey
Bhujel, Anil, Wang, Yibin, Lu, Yuzhen, Morris, Daniel, Dangol, Mukesh
Technology-driven precision livestock farming (PLF) empowers practitioners to monitor and analyze animal growth and health conditions for improved productivity and welfare. Computer vision (CV) is indispensable in PLF by using cameras and computer algorithms to supplement or supersede manual efforts for livestock data acquisition. Data availability is crucial for developing innovative monitoring and analysis systems through artificial intelligence-based techniques. However, data curation processes are tedious, time-consuming, and resource intensive. This study presents the first systematic survey of publicly available livestock CV datasets (https://github.com/Anil-Bhujel/Public-Computer-Vision-Dataset-A-Systematic-Survey). Among 58 public datasets identified and analyzed, encompassing different species of livestock, almost half of them are for cattle, followed by swine, poultry, and other animals. Individual animal detection and color imaging are the dominant application and imaging modality for livestock. The characteristics and baseline applications of the datasets are discussed, emphasizing the implications for animal welfare advocates. Challenges and opportunities are also discussed to inspire further efforts in developing livestock CV datasets. This study highlights that the limited quantity of high-quality annotated datasets collected from diverse environments, animals, and applications, the absence of contextual metadata, are a real bottleneck in PLF.
Toward Enhanced Reinforcement Learning-Based Resource Management via Digital Twin: Opportunities, Applications, and Challenges
Cheng, Nan, Wang, Xiucheng, Li, Zan, Yin, Zhisheng, Luan, Tom, Shen, Xuemin
This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when applied to physical networks, including limited exploration efficiency, slow convergence, poor long-term performance, and safety concerns during the exploration phase. To deal with the above challenges, a comprehensive DT-based framework is proposed to enhance the convergence speed and performance for unified RL-based resource management. The proposed framework provides safe action exploration, more accurate estimates of long-term returns, faster training convergence, higher convergence performance, and real-time adaptation to varying network conditions. Then, two case studies on ultra-reliable and low-latency communication (URLLC) services and multiple unmanned aerial vehicles (UAV) network are presented, demonstrating improvements of the proposed framework in performance, convergence speed, and training cost reduction both on traditional RL and neural network based Deep RL (DRL). Finally, the article identifies and explores some of the research challenges and open issues in this rapidly evolving field.
Classical and Quantum Physical Reservoir Computing for Onboard Artificial Intelligence Systems: A Perspective
Abbas, A. H., Abdel-Ghani, Hend, Maksymov, Ivan S.
Artificial intelligence (AI) systems of autonomous systems such as drones, robots and self-driving cars may consume up to 50% of total power available onboard, thereby limiting the vehicle's range of functions and considerably reducing the distance the vehicle can travel on a single charge. Next-generation onboard AI systems need an even higher power since they collect and process even larger amounts of data in real time. This problem cannot be solved using the traditional computing devices since they become more and more power-consuming. In this review article, we discuss the perspectives of development of onboard neuromorphic computers that mimic the operation of a biological brain using nonlinear-dynamical properties of natural physical environments surrounding autonomous vehicles. Previous research also demonstrated that quantum neuromorphic processors (QNPs) can conduct computations with the efficiency of a standard computer while consuming less than 1% of the onboard battery power. Since QNPs is a semi-classical technology, their technical simplicity and low, compared with quantum computers, cost make them ideally suitable for application in autonomous AI system. Providing a perspective view on the future progress in unconventional physical reservoir computing and surveying the outcomes of more than 200 interdisciplinary research works, this article will be of interest to a broad readership, including both students and experts in the fields of physics, engineering, quantum technologies and computing.
QUADFormer: Learning-based Detection of Cyber Attacks in Quadrotor UAVs
Wang, Pengyu, Yang, Zhaohua, Yang, Nachuan, Wang, Zikai, Li, Jialu, Zhang, Fan, Wang, Chaoqun, Wang, Jiankun, Meng, Max Q. -H., Shi, Ling
Safety-critical intelligent cyber-physical systems, such as quadrotor unmanned aerial vehicles (UAVs), are vulnerable to different types of cyber attacks, and the absence of timely and accurate attack detection can lead to severe consequences. When UAVs are engaged in large outdoor maneuvering flights, their system constitutes highly nonlinear dynamics that include non-Gaussian noises. Therefore, the commonly employed traditional statistics-based and emerging learning-based attack detection methods do not yield satisfactory results. In response to the above challenges, we propose QUADFormer, a novel Quadrotor UAV Attack Detection framework with transFormer-based architecture. This framework includes a residue generator designed to generate a residue sequence sensitive to anomalies. Subsequently, this sequence is fed into a transformer structure with disparity in correlation to specifically learn its statistical characteristics for the purpose of classification and attack detection. Finally, we design an alert module to ensure the safe execution of tasks by UAVs under attack conditions. We conduct extensive simulations and real-world experiments, and the results show that our method has achieved superior detection performance compared with many state-of-the-art methods.
Enhanced Intrusion Detection System for Multiclass Classification in UAV Networks
Menssouri, Safaa, Delamou, Mamady, Ibrahimi, Khalil, Amhoud, El Mehdi
Unmanned Aerial Vehicles (UAVs) have become increasingly popular in various applications, especially with the emergence of 6G systems and networks. However, their widespread adoption has also led to concerns regarding security vulnerabilities, making the development of reliable intrusion detection systems (IDS) essential for ensuring UAVs safety and mission success. This paper presents a new IDS for UAV networks. A binary-tuple representation was used for encoding class labels, along with a deep learning-based approach employed for classification. The proposed system enhances the intrusion detection by capturing complex class relationships and temporal network patterns. Moreover, a cross-correlation study between common features of different UAVs was conducted to discard correlated features that might mislead the classification of the proposed IDS. The full study was carried out using the UAV-IDS-2020 dataset, and we assessed the performance of the proposed IDS using different evaluation metrics. The experimental results highlighted the effectiveness of the proposed multiclass classifier model with an accuracy of 95%.
MPCC++: Model Predictive Contouring Control for Time-Optimal Flight with Safety Constraints
Krinner, Maria, Romero, Angel, Bauersfeld, Leonard, Zeilinger, Melanie, Carron, Andrea, Scaramuzza, Davide
Quadrotor flight is an extremely challenging problem due to the limited control authority encountered at the limit of handling. Model Predictive Contouring Control (MPCC) has emerged as a promising model-based approach for time optimization problems such as drone racing. However, the standard MPCC formulation used in quadrotor racing introduces the notion of the gates directly in the cost function, creating a multi objective optimization that continuously trades off between maximizing progress and tracking the path accurately. This paper introduces three key components that enhance the state-of-the-art MPCC approach for drone racing. First and foremost, we provide safety guarantees in the form of a track constraint and terminal set. The track constraint is designed as a spatial constraint which prevents gate collisions while allowing for time optimization only in the cost function. Second, we augment the existing first principles dynamics with a residual term that captures complex aerodynamic effects and thrust forces learned directly from real-world data. Third, we use Trust Region Bayesian Optimization (TuRBO), a state-of-the-art global Bayesian Optimization algorithm, to tune the hyperparameters of the MPCC controller given a sparse reward based on lap time minimization. The proposed approach achieves similar lap times to the best-performing RL policy and outperforms the best model-based controller while satisfying constraints. In both simulation and real world, our approach consistently prevents gate crashes with 100% success rate, while pushing the quadrotor to its physical limits reaching speeds of more than 80km/h.
Stung by rebel's drone tactics, Myanmar's junta builds its own fleet
Myanmar's resistance fighters notched decisive breakthroughs last year by relying on a scattered fleet of drones in battles against one of Southeast Asia's most feared militaries. But as the civil war grinds on, the rebels increasingly find their familiar weapons -- Chinese-made commercial drones modified to carry arms -- in the unfamiliar hands of the country's ruling junta, according to seven people with knowledge of the matter. "The battle is changing now as drones are being used by both sides," said a 31-year-old rebel fighter in the country's southeast, identifying himself by the nom de guerre of Ta Yoke Gyi. He said the junta began using armed unmanned aerial vehicles (UAVs) to attack the rebels at around the turn of the year, and that a drone his unit recently shot down was identified as Chinese from its components and had been modified for combat. Two rebel fighters in other parts of Myanmar also described similar skirmishes.
Current applications and potential future directions of reinforcement learning-based Digital Twins in agriculture
Goldenits, Georg, Mallinger, Kevin, Raubitzek, Sebastian, Neubauer, Thomas
Digital Twins have gained attention in various industries for simulation, monitoring, and decision-making, relying on ever-improving machine learning models. However, agricultural Digital Twin implementations are limited compared to other industries. Meanwhile, machine learning, particularly reinforcement learning, has shown potential in agricultural applications like optimizing decision-making, task automation, and resource management. A key aspect of Digital Twins is representing physical assets or systems in a virtual environment, which aligns well with reinforcement learning's need for environment representations to learn the best policy for a task. Reinforcement learning in agriculture can thus enable various Digital Twin applications in agricultural domains. This review aims to categorize existing research employing reinforcement learning in agricultural settings by application domains like robotics, greenhouse management, irrigation systems, and crop management, identifying potential future areas for reinforcement learning-based Digital Twins. It also categorizes the reinforcement learning techniques used, including tabular methods, Deep Q-Networks (DQN), Policy Gradient methods, and Actor-Critic algorithms, to overview currently employed models. The review seeks to provide insights into the state-of-the-art in integrating Digital Twins and reinforcement learning in agriculture, identifying gaps and opportunities for future research, and exploring synergies to tackle agricultural challenges and optimize farming, paving the way for more efficient and sustainable farming methodologies.