Goto

Collaborating Authors

 Drones


Towards Perception-based Collision Avoidance for UAVs when Guiding the Visually Impaired

arXiv.org Artificial Intelligence

Autonomous navigation by drones using onboard sensors combined with machine learning and computer vision algorithms is impacting a number of domains, including agriculture, logistics, and disaster management. In this paper, we examine the use of drones for assisting visually impaired people (VIPs) in navigating through outdoor urban environments. Specifically, we present a perception-based path planning system for local planning around the neighborhood of the VIP, integrated with a global planner based on GPS and maps for coarse planning. We represent the problem using a geometric formulation and propose a multi DNN based framework for obstacle avoidance of the UAV as well as the VIP. Our evaluations conducted on a drone human system in a university campus environment verifies the feasibility of our algorithms in three scenarios; when the VIP walks on a footpath, near parked vehicles, and in a crowded street.


Senators Ricketts, Fetterman unite against China's quiet invasion of US farmland

FOX News

Sen. Pete Ricketts, R-Neb., spoke with Fox News Digital about his bipartisan bill to codify oversight of foreign adversaries, including China, buying American farmland. EXCLUSIVE: Republican Sen. Pete Ricketts is leading the charge with Democrat Sen. John Fetterman to codify oversight on foreign countries buying American farmland. The bipartisan Agricultural Foreign Investment Disclosure (AFIDA) Improvements Act seeks to implement recommendations published by the Government Accountability Office (GAO) in January 2024, which found the AFIDA was ill-equipped to combat foreign ownership of American agricultural land. "Communist China is our greatest geopolitical threat," Ricketts told Fox News Digital in an exclusive interview, adding, "This is a way for us to improve the disclosure that's going on with regard to the purchase of this agricultural land, so we can take other action if necessary to make sure we're not giving Communist China the opportunity to buy agricultural land." The bill's proposal comes as two Chinese nationals – a University of Michigan post-doctoral research fellow, Yunqing Jian, and Huazhong University of Science and Technology student Chengxuan Han – were held in federal custody after they were accused of smuggling biological materials into the United States.


'Eyes in the sky': Army drone expert explains US strategy on innovation as global conflict looms

FOX News

Garrett Butts details military drone innovation effort aimed at speeding deployment and reducing cost in an exclusive interview with Fox News Digital. As the war between Israel and Iran intensifies, one Army drone expert is warning that the U.S. must stay ready, and fast. Garrett Butts is helping lead the charge by building smarter, cheaper unmanned aircraft systems (UAS) in-house for the battlefield. In an exclusive interview with Fox News Digital on Tuesday, Butts described how his team is creating drone technology from scratch, often using parts it took nearly a year to legally obtain. "We're a transformation and contact unit," said Butts, who serves with the 1st Cavalry Division.


Ukraine's 'Spiderweb' drone assault forces Russia to shelter, move aircraft

Al Jazeera

Russia's increased sense of vulnerability may be the most important result of a recent large-scale Ukrainian drone attack named Operation Spiderweb, experts tell Al Jazeera. The operation destroyed as much as a third of Russia's strategic bomber fleet on the tarmac of four airfields deep inside Russia on June 1. Days later, Russia started to build shelters for its bombers and relocate them. An open source intelligence (OSINT) researcher nicknamed Def Mon posted time-lapse satellite photographs on social media showing major excavations at the Kirovskoe airfield in annexed Crimea as well as in Sevastopol, Gvardiyskoye and Saki, where Russia was constructing shelters for military aircraft. They reported similar work at several airbases in Russia, including the Engels base, which was targeted in Ukraine's attacks on June 1.


GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics

arXiv.org Artificial Intelligence

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive parameter tuning, or computationally intensive models unsuitable for onboard use. We introduce GRaD-Nav++, a lightweight Vision-Language-Action (VLA) framework that runs fully onboard and follows natural-language commands in real time. Our policy is trained in a photorealistic 3D Gaussian Splatting (3DGS) simulator via Differentiable Reinforcement Learning (DiffRL), enabling efficient learning of low-level control from visual and linguistic inputs. At its core is a Mixture-of-Experts (MoE) action head, which adaptively routes computation to improve generalization while mitigating forgetting. In multi-task generalization experiments, GRaD-Nav++ achieves a success rate of 83% on trained tasks and 75% on unseen tasks in simulation. When deployed on real hardware, it attains 67% success on trained tasks and 50% on unseen ones. In multi-environment adaptation experiments, GRaD-Nav++ achieves an average success rate of 81% across diverse simulated environments and 67% across varied real-world settings. These results establish a new benchmark for fully onboard Vision-Language-Action (VLA) flight and demonstrate that compact, efficient models can enable reliable, language-guided navigation without relying on external infrastructure.


American citizen killed in Russian attack on Kyiv, State Department confirms

FOX News

A U.S. citizen died during a Russian missile attack on the Ukrainian capital of Kyiv, the State Department confirmed Tuesday afternoon. An American citizen was among the 15 killed in Russian drone and missile strikes on the Ukrainian capital city, Kyiv, on Tuesday, State Department spokesperson Tammy Bruce confirmed in a press conference Wednesday. In response to a reporter's question on U.S. diplomats in Kyiv having to spend the night in a bunker, Bruce said "we can confirm the death of a U.S. citizen in Ukraine." "We are aware of last night's attack on Kyiv that resulted in numerous casualties, including the tragic death of a U.S. citizen," she said, noting, "We condemn those strikes and extend our deepest condolences to the victims and to the families of all those affected." Bruce did not offer any more details on the identity of the citizen killed by the Russian strikes, citing "respect to the family during this obviously horrible time."


Kyiv hit by deadly wave of Russian drones and missiles

Al Jazeera

Russia has launched a large-scale drone and missile attack on Ukraine's capital Kyiv, killing several people and wounding more than a hundred others according to local officials. Al Jazeera's Assed Baig has been to one of the attack sites there.


'Disrespect to US': Ukraine brands Russia's 'horrific' bombardment of Kyiv

Al Jazeera

Waves of Russian missile and drone strikes have killed at least 15 people and injured 116 others, with most of the casualties in Kyiv, Ukrainian officials have reported. The massive aerial assault overnight into Tuesday struck 27 locations in the Ukrainian capital, damaging residential buildings and critical infrastructure, according to Interior Minister Ihor Klymenko. Ukrainian officials were quick to call for international attention on the attacks as Kyiv pushes diplomatic efforts to raise pressure on Moscow to agree a ceasefire. "Today, the enemy spared neither drones nor missiles," Klymenko said, describing the attack as one of the largest against Kyiv since Russia launched its full-scale invasion of the country in February 2022. Thirty apartments were destroyed in a single residential block, and emergency services were searching through the rubble for possible survivors, Klymenko added.


Autonomous 3D Moving Target Encirclement and Interception with Range measurement

arXiv.org Artificial Intelligence

Commercial UAVs are an emerging security threat as they are capable of carrying hazardous payloads or disrupting air traffic. To counter UAVs, we introduce an autonomous 3D target encirclement and interception strategy. Unlike traditional ground-guided systems, this strategy employs autonomous drones to track and engage non-cooperative hostile UAVs, which is effective in non-line-of-sight conditions, GPS denial, and radar jamming, where conventional detection and neutralization from ground guidance fail. Using two noisy real-time distances measured by drones, guardian drones estimate the relative position from their own to the target using observation and velocity compensation methods, based on anti-synchronization (AS) and an X$-$Y circular motion combined with vertical jitter. An encirclement control mechanism is proposed to enable UAVs to adaptively transition from encircling and protecting a target to encircling and monitoring a hostile target. Upon breaching a warning threshold, the UAVs may even employ a suicide attack to neutralize the hostile target. We validate this strategy through real-world UAV experiments and simulated analysis in MATLAB, demonstrating its effectiveness in detecting, encircling, and intercepting hostile drones. More details: https://youtu.be/5eHW56lPVto.


Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systems

arXiv.org Artificial Intelligence

Recent breakthroughs in multimodal large language models (MLLMs) have endowed AI systems with unified perception, reasoning and natural-language interaction across text, image and video streams. Meanwhile, Unmanned Aerial Vehicle (UAV) swarms are increasingly deployed in dynamic, safety-critical missions that demand rapid situational understanding and autonomous adaptation. This paper explores potential solutions for integrating MLLMs with UAV swarms to enhance the intelligence and adaptability across diverse tasks. Specifically, we first outline the fundamental architectures and functions of UAVs and MLLMs. Then, we analyze how MLLMs can enhance the UAV system performance in terms of target detection, autonomous navigation, and multi-agent coordination, while exploring solutions for integrating MLLMs into UAV systems. Next, we propose a practical case study focused on the forest fire fighting. To fully reveal the capabilities of the proposed framework, human-machine interaction, swarm task planning, fire assessment, and task execution are investigated. Finally, we discuss the challenges and future research directions for the MLLMs-enabled UAV swarm. An experiment illustration video could be found online at https://youtu.be/zwnB9ZSa5A4.