Goto

Collaborating Authors

 Drones


Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding

arXiv.org Artificial Intelligence

--Vision-and-language navigation (VLN) is a long-standing challenge in autonomous robotics, aiming to empower agents with the ability to follow human instructions while navigating complex environments. Two key bottlenecks remain in this field: generalization to out-of-distribution environments and reliance on fixed discrete action spaces. To address these challenges, we propose Vision-Language Fly (VLFly), a framework tailored for Unmanned Aerial Vehicles (UAVs) to execute language-guided flight. Without the requirement for localization or active ranging sensors, VLFly outputs continuous velocity commands purely from egocentric observations captured by an onboard monocular camera. The VLFly integrates three modules: an instruction encoder based on a large language model (LLM) that reformulates high-level language into structured prompts, a goal retriever powered by a vision-language model (VLM) that matches these prompts to goal images via vision-language similarity, and a waypoint planner that generates executable trajectories for real-time UAV control. VLFly is evaluated across diverse simulation environments without additional fine-tuning and consistently outperforms all baselines. Moreover, real-world VLN tasks in indoor and outdoor environments under direct and indirect instructions demonstrate that VLFly achieves robust open-vocabulary goal understanding and generalized navigation capabilities, even in the presence of abstract language input. The capability of robots to execute complex tasks based on natural language instructions has long been a compelling objective in robotics and artificial intelligence (AI). Particularly within the field of autonomous navigation, this capability enables applications spanning home assistance [1], urban inspection [2], and environmental exploration [3]. Y uhang Zhang and Haosheng Y u are co-first authors.


When Maximum Entropy Misleads Policy Optimization

arXiv.org Artificial Intelligence

The Maximum Entropy Reinforcement Learning (MaxEnt RL) framework is a leading approach for achieving efficient learning and robust performance across many RL tasks. However, MaxEnt methods have also been shown to struggle with performance-critical control problems in practice, where non-MaxEnt algorithms can successfully learn. In this work, we analyze how the trade-off between robustness and optimality affects the performance of MaxEnt algorithms in complex control tasks: while entropy maximization enhances exploration and robustness, it can also mislead policy optimization, leading to failure in tasks that require precise, low-entropy policies. Through experiments on a variety of control problems, we concretely demonstrate this misleading effect. Our analysis leads to better understanding of how to balance reward design and entropy maximization in challenging control problems.


Israeli strikes kill at least 42 across Gaza as UN eyes ceasefire vote

Al Jazeera

Israeli attacks have killed at least 42 people across Gaza since dawn, medical sources told Al Jazeera, as the United Nations General Assembly prepares for a vote urging an unconditional ceasefire in the besieged enclave. Sources told Al Jazeera that at least 26 of the people killed on Thursday died in Israeli drone attacks while waiting for food and basic supplies being distributed by the controversial United States and Israel-backed Gaza Humanitarian Foundation (GHF). Gaza civil defence official Mohammed el-Mougher told AFP news agency that al-Awda Hospital received at least 10 bodies and about 200 others who were wounded "after Israeli drones dropped multiple bombs on gatherings of civilians near an aid distribution point around the Netzarim checkpoint in central Gaza". El-Mougher said that Gaza City's al-Shifa Hospital also received six bodies after Israeli attacks on aid queues near Netzarim and in the as-Sudaniya area in northwestern Gaza. Since the GHF began its operation in Gaza in late May, dozens of Palestinians have been killed while trying to reach the aid distribution points, according to Gaza's civil defence agency.


Can any nation protect against a Ukraine-style drone smuggling attack?

New Scientist

On 1 June, Ukraine stunned the world with an audacious attack against Russian airbases. Using cheap, small drones concealed inside trucks that had penetrated deep into Russian territory, Ukraine was able to hit dozens of nuclear-capable strategic bombers, taking out 7 billion of military hardware. The drone-smuggling attack, codenamed Operation Spiderweb, was an incredible feat of military planning – but it also highlighted a vulnerability that has defence chiefs around the world concerned that their assets could be hit next. "The risk potentials of small drone attacks to US or UK air bases right now are 100 per cent," says Robert Bunker at US consultancy firm C/O Futures. "You simply need a group with the intent and capability, which is a very low bar to overcome."


Russia-Ukraine war: List of key events, day 1,204

Al Jazeera

The United States ambassador to NATO, Matthew Whitaker, said the Ukrainian drone attack on Russian strategic bombers at their airbases earlier this month was "badass" but also "a little bit reckless, and a little bit dangerous". Ukrainian President Volodymyr Zelenskyy, addressing a conference of southeast European leaders in the Black Sea port of Odesa, said Russia was determined to destroy the south of his country as well as nearby Moldova and Romania, as he called for increased pressure on Moscow to prevent further military threats. It is the first time the leader has visited Ukraine during his 12 years in power. Finland's Ministry for Foreign Affairs said it had summoned a Russian diplomat over a suspected June 10 violation of Finnish airspace by Russian aircraft, the second such event in under three weeks. Slovakia will not back the European Union's 18th package of sanctions against Russia unless the European Commission provides a solution to the situation the country faces if the bloc phases out Russian energy as planned, the country's Prime Minister Robert Fico has said. Germany's imports of goods from Russia fell by 95 percent in the 2021-2024 period, while its exports of goods to Russia were cut by 72 percent, the country's statistics office Destatis has reported.


Hierarchical Image Matching for UAV Absolute Visual Localization via Semantic and Structural Constraints

arXiv.org Artificial Intelligence

Absolute localization, aiming to determine an agent's location with respect to a global reference, is crucial for unmanned aerial vehicles (UAVs) in various applications, but it becomes challenging when global navigation satellite system (GNSS) signals are unavailable. Vision-based absolute localization methods, which locate the current view of the UAV in a reference satellite map to estimate its position, have become popular in GNSS-denied scenarios. However, existing methods mostly rely on traditional and low-level image matching, suffering from difficulties due to significant differences introduced by cross-source discrepancies and temporal variations. To overcome these limitations, in this paper, we introduce a hierarchical cross-source image matching method designed for UAV absolute localization, which integrates a semantic-aware and structure-constrained coarse matching module with a lightweight fine-grained matching module. Specifically, in the coarse matching module, semantic features derived from a vision foundation model first establish region-level correspondences under semantic and structural constraints. Then, the fine-grained matching module is applied to extract fine features and establish pixel-level correspondences. Building upon this, a UAV absolute visual localization pipeline is constructed without any reliance on relative localization techniques, mainly by employing an image retrieval module before the proposed hierarchical image matching modules. Experimental evaluations on public benchmark datasets and a newly introduced CS-UAV dataset demonstrate superior accuracy and robustness of the proposed method under various challenging conditions, confirming its effectiveness.


Lightweight Object Detection Using Quantized YOLOv4-Tiny for Emergency Response in Aerial Imagery

arXiv.org Artificial Intelligence

This paper presents a lightweight and energy-efficient object detection solution for aerial imagery captured during emergency response situations. We focus on deploying the YOLOv4-Tiny model, a compact convolutional neural network, optimized through post-training quantization to INT8 precision. The model is trained on a custom-curated aerial emergency dataset, consisting of 10,820 annotated images covering critical emergency scenarios. Unlike prior works that rely on publicly available datasets, we created this dataset ourselves due to the lack of publicly available drone-view emergency imagery, making the dataset itself a key contribution of this work. The quantized model is evaluated against YOLOv5-small across multiple metrics, including mean Average Precision (mAP), F1 score, inference time, and model size. Experimental results demonstrate that the quantized YOLOv4-Tiny achieves comparable detection performance while reducing the model size from 22.5 MB to 6.4 MB and improving inference speed by 44\%. With a 71\% reduction in model size and a 44\% increase in inference speed, the quantized YOLOv4-Tiny model proves highly suitable for real-time emergency detection on low-power edge devices.


Russia hits Ukraine's Kharkiv with deadly nighttime barrage of drones

The Japan Times

A concentrated, nine-minute-long Russian drone attack on Ukraine's second largest city of Kharkiv in the middle of the night killed six people and injured 64, including nine children, Ukrainian officials said on Wednesday. The overnight attack followed Russia's two biggest air assaults of the war on Ukraine this week, part of intensified bombardments that Moscow says are retaliatory measures for Kyiv's recent attacks in Russia. Elsewhere, two southern Ukrainian regions, Mykolaiv and Kherson, were left without electricity on Wednesday after Russian forces attacked an energy facility, the governors said.


Russia fires North Korean ballistic missiles in 'extremely dangerous' threat to Europe and Asia: Zelenskyy

FOX News

Fox News' Alex Hogan reports on one of the largest Russian attacks on Ukraine since the war began. Fox News contributor Mike Pompeo also breaks down the Trump administration's travel ban and discusses the U.S. role in potential peace talks. North Korean ballistic missiles once again rained down over Ukraine this week as the war with Russia continues to rage, prompting President Volodymyr Zelenskyy to renew warnings that the threat posed by the Moscow-Pyongyang alliance is "extremely dangerous" for Europe and Asia alike. "The longer this war continues on our territory, the more warfare technologies evolve, and the greater the threat will be to everyone," Zelenskyy said Tuesday. "This must be addressed now, not when thousands of upgraded Shahed drones and ballistic missiles begin to threaten Seoul and Tokyo." Zelenskyy's warning came just one day after Ukraine's military intelligence chief, Kyrylo Budanov, confirmed in an interview with The War Zone that Russia has significantly improved North Korea's KN-23 ballistic missiles.


What's behind Russia's 'evolving' drone warfare in Ukraine?

Al Jazeera

Kyiv, Ukraine – Swarms of Russian kamikaze drones broke through Ukrainian air defence fire early on Tuesday, screeching and shrilling over Kyiv in one of the largest wartime attacks. Oleksandra Yaremchuk, who lives in the Ukrainian capital, said the hours-long sound of two or perhaps three drones above her house felt new and alarming. "This horrible buzz is the sound of death, it makes you feel helpless and panicky," the 38-year-old bank clerk told Al Jazeera, describing her sleepless night in the northern district of Obolon. "This time I heard it in stereo and in Dolby surround," she quipped. Back in 2022, she crisscrossed duct tape over her apartment's windows to avoid being hit by glass shards and spent most of the night in a shaky chair in her hallway.