Visual Heading Prediction for Autonomous Aerial Vehicles

Abstract--The integration of Unmanned Aerial V ehicles (UA Vs) and Unmanned Ground V ehicles (UGVs) is increasingly central to the development of intelligent autonomous systems for applications such as search and rescue, environmental monitoring, and logistics. However, precise coordination between these platforms in real-time scenarios presents major challenges, particularly when external localization infrastructure such as GPS or GNSS is unavailable or degraded [1]. This paper proposes a vision-based, data-driven framework for real-time UA V-UGV integration, with a focus on robust UGV detection and heading angle prediction for navigation and coordination. The system employs a fine-tuned YOLOv5 model to detect UGVs and extract bounding box features, which are then used by a lightweight artificial neural network (ANN) to estimate the UA V's required heading angle. A VICON motion capture system was used to generate ground-truth data during training, resulting in a dataset of over 13,000 annotated images collected in a controlled lab environment. The trained ANN achieves a mean absolute error of 0.1506 and a root mean squared error of 0.1957, offering accurate heading angle predictions using only monocular camera inputs. Experimental evaluations achieve 95% accuracy in UGV detection. This work contributes a vision-based, infrastructure-independent solution that demonstrates strong potential for deployment in GPS/GNSS-denied environments, supporting reliable multi-agent coordination under realistic dynamic conditions. A demonstration video showcasing the system's real-time performance, including UGV detection, heading angle prediction, and UA V alignment under dynamic conditions, is available at: https://github.com/Kooroshraf/UA HE integration of Unmanned Aerial V ehicles (UA Vs) and Unmanned Ground V ehicles (UGVs) has emerged as a powerful paradigm in multi-agent systems, offering significant advantages for surveillance, search and rescue, precision agriculture, and autonomous logistics [2]. UA Vs provide agility and a wide field of view, while UGVs offer stable ground-level interaction and payload capacity.