UAV Object Detection and Positioning in a Mining Industrial Metaverse with Custom Geo-Referenced Data

--The mining sector increasingly adopts digital tools to improve operational efficiency, safety, and data-driven decision-making. One of the key challenges remains the reliable acquisition of high-resolution, geo-referenced spatial information to support core activities such as extraction planning and on-site monitoring. This work presents an integrated system architecture that combines UA V-based sensing, LiDAR terrain modeling, and deep learning-based object detection to generate spatially accurate information for open-pit mining environments. The proposed pipeline includes geo-referencing, 3D reconstruction, and object localization, enabling structured spatial outputs to be integrated into an industrial digital twin platform. Unlike traditional static surveying methods, the system offers higher coverage and automation potential, with modular components suitable for deployment in real-world industrial contexts. While the current implementation operates in post-flight batch mode, it lays the foundation for real-time extensions. The system contributes to the development of AI-enhanced remote sensing in mining by demonstrating a scalable and field-validated geospatial data workflow that supports situational awareness and infrastructure safety. HE mining industry is significantly transforming by integrating emerging digital technologies. One of the primary challenges facing this sector is the lack of high-precision real-time geospatial data to support decision-making in exploration, extraction, and safety monitoring [1], [2]. Traditional data collection methods often involve high costs, time-consuming processes, and potential safety risks. The proposed approach enables the detection of key objects using onboard cameras and deep learning techniques, followed by their projection onto the 3D map for enhanced situational awareness. Additionally, the system leverages geo-referenced images to support visual navigation, improving UA V positioning within the mining environment. Balaska(*corresponding author), I.T Papapetros, K.M Oikonomou and A. Gasteratos are with the Department of Production and Management Engineering, Democritus University of Thrace, Xanthi, Greece. L. Bampis is with the Department of Electrical and Computer Engineering, Democritus University of Thrace, Xanthi, Greece.