satellite video
Highly Efficient and Unsupervised Framework for Moving Object Detection in Satellite Videos
Xiao, C., An, W., Zhang, Y., Su, Z., Li, M., Sheng, W., Pietikäinen, M., Liu, L.
Moving object detection in satellite videos (SVMOD) is a challenging task due to the extremely dim and small target characteristics. Current learning-based methods extract spatio-temporal information from multi-frame dense representation with labor-intensive manual labels to tackle SVMOD, which needs high annotation costs and contains tremendous computational redundancy due to the severe imbalance between foreground and background regions. In this paper, we propose a highly efficient unsupervised framework for SVMOD. Specifically, we propose a generic unsupervised framework for SVMOD, in which pseudo labels generated by a traditional method can evolve with the training process to promote detection performance. Furthermore, we propose a highly efficient and effective sparse convolutional anchor-free detection network by sampling the dense multi-frame image form into a sparse spatio-temporal point cloud representation and skipping the redundant computation on background regions. Coping these two designs, we can achieve both high efficiency (label and computation efficiency) and effectiveness. Extensive experiments demonstrate that our method can not only process 98.8 frames per second on 1024x1024 images but also achieve state-of-the-art performance. The relabeled dataset and code are available at https://github.com/ChaoXiao12/Moving-object-detection-in-satellite-videos-HiEUM.
Deep Blind Super-Resolution for Satellite Video
Xiao, Yi, Yuan, Qiangqiang, Zhang, Qiang, Zhang, Liangpei
Recent efforts have witnessed remarkable progress in Satellite Video Super-Resolution (SVSR). However, most SVSR methods usually assume the degradation is fixed and known, e.g., bicubic downsampling, which makes them vulnerable in real-world scenes with multiple and unknown degradations. To alleviate this issue, blind SR has thus become a research hotspot. Nevertheless, existing approaches are mainly engaged in blur kernel estimation while losing sight of another critical aspect for VSR tasks: temporal compensation, especially compensating for blurry and smooth pixels with vital sharpness from severely degraded satellite videos. Therefore, this paper proposes a practical Blind SVSR algorithm (BSVSR) to explore more sharp cues by considering the pixel-wise blur levels in a coarse-to-fine manner. Specifically, we employed multi-scale deformable convolution to coarsely aggregate the temporal redundancy into adjacent frames by window-slid progressive fusion. Then the adjacent features are finely merged into mid-feature using deformable attention, which measures the blur levels of pixels and assigns more weights to the informative pixels, thus inspiring the representation of sharpness. Moreover, we devise a pyramid spatial transformation module to adjust the solution space of sharp mid-feature, resulting in flexible feature adaptation in multi-level domains. Quantitative and qualitative evaluations on both simulated and real-world satellite videos demonstrate that our BSVSR performs favorably against state-of-the-art non-blind and blind SR models. Code will be available at https://github.com/XY-boy/Blind-Satellite-VSR
- Asia > China > Hubei Province > Wuhan (0.05)
- Asia > China > Guangdong Province > Zhuhai (0.05)
- Asia > China > Liaoning Province > Dalian (0.04)
- (15 more...)
Technology Convergence – Artificial Intelligence and Satellite Imaging
Artificial intelligence (AI) has been used for years on satellite images – so why all the excitement? The application of AI and machine learning (ML) to Earth observation (EO) data is a huge growth area, demonstrated by the many online competitions, GitHub repositories and entire businesses founded exclusively on this topic. GitHub is a development platform inspired by the way people work, from open source to business. Users can host and review code, manage projects and build software alongside 31 million developers. However, taking the Oxford English Dictionary's definition of AI as'systems able to perform tasks normally requiring human intelligence', AI has been available for many years to address the meatiest challenges in image interpretation.