Fast-SEnSeI: Lightweight Sensor-Independent Cloud Masking for On-board Multispectral Sensors

Kněžík, Jan, Herec, Jonáš, Pitoňák, Rado

arXiv.org Artificial Intelligence 

Abstract--Cloud segmentation is a critical preprocessing step for many Earth observation tasks, yet most models are tightly coupled to specific sensor configurations and rely on ground-based processing. In this work, we propose Fast-SEnSeI, a lightweight, sensor-independent encoder module that enables flexible, on-board cloud segmentation across multispectral sensors with varying band configurations. Building upon SEnSeI-v2, Fast-SEnSeI integrates an improved spectral descriptor, lightweight architecture, and robust padding-band handling. It accepts arbitrary combinations of spectral bands and their wavelengths, producing fixed-size feature maps that feed into a compact, quantized segmentation model based on a modified U-Net. The module runs efficiently on embedded CPUs using Apache TVM, while the segmentation model is deployed on FPGA, forming a CPU-FPGA hybrid pipeline suitable for space-qualified hardware. Evaluations on Sentinel-2 and Landsat 8 datasets demonstrate accurate segmentation across diverse input configurations. As the volume of satellite imagery captured in orbit continues to grow, the traditional paradigm of ground-based data processing is reaching its limits. Downlink bottlenecks, limited bandwidth, and the need for timely data products have driven the development of on-board artificial intelligence (AI) capabilities [1], [2], [3], [4]. By moving parts of the processing pipeline directly onto the satellite, it becomes possible to filter, analyze, and prioritize data before transmission, enhancing mission efficiency and enabling new forms of real-time decision-making. A particularly promising application of on-board AI is cloud segmentation.