Goto

Collaborating Authors

 Geophysical Analysis & Survey


Case-based reasoning for rare events prediction on strategic sites

arXiv.org Machine Learning

Satellite imagery is now widely used in the defense sector for monitoring locations of interest. Although the increasing amount of data enables pattern identification and therefore prediction, carrying this task manually is hardly feasible. We hereby propose a cased-based reasoning approach for automatic prediction of rare events on strategic sites. This method allows direct incorporation of expert knowledge, and is adapted to irregular time series and small-size datasets. Experiments are carried out on two use-cases using real satellite images: the prediction of submarines arrivals and departures from a naval base, and the forecasting of imminent rocket launches on two space bases. The proposed method significantly outperforms a random selection of reference cases on these challenging applications, showing its strong potential. Keywords: Predictive analysis · Case-based reasoning · Earth observation · Submarine activity · Space launch.


When Remote Sensing Meets Artificial Intelligence

#artificialintelligence

Image Processing vs Computer Vision 7. Image Processing Example 1) Rescaling: zoom in, zoom out, cropping 2) Correcting illumination: brightness and contrast 3) Color manipulations: black and white, gray-scale, HSV, RGB, BGR 4) Filter: mean, median, low pass, high pass, gaussian, laplacian 5) Edge detection Original Sobel Laplacian Canny 8. Image Processing Example 6) Morphology: - Erode (local minimum) - Dilate (local maximum) - Opening (erosion then dilation) - Closing (dilation then erosion) - Morphology Gradient (MG) (difference between dilation and erosion) - Top Hat (TH) (difference between image and opening) - Black Hat (difference between image and closing) 9. Computer Vision Example Scene modeling Object detection Object recognition Object tracking Pose estimation Motion estimation Image restoration 10. Artificial Intelligence (AI) AI is intelligence demonstrated by machines, as opposed to the natural intelligence displayed by humans or animals.


Robust real-time aircraft detection with multi-task cascaded calibration networks

#artificialintelligence

Aircraft detection is notoriously challenging owing to the orientation and size variations of aircraft objects. Existing detection pipelines compromise with efficiency or accuracy to deal with the large visual variations. We present a novel cascaded framework that joins object detection and orientation prediction through multi-task learning. The cascaded framework consists of three stages and operates in a coarse-to-fine manner. Each stage simultaneously rejects false targets, regresses the locations of object candidates, and calibrates the orientations of the candidates to upright gradually.


Jalisco's multiclass land cover analysis and classification using a novel lightweight convnet with real-world multispectral and relief data

arXiv.org Artificial Intelligence

Terrestrial vegetation is a critical component of global biogeochemical cycles and provides important ecosystem services to support human life [1]. Given its importance, it is essential to know the spatial-temporal variations of vegetation [2]. These variations are due to several determining factors such as global climate variability, climate gradients, and anthropogenic factors such as Land Use and Land Cover Change (LULCC). The diversity in climatic conditions and vegetation types pose different obstacles to monitoring and classifying land cover using remote sensing. Mexico is considered one of the mega-diverse countries on the planet due to its location in a transition zone between Nearctic and Neotropic regions making it more difficult for land use classification and monitoring. The anthropogenic factors, could be a trigger for deforestation and forest degradation [3] and have a severe impact on the global carbon cycle, soil erosion, hydrological cycles, and in general, affect on the ecosystem services that sustain society [4]. As a result, timely land cover monitoring and classification are of crucial importance for assessing gradual degradation-ecosystem processes. Furthermore, it is important to be in line with the United Nations Sustainable Development Goals (SDGs) specifically SDG 15 concerning "Life on Land" [5].


Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery

arXiv.org Artificial Intelligence

Natural disasters ravage the world's cities, valleys, and shores on a regular basis. Deploying precise and efficient computational mechanisms for assessing infrastructure damage is essential to channel resources and minimize the loss of life. Using a dataset that includes labeled pre- and post- disaster satellite imagery, we take a machine learning-based remote sensing approach and train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. We present a novel methodology of interpretable deep learning that seeks to explicitly investigate the most useful modalities of information in the training data to create an accurate classification model. We also investigate which loss functions best optimize these models. Our findings include that ordinal-cross entropy loss is the most optimal criterion for optimization to use and that including the type of disaster that caused the damage in combination with pre- and post-disaster training data most accurately predicts the level of damage caused. Further, we make progress in the qualitative representation of which parts of the images that the model is using to predict damage levels, through gradient-weighted class activation mapping (Grad-CAM). Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.


Remote sensing and machine learning - POST

#artificialintelligence

There is increasing interest in using machine learning to automatically analyse remote sensing data and increase our understanding of complex environmental systems. While there are benefits from this approach, there are also some barriers to its use. This POSTnote examines the value of these approaches, and the technical and ethical challenges for wider implementation.


Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detection

arXiv.org Artificial Intelligence

Abstract--Deep learning for change detection is one of the current hot topics in the field of remote sensing. However, most endto-end networks are proposed for supervised change detection, and unsupervised change detection models depend on traditional pre-detection methods. Therefore, we proposed a fully convolutional change detection framework with generative adversarial network, to conclude unsupervised, weakly supervised, regional supervised, and fully supervised change detection tasks into one framework. A basic Unet segmentor is used to obtain change detection map, an image-to-image generator is implemented to model the spectral and spatial variation between multi-temporal images, and a discriminator for changed and unchanged is proposed for modeling the semantic changes in weakly and regional supervised change detection task. The iterative optimization of segmentor and generator can build an end-to-end network for unsupervised change detection, the adversarial process between segmentor and discriminator can provide the solutions for weakly and regional supervised change detection, the segmentor itself can be trained for fully supervised task. The experiments indicate the effectiveness of the propsed framework in unsupervised, weakly supervised and regional supervised change detection. This paper provides theorical definitions for unsupervised, weakly supervised and regional supervised change detection tasks, and shows great potentials in exploring end-to-end network for remote sensing change detection. It changes and non-changes by pre-detection, and use aims at finding landscape changes from the multi-temporal the corresponding patches as training samples to build a remote sensing images observing the same study site deep network model to extract better features and discriminate at different time. It has been widely used in land-use/landcover semantic labels [25-27].


Realizing Machine Learning's Promise in Geoscience Remote Sensing - Eos

#artificialintelligence

In recent years, machine learning and pattern recognition methods have become common in Earth and space sciences. This is especially true for remote sensing applications, which often rely on massive archives of noisy data and so are well suited to such artificial intelligence (AI) techniques. As the data science revolution matures, we can assess its impact on specific research disciplines. We focus here on imaging spectroscopy, also known as hyperspectral imaging, as a data-centric remote sensing discipline expected to benefit from machine learning. Imaging spectroscopy involves collecting spectral data from airborne and satellite sensors at hundreds of electromagnetic wavelengths for each pixel in the sensors' viewing area.


Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust Road Extraction

arXiv.org Artificial Intelligence

Land remote sensing analysis is a crucial research in earth science. In this work, we focus on a challenging task of land analysis, i.e., automatic extraction of traffic roads from remote sensing data, which has widespread applications in urban development and expansion estimation. Nevertheless, conventional methods either only utilized the limited information of aerial images, or simply fused multimodal information (e.g., vehicle trajectories), thus cannot well recognize unconstrained roads. To facilitate this problem, we introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet), which fully benefits the complementary different modal data (i.e., aerial images and crowdsourced trajectories). Specifically, CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement. In particular, the complementary information of each modality is comprehensively extracted and dynamically propagated to enhance the representation of another modality. Extensive experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction benefiting from blending different modal data, either using image and trajectory data or image and Lidar data. From the experimental results, we observe that the proposed approach outperforms current state-of-the-art methods by large margins.Our source code is resealed on the project page \url{http://lingboliu.com/multimodal road extraction.html}


Multi-Label Classification on Remote-Sensing Images

arXiv.org Artificial Intelligence

Acquiring information on large areas on the earth's surface through satellite cameras allows us to see much more than we can see while standing on the ground. This assists us in detecting and monitoring the physical characteristics of an area like land-use patterns, atmospheric conditions, forest cover, and many unlisted aspects. The obtained images not only keep track of continuous natural phenomena but are also crucial in tackling the global challenge of severe deforestation. Among which Amazon basin accounts for the largest share every year. Proper data analysis would help limit detrimental effects on the ecosystem and biodiversity with a sustainable healthy atmosphere. This report aims to label the satellite image chips of the Amazon rainforest with atmospheric and various classes of land cover or land use through different machine learning and superior deep learning models. Evaluation is done based on the F2 metric, while for loss function, we have both sigmoid cross-entropy as well as softmax cross-entropy. Images are fed indirectly to the machine learning classifiers after only features are extracted using pre-trained ImageNet architectures. Whereas for deep learning models, ensembles of fine-tuned ImageNet pre-trained models are used via transfer learning. Our best score was achieved so far with the F2 metric is 0.927.