Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network

Pansharpening, which is the fusion of a multispectral (MS) image and a wideband panchromatic (PAN) image, is an important technique in remote sensing. Ideally, the fused image should contain all the spectral information from the MS image and all the spatial details from the PAN image. With advances in sensor development, the fusion of a high spatial resolution MS image and a low spatial resolution hyperspectral (HS) image (MS/HS fusion) is becoming relevant for many applications. A typical HS image contains hundreds of spectral reflectance bands, making the spectral information content very high. This allows for the identification of different materials based on their spectral signature, which is useful for applications such as classification of land cover types.