Deep Fusion Prior for Plenoptic Super-Resolution All-in-Focus Imaging

Plenoptic imaging offers not only 2-D projections but also adds light array directions, thus supporting single-shot all-in-focus imaging. While its poor spatial resolution becomes an obstacle to high-quality all-in-focus imaging performance. Although various super-resolution (SR) methods have been designed and combined with multifocus image fusion (MFIF), high-quality multi-focus fused super-resolution images can be reconstructed for various applications, almost all of them deal with MFIF and SR separately. To our best knowledge, we first unify MFIF and SR problems as the multi-focus image super-resolution fusion (MFISRF) in the optical perspective and thus propose a novel dataset-free unsupervised framework named deep fusion prior (DFP) to address such MFISRF, particularly for plenoptic super-resolution all-in-focus imaging. Both numerical and practical experiments have proved that our proposed DFP approaches or even outperforms those state-of-the-art MFIF and SR method combinations. Therefore, we believe DFP can be potentially used in various computational photography applications.