Epipolar-Free 3D Gaussian Splatting for Generalizable Novel View Synthesis Zhiyuan Min Yawei Luo 1, Jianwen Sun 2 Yi Yang
–Neural Information Processing Systems
Generalizable 3D Gaussian splitting (3DGS) can reconstruct new scenes from sparse-view observations in a feed-forward inference manner, eliminating the need for scene-specific retraining required in conventional 3DGS. However, existing methods rely heavily on epipolar priors, which can be unreliable in complex realworld scenes, particularly in non-overlapping and occluded regions. In this paper, we propose eFreeSplat, an efficient feed-forward 3DGS-based model for generalizable novel view synthesis that operates independently of epipolar line constraints. To enhance multiview feature extraction with 3D perception, we employ a selfsupervised Vision Transformer (ViT) with cross-view completion pre-training on large-scale datasets. Additionally, we introduce an Iterative Cross-view Gaussians Alignment method to ensure consistent depth scales across different views. Our eFreeSplat represents an innovative approach for generalizable novel view synthesis. Different from the existing pure geometry-free methods, eFreeSplat focuses more on achieving epipolar-free feature matching and encoding by providing 3D priors through cross-view pretraining. We evaluate eFreeSplat on wide-baseline novel view synthesis tasks using the RealEstate10K and ACID datasets. Extensive experiments demonstrate that eFreeSplat surpasses state-of-the-art baselines that rely on epipolar priors, achieving superior geometry reconstruction and novel view synthesis quality.
Neural Information Processing Systems
May-29-2025, 08:51:16 GMT
- Country:
- Europe > Germany (0.28)
- North America > United States (0.46)
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (0.67)
- Promising Solution (0.87)
- Research Report
- Industry:
- Health & Medicine (0.46)
- Information Technology (0.67)
- Technology: