High Fidelity 3D Reconstructions with Limited Physical Views