Towards Learning Neural Representations from Shadows