SaLF: Sparse Local Fields for Multi-Sensor Rendering in Real-Time