A Resource Efficient Fusion Network for Object Detection in Bird's-Eye View using Camera and Raw Radar Data