Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Models