FACTS: A Factored State-Space Framework For World Modelling