Learning to Walk from Three Minutes of Real-World Data with Semi-structured Dynamics Models