One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patterns