On Invariance in Hierarchical Models