Depth separation beyond radial functions