Inverse Depth Scaling From Most Layers Being Similar