Rethink Depth Separation with Intra-layer Links