Optimal lower Lipschitz bounds for ReLU layers, saturation, and phase retrieval