Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows