On the Duality between Gradient Transformations and Adapters