Glocal Hypergradient Estimation with Koopman Operator