Sharp Spectral Rates for Koopman Operator Learning