Flying through Moving Gates without Full State Estimation