Residual Learning and Context Encoding for Adaptive Offline-to-Online Reinforcement Learning