Are Expressive Models Truly Necessary for Offline RL?