Robust Offline Reinforcement Learning for Non-Markovian Decision Processes