Improving Zero-Shot Generalization in Offline Reinforcement Learning using Generalized Similarity Functions