Robust Offline Reinforcement Learning with Linearly Structured $f$-Divergence Regularization