Offline RL with Smooth OOD Generalization in Convex Hull and its Neighborhood