Design Considerations in Offline Preference-based RL