A Good Plan is Hard to Find: Aligning Models with Preferences is Misaligned with What Helps Users

Open in new window