Users as Annotators: LLM Preference Learning from Comparison Mode

Open in new window