AutomatedMulti-levelPreferenceforMLLMs

However, Is asingle comparison between superior and inferior responses sufficient for preference learning in MLLMs? Upon consideration, we find that a multi-level preference framework offers greater benefits for preference learning, primarily due to two main intuitive advantages.