Human-in-the-Loop Learning of Qualitative Preference Models

In this work, we present a novel human-in-the-loop framework to help the agent understand the decision making process that involves choosing preferred options. We focus on qualitative preference models over alternatives from combinatorial domains. This framework is interactive: e.g., the agent provides her behavioral data to the framework, and the framework ex- plains the learned model to the agent. It is iterative: the framework collects feedback on the learned model from the agent and tries to improve it accordingly until the agent terminates the iteration. In order to communicate the learned preference model to the agent, we focus on visualizing some of the intuitive and explain- able graphic models, such as lexicographic preference trees and forests, and conditional preference networks. To this end, we discuss key aspects of our framework, and demonstrate our prototype ready for lexicographic preference models.