Reviews: Human-in-the-Loop Interpretability Prior

Neural Information Processing Systems 

More than that, it depends on the purpose for which an explanation is being desired. Assessing whether a model is fit-for-purpose would entail defining a specific task, which as you state is not something you do in this paper. Nevertheless I think it's an important part of framing the general problem.