Human-interpretable model explainability on high-dimensional data
de Mijolla, Damien, Frye, Christopher, Kunesch, Markus, Mansir, John, Feige, Ilya
–arXiv.org Artificial Intelligence
The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional: on one hand, principled model-agnostic approaches to explainability become too computationally expensive; on the other, more efficient explainability algorithms lack natural interpretations for general users. In this work, we introduce a framework for human-interpretable explainability on high-dimensional data, consisting of two modules. First, we apply a semantically-meaningful latent representation, both to reduce the raw dimensionality of the data, and to ensure its human interpretability. These latent features can be learnt, e.g. Second, we adapt the Shapley paradigm for model-agnostic explainability to operate on these latent features. This leads to interpretable model explanations that are both theoreticallycontrolled and computationally-tractable. We benchmark our approach on synthetic data and demonstrate its effectiveness on several image-classification tasks. The explainability of AI systems is important, both for model development and model assurance. This importance continues to rise as AI models - and the data on which they are trained - become ever more complex. Moreover, methods for AI explainability must be adapted to maintain the human-interpretability of explanations in the regime of highly complex data. Many explainability methods exist in the literature.
arXiv.org Artificial Intelligence
Oct-14-2020
- Country:
- North America
- United States > Colorado (0.04)
- Canada > Ontario
- Toronto (0.04)
- Europe > United Kingdom
- England > Greater London > London (0.04)
- Asia > Middle East
- Jordan (0.04)
- North America
- Genre:
- Research Report (0.50)
- Technology: