05a2d9ef0ae6f249737c1e4cce724a0c-Paper-Conference.pdf

Information-theoretic analysis ofdeep neural networks (DNN) has attracted recent interest due to intriguing fundamental results and new hypotheses. Applying information theory to DNNs may provide novel tools for explainable AI via estimation of information flows [1-5], as well as new ways to encourage models to extract and generalize information [1, 6-8].