Smoothed Differentiation Efficiently Mitigates Shattered Gradients in Explanations

Adrian Hill, Neal McKee, Johannes Maeß, Stefan Blücher, Klaus-Robert Müller

Neural Information Processing Systems 

Thus, SmoothDiff greatly enhances the usability (quality and speed) SmoothDiff's excellent speed and performance in a number of experiments and sible for shattered gradients and making it easy to implement. We demonstrate across a network architecture, directly targeting only the non4linearities respon4 leverages automatic differentiation to decompose the expected values of Jacobians yielding a speedup of over two orders of magnitude. Specifically, SmoothDiff work we propose a well founded novel method SmoothDiff to resolve this tradeoff demand, therefore in practice only few samples are used in SmoothGrad.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found