Explaining Explainable AI

The next question is, why do we even bother to explain something that is just a guess (but a very good one). If it works why do we even care? Actually the problem lies in us, in humans. Nowadays we don't trust anything that we cannot understand. The interesting part is that we still have trust in specialist (if it's a human specialist and not a robot), even if the error rate of a human specialist is much higher than of a specialized Artificial Neural Network.