d8ea5f53c1b1eb087ac2e356253395d8-Supplemental.pdf

The difference between a representationZin IB and a statisticT(X), is that the mapping between the inputsX and the representation Z can be stochastic -- specifically a representation is a statistic of the input and independent noise X, i.e., Z = T(X,).