Entropy and mutual information in models of deep neural networks

Marylou Gabrié, Andre Manoel, Clément Luneau, jean barbier, Nicolas Macris, Florent Krzakala, Lenka Zdeborová

Neural Information Processing Systems 

Neural Information Processing Systems http://nips.cc/