[D] Information Theory for Machine Learning • r/MachineLearning

There are accompanying video lectures on YouTube. Title is something like "Pattern Recognition, Information Theory, and Neural Networks". Does everything from prove Shannon's source coding theorem, introduce error correcting codes, show how to solve traveling salesman problem with Boltzmann Machines, ... A true gem of a book relating ideas from info theory to Bayesian stats to ising models to probabilistic modeling with neural networks. Was a formative read for me early on in the ML endeavour.