Chaining Mutual Information and Tightening Generalization Bounds

Amir Asadi, Emmanuel Abbe, Sergio Verdu

Neural Information Processing Systems 

Two important difficulties are (i) exploiting the dependencies between the hypotheses, (ii) exploiting the dependence between the algorithm's input and output.