TowardsaUnified Information-Theoretic FrameworkforGeneralization

Let D be an unknown distribution on a spaceZ, and let H be a set of classifiers. Consider a (randomized) learning algorithmA = (An)n 1 that selects an elementˆh in H, based onn i.i.d.