Bayesian Learning
Entropy testing and its application to testing Bayesian networks
This paper studies the problem of entropy identity testing: given sample access to a distribution p and a fully described distribution q (both discrete distributions over a domain of size k), and the promise that either p = q or |H (p) H (q)| ฮต, where H () denotes the Shannon entropy, a tester needs to distinguish between the two cases with high probability.