Statistical-Computational Trade-offs for Density Estimation

We study the density estimation problem defined as follows: given k distributions p_1, \ldots, p_k over a discrete domain [n], as well as a collection of samples chosen from a "query" distribution q over [n], output p_i that is "close" to q . Recently Aamand et al. gave the first and only known result that achieves sublinear bounds in both the sampling complexity and the query time while preserving polynomial data structure space. However, their improvement over linear samples and time is only by subpolynomial factors.Our main result is a lower bound showing that, for a broad class of data structures, their bounds cannot be significantly improved. In particular, if an algorithm uses O(n/\log c k) samples for some constant c 0 and polynomial space, then the query time of the data structure must be at least k {1-O(1)/\log \log k}, i.e., close to linear in the number of distributions k . This is a novel statistical-computational trade-off for density estimation, demonstrating that any data structure must use close to a linear number of samples or take close to linear query time.