The Fundamental Limits of Structure-Agnostic Functional Estimation