Network size and weights size for memorization with two-layers neural networks S ebastien Bubeck Microsoft Research Ronen Eldan

In 1988, Eric B. Baum showed that two-layers neural networks with threshold activation function can perfectly memorize the binary labels of n points in general position in R