Why Small Data is Important for Advancing AI

Everything was small data before we had big data. The scientific discoveries of the 19th and 20th centuries were all made using small data. Physicists made all calculations by hand, thus exclusively using small data. And yet, they discovered the most beautiful and most fundamental laws of nature. Moreover, they compressed them into simple rules in the form of elegant equations.