Deep Learning Can be Applied to NLP – Intuition Machine

The point here that surprises most Machine Learning practitioners is the'brute-force memorization'. See, ML has always been about curve fitting. In curve fitting you find a sparse set of parameters that describe your curve and you use that to fit the data. The generalization that comes into play relates to the ability to interpolate between points. The major disconnect here is that DL have exhibited impressive generalization, yet it cannot possibly work if we consider them as just memory stores.