Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention

Open in new window