Akira's Machine Learning News -- Issue #38

In the following sections, I will introduce various articles and papers not only on the above contents but also on the following five topics. Since molecules have different interatomic distances depending on the nature of the target atoms, they proposed multi-scale Self-Attention, which adjusts the application of Attention according to the distance, and AFPS, which downsamples according to the Attention score. It showed good performance on quantum chemical molecular data sets.