r/MachineLearning - [P] SpeedTorch. 4x faster pinned CPU - GPU data transfer than Pytorch pinned CPU tensors, and 110x faster GPU - CPU transfer. Augment parameter size by hosting on CPU. Use non sparse optimizers (Adadelta, Adamax, RMSprop, Rprop, etc.) for sparse training (word2vec, node2vec, GloVe, NCF, etc.).