NLP Deep Learning Training on Downstream tasks using Pytorch Lightning -- Summarization on XSum…

These are not strong scores and will need training for additional Epochs. A single Epoch took 2 hrs 8 mins to run. The test loss is close to the training loss. The example notebook of Transformers using their Trainer shows a Training loss of 2.72 after 1 Epoch with a running time of 1 hr 22 mins. Both the loss and the running time is lower than this notebook using Pytorch Lightning.