Awesome PyTorch Lightning template!

Have you ever been confused about what is the best practice for PyTorch? Like, when to send your Tensor to GPU? or when to call zero_grad? Or have you tried to do something new, like adding a SimCLR-like pipeline, and having to rewrite a majority of your code because it was so poorly written? Or maybe, you are wondering what everyone else's pipeline is like? Are theirs 100% more efficient?