How To Train Your (Compressed) Large Language Model