GitHub - google-research/tuning_playbook: A playbook for systematically maximizing the performance of deep learning models.

Summary: The batch size governs the training speed and shouldn't be used to directly tune the validation set performance. Often, the ideal batch size will be the largest batch size supported by the available hardware.