Neural Network Training Techniques Regularize Optimization Trajectory: An Empirical Study