After investigation, those losses are due to hyperparameter