Online and Offline Learning of Player Objectives from Partial Observations in Dynamic Games