Identifying Latent Actions and Dynamics from Offline Data via Demonstrator Diversity