ReCoRe: Regularized Contrastive Representation Learning of World Model