Parallel MCMC Without Embarrassing Failures