Robust Exploration with Tight Bayesian Plausibility Sets