Learning Control Under Extreme Uncertainty