Weathering Ongoing Uncertainty: Learning and Planning in a Time-Varying Partially Observable Environment