Directly Forecasting Belief for Reinforcement Learning with Delays