The very basics of Reinforcement Learning

So, say if we want to predict the future, rather than using the whole history, we can use the Markov State. The Markov State essentially contains no less information than the history. So, here the probability of getting to a future state St 1 given state St is the same as getting to St 1 given all the previous states. This is because the state St already contains the information about the previous states embedded in it. Say, we have a game in which there is a waiter at a restaurant.