Markov Observation Models