A Proof of Theorem 3.1

Neural Information Processing Systems 

We need some more notation in order to linearize the value function.