d (s,πo(s))=Ro(s) +γdGo(s), max