Dr Jekyll & Mr Hyde: the strange case of off-policy policy updates