Machine learning (ML) algorithms can solve many prediction tasks with greater accuracy than classical methods.

We additionally assume that the agent cannot interact with the environment but has access to the action-labeled transition data collected by some agents with unknown qualities.

Thepresented equations can be efficiently solved using well-known numerical methods.