BACON allows computational resources to be focused on simulations that provide the most value in terms of reducing epistemic uncertainty.

In the policy evaluation steps, the critic is updated to capture the soft Q-function. In the policy improvement steps, the actor is adjusted in accordance with the updated soft Q-function.

Neural Information Processing Systems http://nips.cc/

However, existing frameworks face several interrelated limitations.