However, estimating and optimizingฮฑ-divergences require to use importance sampling, which may havelarge orinfinite variance due to heavy tails ofimportance weights.
Unlikeknowledge-based anddata-basedalgorithms, competence-based algorithms simultaneously address both the exploration challenge as well as distilling the generated experience in the form of reusable skills.