Using a Logarithmic Mapping to Enable Lower Discount Factors in Reinforcement Learning

Weproveconvergence for this method under standard assumptions and demonstrate empirically that it indeed enables lowerdiscount factors forapproximate reinforcement-learning methods.