Country
IsBang-BangControlAllYouNeed? SolvingContinuousControlwithBernoulliPolicies
Real-world robotics tasks commonly manifest ascontrol problems overcontinuous action spaces. When learning to act in such settings, control policies are typically represented as continuous probability distributions that cover all feasible control inputs - often Gaussians. The underlying assumption is that this enables more refined decisions compared to crude policy choices such as discretized controllers, which limit the search space but induce abrupt changes. While switching controls canbeundesirable inpractice astheymaychallenge stability andaccelerate system weardown, they are theoretically feasible and even arise as optimal strategies in some settings.
Learning to Confuse: Generating Training Time Adversarial Data with Auto-Encoder
Ji Feng, Qi-Zhi Cai, Zhi-Hua Zhou
Thiscanbe formulated into anon-linear equality constrained optimization problem. Unlike GANs, solving such problem iscomputationally challenging, wethen proposed a simple yet effective procedure to decouple the alternating updates for the two networks for stability. By teaching the perturbation generator to hijacking the training trajectory of the victim classifier, the generator can thus learn to move against thevictim classifier stepbystep.