Goto

Collaborating Authors

 Deep Learning







Convergence of Actor-Critic Methods with Multi-Layer Neural Networks

Neural Information Processing Systems

The early theory of actor-critic methods considered convergence using linear function approximators for the policy and value functions. Recent work has established convergence using neural network approximators with a single hidden layer. In this work we are taking the natural next step and establish convergence using deep neural networks with an arbitrary number of hidden layers, thus closing a gap between theory and practice. We show that actor-critic updates projected on a ball around the initial condition will converge to a neighborhood where the average of the squared gradients is O (1 / m) + O (ฯต), with m being the width of the neural network and ฯต the approximation quality of the best critic neural network over the projected set.



BitDelta: YourFine-TuneMayOnlyBeWorthOneBit

Neural Information Processing Systems

Thisinteresting finding notonlyhighlights the potential redundancy of information added during fine-tuning, but also has significant implications for the multi-tenant serving and multi-tenant storage of fine-tuned models.