Learning Separable Hidden Unit Contributions for Speaker-Adaptive Lip-Reading