Overview -- ZeroGen, Efficient Zero-shot Learning via Dataset Generation

An interesting take on zero-shot learning was introduced in a paper that was dated Feb 16. More efficient and flexible ways to conduct zero-shot learning with PLMs were explored by the authors. They take the dataset generation method to the extreme and study ZeroGEN, a flexible and efficient zero-shot learning framework via dataset generation. With the pseudo-dataset, a tiny task model TAM is trained to conduct the given task. This procedure is highly flexible, meaning that any model architecture, loss function, and training strategy can be used.