Microsoft's AI rewrites sentences based on context

Ever heard of context modeling? It defines how contextual data is structured and maintained, and it plays a pivotal role in open domain conversation. That's why researchers at Microsoft recently investigated a novel approach that involves rewriting the last utterance in a dialogue turn (i.e., a series of utterances) by considering context history. In a preprint paper detailing their work ("Unsupervised Context Rewriting for Open Domain Conversation"), they claim empirical results show it achieves state-of-the-art baselines in terms of rewriting quality and multi-turn response generation. As the researchers explain, conversation context raises challenges not existing in the sentence modeling, including things like topic transitions, coreferences (e.g., he, him, she, it, they), and long-term dependencies.