The NLP Cypher

Microsoft's DeepSpeed continues to plot approaches to very very large language models. And now they are infiltrating the inference domain. With models containing billions and now pushing into the trillion parameter range, distributed inference is a requirement. The future of GPT-3 is global. The cat is out of the bag now.