Google's new AI language model can comprehend entire books
One of the prime challenges of a language-based AI model is to understand the context of the surrounding content. To solve this problem, Google has introduced a new model called Reformer, which understands the context of 1 million lines using just 16GB space. The company built this to solve problems of its old model Transformer -- a neural network that compares words in a paragraph to each other to understand the relationship between them. Early birds are even cooler. However, as it uses pair matching, Transformer takes a lot of data space if it needs to process text more than a few thousand words.
Jan-21-2020, 01:33:28 GMT
- Technology: