groq tsp lead
Groq TSP Leads in Inference Performance
Today the Linley Group released its latest Microprocessor Report titled "Groq Rocks Neural Networks", which concludes that Groq's "TSP stands out in both peak performance and ResNet-50 throughput," and that "Groq's [deep-learning] accelerator is the fastest available on the merchant market." The Linley Group's report provides the most detailed overview of the novel Groq architecture available to date. In the few weeks since our interview with the Linley Group, we've been able to improve the performance of our ResNet-50 v2 implementation. The TSP can now reach 21,700 IPS (core compute) for Resnet-50 running at 900 MHz. Groq's level of inference performance exceeds that of other commercially available neural network architectures, with throughput that more than doubles the ResNet-50 score of the incumbent GPU-based architecture.