single chip deliver 1petaop
Single chip delivers 1PetaOps/sec
Groq calls its architecture Tensor Streaming Processor (TSP). Two years back it said it had recruited eight of the ten people who developed Google's Tensor Processing Unit (TPU). The company has raised $62.3 million in funding. Groq's architecture is equivalent to one quadrillion operations per second, or 1e15 ops/s and capable of up to 250 trillion floating-point operations per second (FLOPS). "Top GPU companies have been telling customers that they'd hoped to be able to deliver one PetaOp/s performance within the next few years; Groq is announcing it today," says Groq CEO Jonathan Ross, "the Groq architecture is many multiples faster than anything else available for inference, in terms of both low latency and inferences per second. We had first silicon back, first-day power-on, programs running in the first week, sampled to partners and customers in under six weeks, with A0 silicon going into production" With a software-first mindset, Groq's TSP architecture claims to achieve both compute flexibility and massive parallelism without the synchronization overhead of traditional GPU and CPU architectures.