ai compute
AI Greenferencing: Routing AI Inferencing to Green Modular Data Centers with Heron
Reddy, Tella Rajashekhar, Palak, null, Gandhi, Rohan, Parayil, Anjaly, Zhang, Chaojie, Shepperd, Mike, Yu, Liangcheng, Mohan, Jayashree, Iyengar, Srinivasan, Kalyanaraman, Shivkumar, Bhattacherjee, Debopam
AI power demand is growing unprecedentedly thanks to the high power density of AI compute and the emerging inferencing workload. On the supply side, abundant wind power is waiting for grid access in interconnection queues. In this light, this paper argues bringing AI workload to modular compute clusters co-located in wind farms. Our deployment right-sizing strategy makes it economically viable to deploy more than 6 million high-end GPUs today that could consume cheap, green power at its source. We built Heron, a cross-site software router, that could efficiently leverage the complementarity of power generation across wind farms by routing AI inferencing workload around power drops. Using 1-week ofcoding and conversation production traces from Azure and (real) variable wind power traces, we show how Heron improves aggregate goodput of AI compute by up to 80% compared to the state-of-the-art.
Graphcore and NEC partner to deliver advanced AI compute
Graphcore is announcing a partnership with NEC โ one of the world's best known and most respected technology companies - to accelerate heterogeneous supercomputing and innovation in artificial intelligence. The collaboration brings together our Intelligence Processing Unit (IPU) systems with NEC's vector supercomputer SX-Aurora TSUBASA to deliver AI high-performance solutions to customers worldwide. Graphcore becomes part of NEC's offering to customers who are building their AI compute capacity and want the advanced capabilities and performance advantage made possible by the IPU. NEC is also committed to making the IPU an integral part of its long-term product roadmap for artificial intelligence solutions, alongside its SX-Aurora TSUBASA vector supercomputers and other datacentre systems. The fact that NEC sees the IPU as the future of artificial intelligence compute and has chosen to make it part of their product offering is a massive endorsement of our technology.
Graphcore advances in Southeast Asia with new Singapore base
As more and more innovators across Asia choose IPU systems to power their AI breakthroughs, Graphcore is expanding into Southeast Asia with a new regional hub in Singapore. Graphcore Singapore will support our local teams and customers across ASEAN's fastest growing economies including Taiwan, Hong Kong, Vietnam, Malaysia, Thailand, Indonesia, and Singapore itself. This important milestone in Graphcore's international growth reflects the rate at which customers across the wider Asia-Pacific region are adopting IPU technology for AI compute. High-profile clients such as Korean technology giant NHN and Korea Telecom, the country's largest telecommunications business, have already selected Graphcore systems because of their superior performance on both today's AI workloads and ability to unlock new AI techniques for tomorrow's emerging applications. Graphcore is expanding into Southeast Asia with the expert support of our new Elite Partners NetWeb and Cxrus, both headquartered in Singapore, and INT2, based in Vietnam, as well as our existing global partners.
Mythic launches analog AI processor that consumes 10 times less power
Analog AI processor company Mythic launched its M1076 Analog Matrix Processor today to provide low-power AI processing. The company uses analog circuits rather than digital to create its processor, making it easier to integrate memory into the processor and operate its device with 10 times less power than a typical system-on-chip or graphics processing unit (GPU). The M1076 AMP can support up to 25 trillion operations per second (TOPS) of AI compute in a 3-watt power envelope. It is targeted at AI at the edge applications, but the company said it can scale from the edge to server applications, addressing multiple vertical markets including smart cities, industrial applications, enterprise applications, and consumer devices. To address a wider range of designs, the M1076 AMP comes in several form factors: a standalone processor, an ultra-compact PCIe M.2 card, and a PCIe card with up to 16 AMPs.
Computing to win: Addressing the policy blind spot that threatens national AI ambitions - Atlantic Council
Servers run inside the Facebook New Albany Data Center on Thursday, February 6, 2020 in New Albany, Ohio. Artificial intelligence (AI) is causing significant structural changes to global competition and economic growth. AI may generate trillions of dollars in new value over the next decade, but this value will not be easily captured or evenly distributed across nations. Much of it will depend on how governments invest in the underlying computational infrastructure that makes AI possible. Yet early signs point to a blind spot--a lack of understanding, measurement, and planning.