Global Big Data Conference

Efforts to benchmark computer systems, known as MLPerf, are essential to measure the expanding world of artificial intelligence silicon, according to Jeff Dean, head of AI efforts at Google, but the benchmarks will also have to evolve to better reflect real-world concerns. If computer systems are to evolve to handle ever larger machine learning models, a standard way to compare the effectiveness of those systems is essential, according to Google head of AI, Jeff Dean. But that system of measurement itself must evolve over time, he said. "I think the MLPerf benchmark suite is actually going to be very effective," said Dean, in an interview with ZDNet, last week, referring to the consortium of commercial and academic organizations known as MLPerf, founded within the last few years. The MLPerf group have formulated test suites that measure how different systems do on various AI tasks such as the number of image "convolutions" per second.