Why AI Systems Are So Hard To Predict - AI Summary

Those updates can be anything from software and firmware in other parts of a system, which can alter performance, power and thermal gradients, to new algorithms in the AI system or system of systems. Modifications to an algorithm can change the data flow within a system, stressing different parts of a system differently and at different times. These systems are supposed adapt to whatever is optimal for a particular user or device or application, so each system will adjust itself to the optimum performance or energy consumption based upon internal variations. That makes it almost impossible to predict how a system will behave, and it makes it much harder to pinpoint problems when a system is in use. The challenge going forward will be to build tools and systems that can both measure and predict all of these possible permutations, and to build sensors and analytics into systems that can at least give engineers some idea of how the hardware is behaving.