Resource Management in the Age of Artificial Intelligence - HPCwire

Fueled by GPUs, big data, and rapid advances in software, the AI revolution is upon us. Enterprises are re-tooling systems and exploring AI for everything from customer service to fraud surveillance to enhanced decision making. For IT organizations, deploying, managing and sustaining these environments is a significant challenge. In this article, we look at AI through the prism of workload and resource management and explain how new challenges are driving fresh innovation. AI resource management is an "all-of-the-above" challenge Building and deploying AI applications is a multi-stage workflow, and each stage involves different applications and frameworks with unique workload and resource management challenges. AI models are fueled by vast amounts of training data from sources that include SQL databases, NoSQL stores, and semi-structured data in object stores or data lakes.