Infrastructure Requirements for AI Inference vs. Training