Choosing the Right AI Tech for Inference Scale-Out