Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs