Ensuring Fair LLM Serving Amid Diverse Applications