Scaling Group Inference for Diverse and High-Quality Generation