More Agents Helps but Adversarial Robustness Gap Persists