LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactions