"Let the AI conspiracy begin..." Language Model coordination is just one inference-intervention away