CoLa: Learning to Interactively Collaborate with Large Language Models