Compressed Context Memory For Online Language Model Interaction