Vector-ICL: In-context Learning with Continuous Vector Representations