STAMP: Scalable Task And Model-agnostic Collaborative Perception