Retrieval-Augmented Classification with Decoupled Representation