From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approach