Federated style aware transformer aggregation of representations