Although significant efforts have been made into tackling statistical data heterogeneity,the diversity in the processing capabilities andnetworkbandwidth ofclients,termedassystemheterogeneity,hasremained largelyunexplored.

The recent large-scale text-to-image generative models have attained unprecedented performance, while people establishedadaptor modules like LoRA and DreamBooth to extend this performance to even more unseen concept tokens. However, we empirically find that this workflow often fails to accurately depict the out-of-distributionconcepts. This failure is highly related to the low quality of training data.

While this could be done using thesynthesis formulation, we demonstrate that this leads to slower performances. The main difficulty inapplying suchmethods intheanalysisformulation liesinproposing a way to compute the derivatives through the proximal operator.