Following this observation, we proposeMaskFormer,asimple mask classification model which predicts a set of binary masks, each associated with asingle global class label prediction.

In this work, we provide evidence to the contrary.

Communication compression isacrucial technique formodern distributedlearning systems to alleviate their communication bottlenecks over slower networks.