SAPA: Similarity-A ware Point Affiliation for Feature Upsampling Supplementary Materials