toposrl
Supplementary material for TopoSRL: Topology Preserving Self-Supervised Simplicial Representation Learning
Theorem 1. Minimizing the expected loss Suppose we have T -dimensional features. Anchor nodes serve as fixed reference points within a simplicial complex, anchoring its structure and providing stability. Furthermore, anchor nodes can also represent important entities. Figure S2: Comparison of TSNE plots of representations learned by various encoders. CCA-SSG methods can not capture higher-order information and show similar artifacts. For example, the two clusters on the bottom and one from the right (corresponding to classes 1,2,3) are students from the same year but in different divisions.
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Asia > Taiwan > Taiwan Province > Taipei (0.04)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Asia > Taiwan > Taiwan Province > Taipei (0.04)
TopoSRL: Topology preserving self-supervised Simplicial Representation Learning
In this paper, we introduce \texttt{TopoSRL}, a novel self-supervised learning (SSL) method for simplicial complexes to effectively capture higher-order interactions and preserve topology in the learned representations. We propose a new simplicial augmentation technique that generates two views of the simplicial complex that enriches the representations while being efficient. Next, we propose a new simplicial contrastive loss function that contrasts the generated simplices to preserve local and global information present in the simplicial complexes. Extensive experimental results demonstrate the superior performance of \texttt{TopoSRL} compared to state-of-the-art graph SSL techniques and supervised simplicial neural models across various datasets corroborating the efficacy of \texttt{TopoSRL} in processing simplicial complex data in a self-supervised setting.