Goto

Collaborating Authors

 Asia


Self-SupervisedGraphTransformeronLarge-Scale MolecularData

Neural Information Processing Systems

Nevertheless, two issues impede the usage of GNNs in real scenarios: (1)insufficient labeled molecules forsupervised training; (2)poorgeneralization capability to new-synthesized molecules.




Acronyms

Neural Information Processing Systems

Frobenius norm of M ฮป ( M) Spectrum of M ฯƒ ( M) Singular values of M E ( x) Dirichlet energy computed on x H ( G) Homophily coefficient of the graph G A B Kronecker product between A and B vec( M) V ector obtained stacking columns of M . In this section, we give the details on the numerical results in Section 6 . On the contrary, the graph layers do not use any dropout nor non-linearity. A sketch of the algorithm is reported in fLode . Cora, Citeseer, and Pubmed are already undirected graphs: to these, we added self-loops.






Uniform Convergence with Square-Root Lipschitz Loss

Neural Information Processing Systems

In linear regression, interpolating the square loss is equivalent to interpolating many other losses (such as the absolute loss) on the training set. Similarly, in the context of linear classification, many works (Soudry et al. 2018; Ji and Telgarsky 2019; Muthukumar et al. 2021) have shown that optimizing


sup

Neural Information Processing Systems

LetT be the time horizon andPT be the path-length that essentially reflects the non-stationarity of environments, the state-of-the-art dynamicregretis O( p T(1+PT)).