Goto

Collaborating Authors

 Asia


Appendix of Joint Data-T ask Generation for Auxiliary Learning Hong Chen

Neural Information Processing Systems

We provide the derivation of the upper implicit gradient in eq. We summarize the whole DTG-AuxL algorithm in Algorithm 1, where the lower and upper optimization updates are conducted alternatingly. We use the batch stochastic gradient optimization for both the lower and upper update. STL: It is a natural baseline where we only train on the primary task. Equal: It is a multi-task learning method, where we assign an equal weight of 1.0 to the loss of each MAXL can be only applied to the classification problem.







Self-SupervisedGraphTransformeronLarge-Scale MolecularData

Neural Information Processing Systems

Nevertheless, two issues impede the usage of GNNs in real scenarios: (1)insufficient labeled molecules forsupervised training; (2)poorgeneralization capability to new-synthesized molecules.




Acronyms

Neural Information Processing Systems

Frobenius norm of M λ ( M) Spectrum of M σ ( M) Singular values of M E ( x) Dirichlet energy computed on x H ( G) Homophily coefficient of the graph G A B Kronecker product between A and B vec( M) V ector obtained stacking columns of M . In this section, we give the details on the numerical results in Section 6 . On the contrary, the graph layers do not use any dropout nor non-linearity. A sketch of the algorithm is reported in fLode . Cora, Citeseer, and Pubmed are already undirected graphs: to these, we added self-loops.