Lin, Joshua Yao-Yu
SupSiam: Non-contrastive Auxiliary Loss for Learning from Molecular Conformers
Maser, Michael, Park, Ji Won, Lin, Joshua Yao-Yu, Lee, Jae Hyeon, Frey, Nathan C., Watkins, Andrew
We investigate Siamese networks for learning related embeddings for augmented samples of molecular conformers. We find that a non-contrastive (positive-pair only) auxiliary task aids in supervised training of Euclidean neural networks (E3NNs) and increases manifold smoothness (MS) around point-cloud geometries. We demonstrate this property for multiple drug-activity prediction tasks while maintaining relevant performance metrics, and propose an extension of MS to probabilistic and regression settings. We provide an analysis of representation collapse, finding substantial effects of task-weighting, latent dimension, and regularization. We expect the presented protocol to aid in the development of reliable E3NNs from molecular conformers, even for small-data drug discovery programs. Modeling conformational shape is of critical importance in many molecular machine learning (MolML) tasks (Zheng et al., 2017).
AGNet: Weighing Black Holes with Deep Learning
Lin, Joshua Yao-Yu, Pandya, Sneh, Pratap, Devanshi, Liu, Xin, Kind, Matias Carrasco, Kindratenko, Volodymyr
Supermassive black holes (SMBHs) are commonly found at the centers of most massive galaxies. Measuring SMBH mass is crucial for understanding the origin and evolution of SMBHs. Traditional approaches, on the other hand, necessitate the collection of spectroscopic data, which is costly. We present an algorithm that weighs SMBHs using quasar light time series information, including colors, multiband magnitudes, and the variability of the light curves, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 light curves for a sample of 38, 939 spectroscopically confirmed quasars to map out the nonlinear encoding between SMBH mass and multi-band optical light curves. We find a 1 scatter of 0.37 dex between the predicted SMBH mass and the fiducial virial mass estimate based on SDSS singleepoch spectra, which is comparable to the systematic uncertainty in the virial mass estimate. Our results have direct implications for more efficient applications with future observations from the Vera C. Rubin Observatory. Our code, AGNet, is publicly available at https: //github.com/snehjp2/AGNet.