Goto

Collaborating Authors

 Industry


Rob Reiner used his fame to advocate for progressive causes. 'Just a really special man. A terrible day'

Los Angeles Times

Things to Do in L.A. Tap to enable a layout that focuses on the article. Rob Reiner used his fame to advocate for progressive causes. This is read by an automated voice. Please report any issues or inconsistencies here . Rob Reiner was a Hollywood legend and also a political force, a frequent voice in progressive causes and a Democratic Party activist.


2 found dead at home of Rob Reiner

Los Angeles Times

Things to Do in L.A. Tap to enable a layout that focuses on the article. This is read by an automated voice. Please report any issues or inconsistencies here . Two people were found dead Sunday afternoon at the Brentwood home of director and actor Rob Reiner, multiple law enforcement sources confirmed. Margaret Stewart, a Los Angeles Fire Department spokesman, said the department was called to the home around 3:30 p.m. for medical aid.


Trio of small quakes rattles Bay Area near Santa Rosa

Los Angeles Times

Things to Do in L.A. Tap to enable a layout that focuses on the article. A magnitude 4.0 earthquake was reported Sunday at 3:30 p.m. in the Bay Area. It was followed in the same area by two smaller quakes. This is read by an automated voice. Please report any issues or inconsistencies here .


Covariate-assisted graph matching

arXiv.org Machine Learning

Data integration is essential across diverse domains, from historical records to biomedical research, facilitating joint statistical inference. A crucial initial step in this process involves merging multiple data sources based on matching individual records, often in the absence of unique identifiers. When the datasets are networks, this problem is typically addressed through graph matching methodologies. For such cases, auxiliary features or covariates associated with nodes or edges can be instrumental in achieving improved accuracy. However, most existing graph matching techniques do not incorporate this information, limiting their performance against non-identifiable and erroneous matches. To overcome these limitations, we propose two novel covariate-assisted seeded graph matching methods, where a partial alignment for a set of nodes, called seeds, is known. The first one solves a quadratic assignment problem (QAP) over the whole graph, while the second one only leverages the local neighborhood structure of seed nodes for computational scalability. Both methods are grounded in a conditional modeling framework, where elements of one graph's adjacency matrix are modeled using a generalized linear model (GLM), given the other graph and the available covariates. We establish theoretical guarantees for model estimation error and exact recovery of the solution of the QAP. The effectiveness of our methods is demonstrated through numerical experiments and in an application to matching the statistics academic genealogy and the collaboration networks. By leveraging additional covariates, we achieve improved alignment accuracy. Our work highlights the power of integrating covariate information in the classical graph matching setup, offering a practical and improved framework for combining network data with wide-ranging applications.


Classifying High-Energy Celestial Objects with Machine Learning Methods

arXiv.org Machine Learning

Modern astronomy has generated an extensive taxonomy of celestial objects based on their physical characteristics and predicted future state. As theories of the development, expansion, history, and predicted future state of the universe rely on identifying and observing celestial bodies, it is essential to have quick and accurate classification of newly observed objects. Historically, classification was performed manually, but the rapid expansion of modern catalogues of celestial objects - such as the Sloan Digital Sky Survey, which grows at a rate of thousands of entries daily [1] - makes this manual classification impractical. Supervised and semi-supervised machine learning represent the most promising candidates for the desired computational classification. Until recently, the data, hardware, and software required for large-scale training and deployment of these methods were unavailable to the general research community. However, improvements to parallel processing hardware have driven increased success and adoption, resulting in the invention of models capable of equaling or surpassing human-level intelligence in tasks formerly considered intractable to computers. Such improvements have been recognized in facial recognition [2] and combinatorial game theory [3], but despite their meteoric rise in popularity, there is a significant gap in astronomical literature on applying machine learning models to the problem of celestial object classification. In an effort to improve this state, we explore a number of machine learning based models for a simplified celestial object classification problem to assess the performance and potential of these models in the field of astronomy.


Data-Driven Model Reduction using WeldNet: Windowed Encoders for Learning Dynamics

arXiv.org Machine Learning

Many problems in science and engineering involve time-dependent, high dimensional datasets arising from complex physical processes, which are costly to simulate. In this work, we propose WeldNet: Windowed Encoders for Learning Dynamics, a data-driven nonlinear model reduction framework to build a low-dimensional surrogate model for complex evolution systems. Given time-dependent training data, we split the time domain into multiple overlapping windows, within which nonlinear dimension reduction is performed by auto-encoders to capture latent codes. Once a low-dimensional representation of the data is learned, a propagator network is trained to capture the evolution of the latent codes in each window, and a transcoder is trained to connect the latent codes between adjacent windows. The proposed windowed decomposition significantly simplifies propagator training by breaking long-horizon dynamics into multiple short, manageable segments, while the transcoders ensure consistency across windows. In addition to the algorithmic framework, we develop a mathematical theory establishing the representation power of WeldNet under the manifold hypothesis, justifying the success of nonlinear model reduction via deep autoencoder-based architectures. Our numerical experiments on various differential equations indicate that WeldNet can capture nonlinear latent structures and their underlying dynamics, outperforming both traditional projection-based approaches and recently developed nonlinear model reduction methods.


TPV: Parameter Perturbations Through the Lens of Test Prediction Variance

arXiv.org Machine Learning

We identify test prediction variance (TPV) -- the first-order sensitivity of model outputs to parameter perturbations around a trained solution -- as a unifying quantity that links several classical observations about generalization in deep networks. TPV is a fully label-free object whose trace form separates the geometry of the trained model from the specific perturbation mechanism, allowing a broad family of parameter perturbations like SGD noise, label noise, finite-precision noise, and other post-training perturbations to be analyzed under a single framework. Theoretically, we show that TPV estimated on the training set converges to its test-set value in the overparameterized limit, providing the first result that prediction variance under local parameter perturbations can be inferred from training inputs alone. Empirically, TPV exhibits a striking stability across datasets and architectures -- including extremely narrow networks -- and correlates well with clean test loss. Finally, we demonstrate that modeling pruning as a TPV perturbation yields a simple label-free importance measure that performs competitively with state-of-the-art pruning methods, illustrating the practical utility of TPV. Code available at github.com/devansharpit/TPV.


Provable Recovery of Locally Important Signed Features and Interactions from Random Forest

arXiv.org Machine Learning

Feature and Interaction Importance (FII) methods are essential in supervised learning for assessing the relevance of input variables and their interactions in complex prediction models. In many domains, such as personalized medicine, local interpretations for individual predictions are often required, rather than global scores summarizing overall feature importance. Random Forests (RFs) are widely used in these settings, and existing interpretability methods typically exploit tree structures and split statistics to provide model-specific insights. However, theoretical understanding of local FII methods for RF remains limited, making it unclear how to interpret high importance scores for individual predictions. We propose a novel, local, model-specific FII method that identifies frequent co-occurrences of features along decision paths, combining global patterns with those observed on paths specific to a given test point. We prove that our method consistently recovers the true local signal features and their interactions under a Locally Spike Sparse (LSS) model and also identifies whether large or small feature values drive a prediction. We illustrate the usefulness of our method and theoretical results through simulation studies and a real-world data example.


An Efficient Variant of One-Class SVM with Lifelong Online Learning Guarantees

arXiv.org Machine Learning

We study outlier (a.k.a., anomaly) detection for single-pass non-stationary streaming data. In the well-studied offline or batch outlier detection problem, traditional methods such as kernel One-Class SVM (OCSVM) are both computationally heavy and prone to large false-negative (Type II) errors under non-stationarity. To remedy this, we introduce SONAR, an efficient SGD-based OCSVM solver with strongly convex regularization. We show novel theoretical guarantees on the Type I/II errors of SONAR, superior to those known for OCSVM, and further prove that SONAR ensures favorable lifelong learning guarantees under benign distribution shifts. In the more challenging problem of adversarial non-stationary data, we show that SONAR can be used within an ensemble method and equipped with changepoint detection to achieve adaptive guarantees, ensuring small Type I/II errors on each phase of data. We validate our theoretical findings on synthetic and real-world datasets.


STARK denoises spatial transcriptomics images via adaptive regularization

arXiv.org Machine Learning

We present an approach to denoising spatial transcriptomics images that is particularly effective for uncovering cell identities in the regime of ultra-low sequencing depths, and also allows for interpolation of gene expression. The method -- Spatial Transcriptomics via Adaptive Regularization and Kernels (STARK) -- augments kernel ridge regression with an incrementally adaptive graph Laplacian regularizer. In each iteration, we (1) perform kernel ridge regression with a fixed graph to update the image, and (2) update the graph based on the new image. The kernel ridge regression step involves reducing the infinite dimensional problem on a space of images to finite dimensions via a modified representer theorem. Starting with a purely spatial graph, and updating it as we improve our image makes the graph more robust to noise in low sequencing depth regimes. We show that the aforementioned approach optimizes a block-convex objective through an alternating minimization scheme wherein the sub-problems have closed form expressions that are easily computed. This perspective allows us to prove convergence of the iterates to a stationary point of this non-convex objective. Statistically, such stationary points converge to the ground truth with rate $\mathcal{O}(R^{-1/2})$ where $R$ is the number of reads. In numerical experiments on real spatial transcriptomics data, the denoising performance of STARK, evaluated in terms of label transfer accuracy, shows consistent improvement over the competing methods tested.