Industry
Debiased Counterfactual Generation via Flow Matching from Observations
Dance, Hugh, Xi, Johnny, Orbanz, Peter, Bloem-Reddy, Benjamin
Estimating counterfactual distributions under interventions is central to treatment risk assessment and counterfactual generation tasks. Existing approaches model the counterfactual distribution as a standalone generative target, without exploiting its relationship to the observational data. In this work, we show that under standard assumptions, observational and counterfactual outcome distributions are tightly linked: they have identical support and tail behavior, remain statistically close under weak confounding, and share any features of high-dimensional outcomes which are invariant to confounders. These properties motivate learning counterfactual distributions not from scratch, but via a deconfounding flow from the observational distribution. We formulate this problem via flow-matching and derive a semiparametrically efficient estimator based on a novel efficient influence function correction. We subsequently extend our estimator to target minimal-energy flows in high-dimensions, which we show can be especially simple targets between observational and counterfactual distributions. In experiments, deconfounding flows outperform existing debiased counterfactual distribution estimators, while also mitigating known failure modes of flow-based methods.
Flow Matching for Count Data
High-dimensional count data arise in applications such as single-cell RNA sequencing and neural spike trains, where mapping between distributions across successive batches or time points form critical components of data analysis. The recent success of diffusion- and flow-based deep generative models for images, video, and text motivates extending these ideas to count-valued settings, but many existing methods either treat each count as a categorical state or transform counts into a continuous space, neither of which is natural or efficient when the count range is large. We propose count-FM, a flow-matching framework for count data based on a continuous-time birth-death process with local unit jumps. Count-FM learns marginal transitions efficiently in count space through simulation-free training of conditional transition rates, allowing transport between arbitrary count-distributed source and target populations. In simulation, count-FM achieves better sample quality than representative baselines while using substantially fewer parameters. We further apply count-FM to scRNA-seq and neural spike-train data for unconditional generation, transport, and conditional generation. Across these tasks, count-FM yields improved sample quality, greater modeling efficiency, and interpretable transport paths.
POETS: Uncertainty-Aware LLM Optimization via Compute-Efficient Policy Ensembles
Menet, Nicolas, Krause, Andreas, Rahimi, Abbas
Balancing exploration and exploitation is a core challenge in sequential decision-making and black-box optimization. We introduce POETS ($\textbf{Po}$licy $\textbf{E}$nsembles for $\textbf{T}$hompson $\textbf{S}$ampling), a novel framework that bridges uncertainty quantification and policy optimization. Our approach is grounded in the insight that policies trained with Kullback-Leibler (KL) regularization implicitly encode an underlying reward function. Building on this, POETS bypasses the complex, nested process of training an uncertainty-aware reward model and separately fitting a policy to this model. Instead, we directly train a policy ensemble to capture epistemic uncertainty by matching implicitly encoded reward functions to online, bootstrapped data. To overcome the prohibitive compute and memory constraints of ensembling Large Language Models (LLMs), POETS utilizes an efficient architecture: the ensemble shares a pre-trained backbone while maintaining diversity through independent Low-Rank Adaptation (LoRA) branches. Theoretically, we prove that POETS implicitly conducts KL-regularized Thompson sampling and thus inherits strong cumulative regret bounds of ${\mathcal O}(\sqrt{T ฮณ_T})$. Empirically, we demonstrate that POETS achieves state-of-the-art sample efficiency across diverse scientific discovery domains, including protein search and quantum circuit design. Furthermore, it improves the optimization trajectories of reinforcement learning, proving particularly robust in off-policy settings with experience replay or in small dataset regimes.
Expectation-Maximization as a Spectrally Governed Relaxation Flow
The expectation--maximization (EM) algorithm combines global monotonicity, local linear convergence, and strong practical robustness, but these features are usually analyzed separately. Global descent is nonlinear, whereas local convergence is governed by the spectrum of the linearized EM map. How these two levels fit into a single dynamical picture has remained less transparent. We make explicit the latent-variable operator that connects them. Along the EM trajectory, the likelihood increment admits a global energy decomposition in terms of posterior-relative entropy. Linearization at a nondegenerate maximizer $ฮธ^\ast$ then reveals the local operator \[ \mathcal G_{ฮธ^\ast}=I-DT(ฮธ^\ast), \] which coincides with both the missing-information ratio and the information-geometric Hessian of the observed likelihood. This operator provides a unified description of local contraction, posterior rigidity, and geometric curvature. Its spectrum yields a sharp characterization of local convergence and naturally leads to an optimal scalar relaxation rule for locally accelerated EM. These results place global descent, local spectral behavior, and optimal local relaxation within a common dynamical framework.
Black-box model classification under the discriminative factorization
Helm, Hayden, Ohata, Merrick, Priebe, Carey
Access to modern generative systems is often restricted to querying an API (the ``black-box" setting) and many properties of the system are unknown to the user at inference time. While recent work has shown that low-dimensional representations of models based on the relationship between their embedded responses to a set of queries are useful for inferring model-level properties, the quality of these representations is highly sensitive to the query set. We introduce the \emph{discriminative factorization} to distinguish between high- and low-quality query sets in the context of black-box model-level classification. Under this framework, the probability of chance-level classification decays exponentially in the query budget. On three auditing tasks, estimated factorization parameters predict the empirical performance decay rate. We conclude by showing that query sets selected using the estimated discriminative field reproduce the empirical ordering of oracle query sets.
Characterizing and Correcting Effective Target Shift in Online Learning
Online learning from a stream of data is a defining feature of intelligence, yet modern machine learning systems often struggle in this setting, especially under distributional shift. To understand its basic properties, we study the relationship between online and offline learning in the context of kernel regression. We derive a closed-form expression for the function learned by online kernel regression, revealing that online kernel regression is equivalent to offline regression with shifted, inaccurate target outputs. Conversely, we show that by compensating for this effective shift in the teaching signal through target correction, online kernel-based learning can provably learn the same predictor as its offline counterpart. We derive both a closed-form expression for this target correction and an iterative form that can be applied sequentially. Applying this framework to image classification tasks on CIFAR-10 and CORe50, we show that online stochastic gradient descent with iteratively corrected targets outperforms learning with the true targets in continual learning settings. This work therefore provides a basic framework for analyzing and improving online learning in non-stationary environments.
Semiparametric Efficient Test for Interpretable Distributional Treatment Effects
Zenati, Houssam, Gretton, Arthur
Distributional treatment effects can be invisible to means: a treatment may preserve average outcomes while changing tails, modes, dispersion, or rare-event probabilities. Kernel tests can detect discrepancies between interventional outcome laws, but global tests do not reveal where the laws differ. We propose DR-ME, to our knowledge the first semiparametrically efficient finite-location test for interpretable distributional treatment effects. DR-ME evaluates an interventional kernel witness at learned outcome locations, returning causal-discrepancy coordinates rather than only a global rejection. From observational data, we derive orthogonal doubly robust kernel features whose centered oracle form is the canonical gradient of this finite witness. For fixed locations, we characterize the local testing limit: DR-ME is chi-square calibrated under the null, has noncentral chi-square local power, and uses the covariance whitening that optimizes local signal-to-noise for discrepancies visible through the selected coordinates. This efficient local-power geometry yields a principled location-learning criterion, with sample splitting preserving post-selection validity. Experiments show near-nominal type-I error, competitive power against global doubly robust kernel tests, and interpretable learned locations that localize distributional effects in a semi-synthetic medical-imaging study.
Empirical Bayes Rebiasing
Ling, Wanyi, Li, Sida, Guan, Junming, Ignatiadis, Nikolaos
We study methods for simultaneous analysis of many noisy and biased estimates, each paired with an even noisier estimate of its own bias. The analyst's goal is to construct short calibrated intervals for each parameter. The standard debiasing approach, which subtracts the bias estimate from each biased estimate, inflates variance and yields long intervals. In this paper, we propose an empirical Bayes rebiasing strategy that starts from the fully debiased estimates and learns from data how much bias to reintroduce by estimating the unknown bias distribution. We provide convergence rates for the coverage of our intervals when the bias distribution is estimated using nonparametric maximum likelihood. Furthermore, we demonstrate substantial precision gains in prediction-powered inference, including pairwise LLM win-rate evaluations, as well as for inference of direct genetic effects in family-based GWAS.
Trouble brewing: Britain's beloved cup of tea could soon taste more BITTER thanks to climate change, campaigners warn
Death of Alabama woman, 22, 'accidentally' shot in chest by boyfriend's dad is ruled a HOMICIDE Two small airlines join forces to create America's newest budget carrier after Spirit collapse leaves millions scrambling Horrifying final days of killer dad Chris Watts' pregnant wife before she was slaughtered alongside their daughters. Read all the chilling texts and receipts in full for first time: 'My eyes burn from crying' I'm a pastor who attended a secret UFO disclosure meeting. We saw images of'translucent beings' that chilled me to the bone... the files could fulfil a dark biblical prophecy Former NFL player Josh Mauro's tragic cause of death revealed after league was left'devastated' by ex-Cardinals and Giants man's sudden passing at 35 Cheerful Christian mom is pillar of Florida community and loves going on TV... but she has a childhood secret so evil that she stuttered with shock when confronted with it Taxpayers to foot Trump's $1.7 BILLION bill as President sues his own government: 'I'm paying myself' How I lost 3 STONE in 3 WEEKS. I've reversed pre-diabetes and no longer need a knee op: DONAL MACINTYRE's extraordinary investigation Popular megachurch in crisis as senior pastor suddenly quits... as bosses furiously DENY sex scandal Husband of doomed dive group leader says'something must have happened down there' as mystery surrounds why the five attempted to explore'cave so deep even divers with best equipment don't try' Greeks savage Kimberly Guilfoyle as Trump's ambassador opens McDonald's in country celebrated for world-class food Trump touts'fantastic' China trade win on Air Force One... but Wall Street is punishing the President I'm godfather to Candace Owens' daughter and Charlie Kirk was my friend... so I know the real reason she's attacking Erika - and I'll never publicly condemn her Wealthy dad'snarled the worst thing a parent could say' to younger daughter before he allegedly executed wife outside their gated community home during nightmare divorce Reese Witherspoon and Ryan Phillippe reunite for son's NYU graduation... as Kate Hudson cheers on her boy at same ceremony with Goldie Hawn and Kurt Russell'How do you live with that?' Disgraced Eric Swalwell's'blindsided' wife dresses for revenge... as friends reveal brutal toll sex assault scandal has had on young mom Judge declares another mistrial in disgraced Hollywood mogul Harvey Weinstein's rape case Can't lose weight no matter what you do? These are the 7 surprising reasons why, including'healthy' hacks actually making you put on pounds.
Samsung's Bespoke update is big step towards a useful AI for your fridge
Samsung's Bespoke update is big step towards a useful AI for your fridge Samsung's Bespoke update is big step towards a useful AI for your fridge The idea of installing a software update on your fridge already feels kind of weird, let alone one centered around improving its AI capabilities. But that's exactly what's happening to Samsung's line of Bespoke refrigerators this week, and to my surprise this patch is making major strides at providing truly useful machine learning in a modern day icebox. As a quick recap, Samsung has offered AI-powered features like automatic food recognition and meal planning on its Bespoke refrigerators for a couple years already. However, as I found out after reviewing its flagship model late last year, the company's AI capabilities are still very much a work in progress. Previously, the fridge could recognize around 60 different kinds of fresh foods (like fruits and veggies) alongside another 50 or so packaged goods like yogurt or popcorn.