Goto

Collaborating Authors

 prediction


Millions told to brace for life-threatening conditions as Tropical Storm Bertha barrels toward US coast

Daily Mail - Science & tech

Chilling map shows where more than 117,000 surveillance cameras are hiding in the US... is your hometown being watched? Chaos at ESPN as'cowardly' execs are slammed for firing $2m-a-year star MID-SHOW... with more layoffs expected today How to lose more than a stone every month WITHOUT weight-loss jabs: I spent years yo-yo dieting and thought I'd cracked it so many times. Here's the method that finally worked... and the tweak that helped me to drop 5 st in my 60s - and keep it off She thinks she's the ugliest person in the world. A soulless ghoul': Charlie Kirk's family reveal widow's private tirades against podcaster she refers to as'that b****' 'Adam Levine is a super weird guy': Insiders reveal ugly Hollywood verdict on Maroon 5 star... and real reason Victoria's Secret model wife didn't leave him after sexting scandal US soldier is identified after he was killed by Iranian drone - read his wife's heartbreaking post Journey rocker SLAMS Bruce Springsteen as'an annoying, bitter old man' who'should shut up'... after Mick Jagger takes aim at him Tom Brady beams in sweet family photo with sons and daughter Vivian who's spitting image of ex Gisele Bundchen Kai Trump reveals diet and exercise secrets that created her new washboard abs... and the impact mom Vanessa had on her fitness journey No one's shocked Harry wants to reverse Megxit. Sinister underbelly of Instagram-perfect paradise adored by Americans... where men prey on women in maze of unmarked alleys: 'I just started screaming' Aaron Rodgers REUNITES with his estranged parents after'more than a decade'... but one family member is missing from photoshoot Manhattan elite flocking to picturesque'anti-Hamptons' enclave that offers REAL luxury for fraction of the price Disgusted schoolgirl speaks out after board member sparked fury by telling her'God, you're hot' during public meeting No wonder they're so giddy... they've discovered Travis Kelce's secret!


The secret to human 'brilliance' that AI just can't match

AIHub

People often make decisions through "satisficing," gathering just enough information to make a satisfactory prediction of a likely outcome. A series of experimental games shows that people also employ satisficing to learn social rules and conventions. This finding offers new insight into social learning and reveals a key difference between how humans and LLMs make predictions. The premise of AI large language models is that any problem can be solved by vacuuming up as much information as possible, running it through probability models, and performing complex calculations to make predictions and come up with the optimal solution. Another premise behind LLMs is that they emulate the way human brains operate.


Occam's razor has lost its edge. Can we sharpen our search for truth?

New Scientist

Occam's razor has lost its edge. Can we sharpen our search for truth? Seeking out the simplest, most elegant explanations has served scientists well for centuries, but cognitive scientist Marina Dubova's experiments are revealing better ways to uncover reality Limited by the knowledge of his time, the ancient Greek astronomer Ptolemy imagined that the planets and sun of our solar system orbited Earth. Every new observation that pushed against this image required a slight tweak to that theory, until centuries later Nicolaus Copernicus's reimagining toppled it once and for all. A more elegant explanation proposed that all the planets orbited the sun, kicking off a scientific revolution that changed our understanding of the entire universe.


Conformal Bayes for Two-Sided Censored Gaussian Regression under Label Shift

arXiv.org Machine Learning

Prediction under label shift becomes nonstandard when responses are censored. In a two-sided censored Gaussian model, latent values below $L$ and above $U$ are recorded at the boundary values, so the observed predictive distribution is mixed, with atoms at $L$ and $U$ and a continuous density on $(L,U)$. In this paper we develop conformal Bayes for this mixed-space setting by combining posterior predictive tilting with weighted conformal calibration. Under a two-sided Tobit Gaussian Bayesian prediction head with a Laplace posterior approximation, the tilted predictive distribution has left-atom, interior, and right-atom components, with a three-term closed-form normalizer. The resulting prediction set is a mixed highest density region that can combine boundary atoms with an interior interval and can reduce to atom-only sets under strong censoring. The main technical issue is that latent label shift does not directly give an ordinary density ratio on the observed censored scale. A latent exponential tilt induces tail-averaged atom weights at the censored boundaries, while the interior ratio remains density based. This yields a mixed observed-space calibration weight with two atom ratios and one interior density ratio. The weight corrects the calibration measure, while predictive tilting gives target-adapted mixed-HDR geometry. Synthetic experiments show that weighted tilted conformal Bayes restores marginal coverage with smaller sets than weighted source-score calibration, while revealing a trade-off between marginal coverage and component-wise behavior across atoms and interior observations.


An Additive MLP-GNN Framework for Characterizing Chemical and Structural Contributions to Aqueous Solubility

arXiv.org Machine Learning

Aqueous solubility is a key property in early-stage drug discovery, but most predictive models merge physicochemical descriptors and molecular graph information into a single representation, obscuring whether a prediction is driven by global chemistry, molecular structure, or both. We present an additive deep-learning framework that keeps these two sources of information separate throughout training: physicochemical descriptors are encoded by a multilayer perceptron (the chemical branch) and molecular graph topology by a graph neural network (the structural branch), with the two outputs combined only at the prediction stage through an additive model with an optional multiplicative interaction. This design provides a direct decomposition of chemical and structural components that can be examined separately after training. Furthermore, pretraining on the larger AqSolDB dataset and fine-tuning on the smaller BigSolDB2 dataset substantially improve accuracy and reduce run-to-run variations, indicating generalizability of the learned features from the data-rich settings. We further interpret the fitted model using best linear projections of the branch outputs, molecule-level embedding summaries across solubility classes, and atom-level GNNExplainer masks aggregated over functional groups. These analyses show that the chemical branch aligns with familiar physicochemical descriptors, while the structural branch captures graph-topological and functional-group patterns associated with solubility. Across both datasets, the framework attains competitive predictive performance while making the distinct roles of chemical and structural information more transparent.


Prototype Language Models

arXiv.org Machine Learning

Knowing which training examples drive outputs is fundamental to auditing, correcting, and understanding language models, yet for modern LLMs this remains expensive, approximate, and largely post-hoc. Standard language models generate tokens through a dense network pathway, causing training data's influence to be distributed across parameters rather than organized along explicit, traceable components. We introduce a prototype language model architecture, Prototypes for Interpretable Sequence Modeling (PRISM), that forms each prediction via a sparse, non-negative mixture of learned prototypes, trained with clustering objectives that anchor each prototype to coherent neighborhoods of training examples. Across architectures from 130M to 1.6B parameters trained on up to 50B tokens, prototype language models either surpass or remain within 2.5 percentage points on average downstream accuracy of matched dense baselines. We show that sparse prototype structure localizes curvature in the loss landscape, yielding a more tractable Hessian and enabling training data attribution that is ~500x faster than post hoc baselines when consuming equivalent memory. Calibrating linear prototype controllers can improve downstream accuracy by roughly 3 points while tracing those corrections back to training neighborhoods, and targeted prototype suppression can remove model behaviors without finetuning or measurable loss in generation quality.


Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers

arXiv.org Machine Learning

Safety classifiers deployed in production operate under a stationarity assumption that fails silently: when input distributions drift, accuracy degrades with no error signal until ground-truth labels arrive. We present an online monitor that detects distributional shift in classifier scores via a sliding-window KS statistic with empirically calibrated alarm thresholds. In a pre-registered factorial evaluation (4 classifiers $\times$ 5 shift conditions $\times$ 20 seeds $\times$ 2 window sizes; 800 cells), the monitor achieves 86.6% valid detection (mean latency 39.5 steps) across synthetic-onset, real-jailbreak, and adversarial regimes; a classifier $\times$ shift interaction ($ฮท^2 = 0.185$) shows that monitoring must be tuned per classifier. Attempting to recover post-detection coverage via weighted conformal prediction exposes a failure mode: density-ratio estimation collapses for generative classifiers because logistic regression separates source from target perfectly in 3584-4096-dimensional embedding space, clipping all importance weights to zero; projecting to $\leq 32$ dimensions restores coverage. We then extend the framework to gradient-based evasion and give the first threat-model characterisation of score-disagreement monitoring as a canary. We falsify three assumptions: that architectural diversity drives the signal (false, $ฮท^2 = 0.011$), that it is generic out-of-distribution detection (false, GCG-specific, $p < 10^{-12}$), and that an adaptive attacker can suppress it (false while the canary is confident). We derive the exact security boundary, a confidence-gated equilibrium at which a monitor-aware attacker stalls at gap $= 1/(2ฮป)$, and provide a calibration-free scan martingale achieving false-alarm rate $\leq 1\%$ across all classifiers with no per-model tuning.


Accelerating Conformal Prediction via Approximate Leave-One-Out

arXiv.org Machine Learning

While conformal prediction provides a general framework for uncertainty quantification in predictive inference, its application is often limited by computational cost. Recent methods, including Jackknife+ and Jackknife-minmax, achieve faster computation by trading a slight loss of efficiency relative to full conformal prediction, but still requires computing leave-one-out refits for all observations. In this paper, we further accelerate conformal prediction by incorporating approximate leave-one-out (ALO) estimators, and establish asymptotic coverage and efficiency. While our proof draws on methods developed for analyzing the consistency of ALO cross-validation risk estimators in high-dimensional statistics, it requires adaptations to handle conformal prediction, where leave-$i$-out residuals are needed for predictions at $x_{n+1}$ rather than just at the training covariate $x_i$. Simulation results validate our theoretical findings, showing that the ALO-based methods achieve coverage and efficiency comparable to the exact methods, while significantly reducing the runtime.


On Optimal Data Splitting for Split Conformal Prediction

arXiv.org Machine Learning

Conformal prediction and its variants, including the split conformal prediction, provide a distribution-free framework for uncertainty quantification by constructing prediction intervals or sets with finite-sample coverage guarantees. The statistical efficiency of these intervals depends critically on how the data are split into training and calibration samples. Despite its practical importance, a principled characterization of the training-calibration split that minimizes prediction interval length while maintaining coverage has remained largely unresolved. In this paper, we develop a theoretical framework for optimal data splitting in split conformal prediction. We first analyze the problem in a general setting and derive analytical characterizations of the length-optimal split ratio under both symmetric and asymmetric regimes. We then show how the general results specialize to several commonly used regression settings, including linear regression, nonparametric regression, and neural networks, thereby demonstrating the scope of the framework. We also describe a data-based method for selecting the optimal proportion. Our analysis clarifies how model-related features govern the optimal allocation of samples between training and calibration and provides principled guidance for constructing shorter prediction intervals. Experiments on both synthetic and real-world datasets demonstrate the applicability of the proposed methodology across a variety of practical scenarios.


Conformal Prediction with Macro-Coverage Guarantees

arXiv.org Machine Learning

Prediction sets should have high coverage to be useful, but some coverage notions are more practically relevant than others. In the classification setting, class-conditional coverage requires that the prediction set (i.e., the set of candidate labels for a new test point) must achieve the target accuracy level within each class, which may be challenging to satisfy when many classes are rare and have few calibration points. At the other extreme, marginal coverage requires only that coverage holds on average over the distribution of all classes, which can lead to low-probability labels being essentially ignored. To find a middle ground, recent work has introduced macro-coverage, defined as the unweighted average of class-conditional coverages. Macro-coverage offers a compromise between marginal coverage and class-conditional coverage that is particularly appropriate for long-tailed settings. In this work, we show that label-weighted conformal prediction can be used to produce prediction sets with a finite-sample macro-coverage guarantee, and more generally a guarantee on a family of generalized macro-coverage objectives that aggregate coverage at the level of arbitrary class groupings and take a weighted average. We further characterize the form of the smallest prediction sets satisfying a given generalized macro-coverage objective and propose a corresponding conformal score function. We validate our theoretical results on two large-scale image classification datasets.