ARelated Work1 Data Attribution Evaluation: Given recent developments in data attribution methods for LLMs,2 past works in evaluating these methods fall two major categories: leave-out-out and task-based3 evaluation. Leave-one-out evaluation measures the correlation between the data attribution method4 scores and model-retraining, which can also be approximated using linear datamodeling score [26].5 In task-based evaluation, the data attribution method is evaluated based on its application towards6 downstream task, such as noisy label detection, counterfactual evaluation [3, 13].7 Training Data Selection: Selecting high-quality training data selection is important for efficient8 learning in LLMs. Common approaches to data selection relies on heuristic filtering, such as de-9 duplication and lexicon-filtering, [34], or semantic rating [48, 52]. Recent works have applied data10 attribution methods towards data selection in LLMs in both pre-training [56, 59, 15] and post-training11 [45, 53, 31]. These data attribution methods are dynamic and model-aware - increasing the frequency12 of performing selection is one way to take greater account for group influence, where online selection13 at each training step is most fine-grained [49].14 Toxicity/Bias Detection: Detecting and mitigating toxic/biased LLMs outputs is a crucial for safe15 deployment in real-word settings. Existing methods for detecting toxicity/bias in LLMs commonly16 include online API tools 1 [37] or LLM-classifiers [58, 21, 16, 27]. Factual Attribution: Identifying training examples which causes LLMs to generate specific factual20 statements is an important application of data attribution as AI tools are becoming increasingly21 common. Apart from baseline retrieval methods that leverage lexical/semantic similarity like BM2522 [48], Rep Sim [44] and Gecko [33], recent works have explored the use of data attribution in tracing23 factual knowledge in both pre-training[6] and post-training [42, 2].24 We provide below descriptions to the data attribution methods and non-attribution baselines evaluated26 in this work. Note that in our work, we consider non-attribution baselines as methods that do not27 estimate the impact of training samples on models, as detailed in [19].28 Rep-Sim [44]: (Non-attribution baseline) Rep-Sim computes the cosine similarity between last29 token last layer hidden states of training and reference examples. It is more efficient compared with30 gradient-based data attribution methods. BM25 [48]: (Non-attribution baseline) BM25 is a classic information retrieval algorithm that ranks33 training samples by lexical overlap with the query. It is significantly more efficient compared with34 gradient-based data attribution methods.35

Data attribution methods quantify the influence of training data on model outputs and are becoming increasingly relevant for a wide range of LLM research and applications, including dataset curation, model interpretability, data valuation. However, there remain critical gaps in systematic LLM-centric evaluation of data attribution methods. To this end, we introduce DATE-LM (Data Attribution Evaluation in Language Models), a unified benchmark for evaluating data attribution methods through real-world LLM applications.

Recommender systems are among the most impactful AI applications, interacting with billions of users every day, guiding them to relevant products, services, or information tailored to their preferences. However, the research and development of recommender systems are hindered by existing datasets that fail to capture realistic user behaviors and inconsistent evaluation settings that lead to ambiguous conclusions. This paper introduces the Open Recommendation Benchmark for Reproducible Research with HIdden Tests (ORBIT), a unified benchmark for consistent and realistic evaluation of recommendation models. ORBIT offers a standardized evaluation framework of public datasets with reproducible splits and transparent settings for its public leaderboard. Additionally, ORBIT introduces a new webpage recommendation task, ClueWeb-Reco, featuring web browsing sequences from 87 million public, high-quality webpages. ClueWeb-Reco is a synthetic dataset derived from real, user-consented, and privacy-guaranteed browsing data.

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While several Dropout-style algorithms, such as DropEdge and DropMessage, have successfully addressed over-smoothing, their impact on oversquashing remains largely unexplored. This represents a critical gap in the literature, as failure to mitigate over-squashing would make these methods unsuitable for long-range tasks - the intended use case of deep MPNNs. In this work, we study the aforementioned algorithms, and closely related edge-dropping algorithms - DropNode, DropAgg and DropGNN - in the context of over-squashing.

Multimodal large language models have unlocked new possibilities for various multimodal tasks. However, their potential in image manipulation detection remains unexplored. When directly applied to the IMD task, M-LLMs often produce reasoning texts that suffer from hallucinations and overthinking. To address this, we propose ForgerySleuth, which leverages M-LLMs to perform comprehensive clue fusion and generate segmentation outputs indicating specific regions that are tampered with. Moreover, we construct the ForgeryAnalysis dataset through the Chain-of-Clues prompt, which includes analysis and reasoning text to upgrade the image manipulation detection task. A data engine is also introduced to build a largerscale dataset for the pre-training phase. Our extensive experiments demonstrate the effectiveness of ForgeryAnalysis and show that ForgerySleuth significantly outperforms existing methods in generalization, robustness, and explainability.

Morphing is a long-standing problem in vision and computer graphics, requiring a time-dependent warping for feature alignment and a blending for smooth interpolation. Recently, multilayer perceptrons (MLPs) have been explored as implicit neural representations (INRs) for modeling such deformations, due to their meshlessness and differentiability; however, extracting coherent and accurate morphings from standard MLPs typically relies on costly regularizations, which often lead to unstable training and prevent effective feature alignment. To overcome these limitations, we propose FLOWING (FLOW morphING), a framework that recasts warping as the construction of a differential vector flow, naturally ensuring continuity, invertibility, and temporal coherence by encoding structural flow properties directly into the network architectures.

Discrete diffusion models have recently gained significant attention due to their ability to process complex discrete structures for language modeling. However, fine-tuning these models with policy gradient methods, as is commonly done in Reinforcement Learning from Human Feedback (RLHF), remains a challenging task. We propose an efficient, broadly applicable, and theoretically justified policy gradient algorithm, called Score Entropy Policy Optimization (SEPO), for finetuning discrete diffusion models over non-differentiable rewards. Our numerical experiments across several discrete generative tasks demonstrate the scalability and efficiency of our method. Our code is available at https://github.com/ozekri/SEPO.

We study one of the most popular problems in neurosymbolic learning (NSL), that of learning neural classifiers given only the result of applying a symbolic component σ to the gold labels of the elements of a vector x. The gold labels of the elements in x are unknown to the learner. We make multiple contributions, theoretical and practical, to address a problem that has not been studied so far in this context, that of characterizing and mitigating learning imbalances, i.e., major differences in the errors that occur when classifying instances of different classes (aka class-specific risks). Our theoretical reveals a unique phenomenon: that σ can greatly impact learning imbalances. This result sharply contrasts with previous research on supervised and weakly supervised learning, which only studies learning imbalances under data imbalances. On the practical side, we introduce a technique for estimating the marginal of the hidden gold labels using weakly supervised data. Then, we introduce algorithms that mitigate imbalances at training and testing time by treating the marginal of the hidden labels as a constraint. We demonstrate the effectiveness of our techniques using strong baselines from NSL and long-tailed learning, suggesting performance improvements of up to 14%.

We propose VASA-3D, an audio-driven, single-shot 3D head avatar generator. This research tackles two major challenges: capturing the subtle expression details present in real human faces, and reconstructing an intricate 3D head avatar from a single portrait image. To accurately model expression details, VASA-3D leverages the motion latent of VASA-1 [1], a method that yields exceptional realism and vividness in 2D talking heads. A critical element of our work is translating this motion latent to 3D, which is accomplished by devising a 3D head model that is conditioned on the motion latent. Customization of this model to a single image is achieved through an optimization framework that employs numerous video frames of the reference head synthesized from the input image. The optimization takes various training losses robust to artifacts and limited pose coverage in the generated training data. Our experiment shows that VASA-3D produces realistic 3D talking heads that cannot be achieved by prior art, and it supports the online generation of 512 512 free-viewpoint videos at up to 75 FPS, facilitating more immersive engagements with lifelike 3D avatars.

TIME announced a partnership with Chris & Ally Corp., a Korean media company, to launch TIME Korea. Notably, Chris & Ally Corp. becomes TIME’s first licensing partner in Asia, marking a significant milestone for the brand’s regional expansion.