Deep Learning
ConquerNet: Convolution-Smoothed Quantile ReLU Neural Networks with Minimax Guarantees
Luo, Tianpai, Wu, Fangwei, Wu, Weichi
Quantile regression is a fundamental tool for distributional learning but poses significant optimization challenges for deep models due to the non-smoothness of the pinball loss. We propose ConquerNet, a class of \textbf{con}volution-smoothed \textbf{qu}antil\textbf{e} \textbf{R}eLU neural \textbf{net}works, which yield smooth objectives while preserving the underlying quantile structure. We establish general nonasymptotic risk bounds for ConquerNet under mild conditions, providing minimax guarantees over Besov function classes. In numerical studies, we demonstrate that the proposed approach outperforms standard quantile neural networks at multiple quantile levels, showing improved estimation accuracy and training efficiency across the board, with particularly pronounced advantages at high and low quantiles.
Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance
When modeling class-imbalanced data, it is crucial to address the imbalance, as models trained on such data tend to be biased towards the majority classes. This problem is amplified under partial supervision, where pseudo-labels for unlabeled data are predicted based on imbalanced labeled data, propagating the bias. While recent semi-supervised models address class imbalance, they typically assume single-modal input data. However, with the growing availability of multimodal data, it is essential to leverage complementary modalities. In this article, we propose a multimodal deep generative model for semi-supervised learning under class imbalance. Our approach uses separate encoders for each modality, sharing latent variables across modalities, and simplifies joint posterior computation with a product-of-experts method. To further address class imbalance, we replace typical Gaussian distributions with Student's t-distributions for the prior, encoder, and decoder, better capturing the heavy-tailed latent distributions in imbalanced data. We derive a new objective function for training the proposed model on both labeled and unlabeled data using $γ$-power divergence. Empirical results on benchmark and real-world datasets demonstrate that our model outperforms baseline methods in generalization, achieving superior classification performance for partially labeled multimodal data with imbalanced class distributions.
Attributions All the Way Down? The Metagame of Interpretability
Baniecki, Hubert, Biecek, Przemyslaw, Fumagalli, Fabian
We introduce the metagame, a conceptual framework for quantifying second-order interaction effects of model explanations. For any first-order attribution $ϕ(f)$ explaining a model $f$, we measure the directional influence of feature $j$ on the attribution of feature $i$, denoted as meta-attribution $φ_{j \to i}(f)$, by treating the attribution method itself as a cooperative game and computing its Shapley value. Theoretically, we prove that attributions hierarchically decompose into meta-attributions, and establish these as directional extensions of existing interaction indices. Empirically, we demonstrate that the metagame delivers insights across diverse interpretability applications: (i) quantifying token interactions in instruction-tuned language models, (ii) explaining cross-modal similarity in vision-language encoders, and (iii) interpreting text-to-image concepts in multimodal diffusion transformers.
End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems
Balsells-Rodas, Carles, Xiang, Zhengrui, Sumba, Xavier, Li, Yingzhen
Learning identifiable representations in deep generative models remains a fundamental challenge, particularly for sequential data with regime-switching dynamics. Existing approaches establish identifiability under restrictive assumptions, such as stationarity or limited emission models, and typically rely on variational autoencoder (VAE) estimators, which introduce approximation gaps that limit the recovery of the latent structure. In this work, we address both the theoretical and practical limitations of this setting. First, we establish identifiability of a broad class of recurrent nonlinear switching dynamical systems under flexible assumptions, significantly extending prior results. Second, we introduce $Ω$SDS, a flow-based estimator that enables exact likelihood optimization using expectation-maximisation. Through empirical validation on both synthetic and real-world data, our results demonstrate that $Ω$SDS achieves improved disentanglement compared to VAE-based estimators and more accurate forecasting of underlying dynamics.
Neural-Actuarial Longevity Forecasting: Anchoring LSTMs for Explainable Risk Management
Traditional multi-population models, such as the Li-Lee framework, rely on the assumption of mean-reverting country-specific deviations. However, recent data from high-longevity clusters suggest a systemic break in this paradigm. We identify a stationarity paradox where mortality residuals in countries like Sweden and West Germany exhibit persistent unit roots, leading to a systematic mispricing of longevity risk in linear models. To address these non-linearities, we propose Hybrid-Lift, a neural-actuarial framework that combines Hierarchical LSTM networks with a Mean-Bias Correction (MBC) anchoring mechanism. Positioned as a governance-friendly model challenger rather than a replacement of classical approaches, the framework exhibits selective superiority on out-of-sample validation (2012-2020): it outperforms Li-Lee by 17.40% in Sweden and 12.57% in West Germany, while remaining comparable for near-linear regimes such as Switzerland and Japan. We complement the predictive model with an integrated governance suite comprising SHAP-based cross-country influence mapping, a dual uncertainty framework for regulatory capital calibration (Swiss ES 99.0% of +1.153 years), and a reverse stress test identifying the critical shock threshold for solvency buffer exhaustion. This research provides evidence that neural networks, when properly anchored by actuarial principles, can serve as effective model challengers for longevity risk management under the SST and Solvency II standards.
The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity
Li, Siquan, Jiang, Kaiqi, Sun, Jiacheng, Hu, Tianyang
Despite the prevalence of the attention sink phenomenon in Large Language Models (LLMs), where initial tokens disproportionately monopolize attention scores, its structural origins remain elusive. This work provides a \textit{mechanistic explanation} for this phenomenon. First, we trace its root to the value aggregation process inherent in self-attention, which induces a systematic variance discrepancy. We further demonstrate that this discrepancy is drastically amplified by the activation of super neurons within Feed-Forward Network (FFN) layers. Specifically, the channel-sparse down-projections trigger a dimension disparity of the first-token representation, necessitating the formation of attention sinks as a structural anchor. Then, we validate this causal chain through two controlled interventions: (i) isolating the aggregation effect via attention mask modifications and (ii) amplifying the variance of targeted token representations. Both interventions can replicate attention sinks at arbitrary positions. Our mechanistic understanding offers a foundation for the systematic control of sink formation. Finally, as a proof of concept, we propose \textit{head-wise RMSNorm}, an architectural modification that stabilizes value aggregation outputs during pre-training. Our experiments demonstrate that restoring statistical parity across positions significantly accelerates convergence.
OpenAI debuts a Codex plugin for Chrome
We're seeing coding be one of the leading applications of artificial intelligence tools, and OpenAI is continuing to expand on its offerings in that space. The company has launched a Chrome extension for its Codex platform. The new browser-based capabilities of the plugin include testing web apps, collecting context from across open tabs and using Chrome DevTools in parallel while the user performs other tasks. This extension could also help Codex be more appealing to casual users and additional professions beyond developers since so many computing tasks happen in browsers. Codex can now take on more of your browser dev work.
Perplexity opens up its Personal Computer AI assistant to all Mac users
Last month, Perplexity sought to better compete with the likes of Claude Cowork and get out ahead of Apple's delayed, generative AI-powered version of Siri by bringing Personal Computer to macOS . The AI assistant was previously only available to those on Perplexity's $200 per month Max plan, but now the company has opened it up to all Mac users. The company says everyone can download the new Perplexity macOS app and use Personal Computer for everyday queries, attachments and dictation. Usage is tied to Pro and Max plans' credit limits, Perplexity noted. Personal Computer can run tasks across local files, other apps, the web and Perplexity's own servers, according to the company.
ChatGPT Has 'Goblin' Mania in the US. In China It Will 'Catch You Steadily'
OpenAI's chatbot has some weird linguistic tics in Chinese that are driving users crazy. Are you even online in 2026 if you haven't experienced the verbal tics of ChatGPT? It loves goblins, em dashes, and "it's not A; it's B" sentence constructions. But what you might not know is that the chatbot also has plenty of strange phrases it loves to say in Chinese, and they are driving Chinese users crazy. ChatGPT does a decent job answering questions in Chinese, which is why it's widely used in China despite being blocked by the government.
This 'anti-goal' prompt trick keeps ChatGPT from going rogue
When you purchase through links in our articles, we may earn a small commission. This'anti-goal' prompt trick keeps ChatGPT from going rogue A simple prompt structure using XML tags can stop ChatGPT, Claude, and Gemini from doing things you never asked for. All too often, ChatGPT, Claude, and Gemini overstep their instructions because they're so focused on making you happy. For example, an AI may jump ahead and completely rewrite a document when all you wanted was some focused feedback, or it may draft a brand-new recipe when you just wanted help substituting an ingredient. You might think the solution is to tell the AI chatbot what it do in your prompt.