Deep Learning
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm
Pruning techniques have been successfully used in neural networks to trade accuracy for sparsity. However, the impact of network pruning is not uniform: prior work has shown that the recall for underrepresented classes in a dataset may be more negatively affected. In this work, we study such relative distortions in recall by hypothesizing an intensification effect that is inherent to the model. Namely, that pruning makes recall relatively worse for a class with recall below accuracy and, conversely, that it makes recall relatively better for a class with recall above accuracy. In addition, we propose a new pruning algorithm aimed at attenuating such effect. Through statistical analysis, we have observed that intensification is less severe with our algorithm but nevertheless more pronounced with relatively more difficult tasks, less complex models, and higher pruning ratios. More surprisingly, we conversely observe a de-intensification effect with lower pruning ratios, which indicates that moderate pruning may have a corrective effect to such distortions.
Predict, Refine, Synthesize: Self-Guiding Diffusion Models for Probabilistic Time Series Forecasting
Diffusion models have achieved state-of-the-art performance in generative modeling tasks across various domains. Prior works on time series diffusion models have primarily focused on developing conditional models tailored to specific forecasting or imputation tasks. In this work, we explore the potential of taskagnostic, unconditional diffusion models for several time series applications. We propose TSDiff, an unconditionally-trained diffusion model for time series. Our proposed self-guidance mechanism enables conditioning TSDiff for downstream tasks during inference, without requiring auxiliary networks or altering the training procedure. We demonstrate the effectiveness of our method on three different time series tasks: forecasting, refinement, and synthetic data generation. First, we show that TSDiff is competitive with several task-specific conditional forecasting methods (predict). Second, we leverage the learned implicit probability density of TSDiff to iteratively refine the predictions of base forecasters with reduced computational overhead over reverse diffusion (refine). Notably, the generative performance of the model remains intact -- downstream forecasters trained on synthetic samples from TSDiff outperform forecasters that are trained on samples from other state-of-the-art generative time series models, occasionally even outperforming models trained on real data (synthesize).
Elon Musk Boosts New Yorker's Sam Altman Exposรฉ on X as Trial Begins
Elon Musk Boosts New Yorker's Sam Altman Exposรฉ on X as Trial Begins The move comes as the trial for Elon Musk's lawsuit against OpenAI kicks off in federal court in Oakland. Elon Musk is boosting a post on X promoting The New Yorker's extensive investigation into Sam Altman's allegedly deceptive behavior, WIRED has confirmed. The move comes just as Musk's lawsuit against OpenAI and Altman heads to a jury trial in a federal courtroom on Monday morning. People scrolling X on Monday reported seeing an April 6 post from Ronan Farrow, a coauthor on the New Yorker article, promoting the investigation. A pop-up on the post on X's mobile app says it was boosted by @elonmusk, who also owns the platform.
Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training
Normalization techniques have become a basic component in modern convolutional neural networks (ConvNets). In particular, many recent works demonstrate that promoting the orthogonality of the weights helps train deep models and improve robustness. For ConvNets, most existing methods are based on penalizing or normalizing weight matrices derived from concatenating or flattening the convolutional kernels. These methods often destroy or ignore the benign convolutional structure of the kernels; therefore, they are often expensive or impractical for deep ConvNets. In contrast, we introduce a simple and efficient "Convolutional Normalization" (ConvNorm) method that can fully exploit the convolutional structure in the Fourier domain and serve as a simple plug-and-play module to be conveniently incorporated into any ConvNets. Our method is inspired by recent work on preconditioning methods for convolutional sparse coding and can effectively promote each layer's channel-wise isometry. Furthermore, we show that our ConvNorm can reduce the layerwise spectral norm of the weight matrices and hence improve the Lipschitzness of the network, leading to easier training and improved robustness for deep ConvNets. Applied to classification under noise corruptions and generative adversarial network (GAN), we show that the ConvNorm improves the robustness of common ConvNets such as ResNet and the performance of GAN. We verify our findings via numerical experiments on CIFAR and ImageNet.
OpenAI's GPT-5.5 is faster, smarter, and a step toward its 'super app'
PCWorld reports that OpenAI has launched GPT-5.5, its most advanced AI model, exclusively for paying ChatGPT subscribers on Plus, Pro, Business, and Enterprise plans. The new model delivers faster, more efficient performance in coding, research, and math while outperforming competitors like Google's Gemini 3.1 Pro and Anthropic's Claude Opus 4.7. GPT-5.5 represents a significant step toward OpenAI's'super app' vision, integrating various AI services into one comprehensive platform. OpenAI recently launched GPT-5.5, which the company describes as its most advanced and intuitive AI model to date. The new model is said to be both faster and more efficient, with specific improvements in areas including coding, research, and math. At the same time, it's said to perform better compared to competing models like Google's Gemini 3.1 Pro and Anthropic's Claude Opus 4.7. According to OpenAI co-founder Greg Brockman, GPT-5.5 is also a step towards the company's vision of a future "super app," where services such as ChatGPT, Codex, and an AI-driven web browser are integrated into a single platform, reports TechCrunch . GPT-5.5 is currently rolling out to paying ChatGPT users, which includes those on Plus, Pro, Business, and Enterprise plans. This article originally appeared on our sister publication PC fรถr Alla and was translated and localized from Swedish.
OpenAI breaks out of exclusivity agreements in its partnership with Microsoft
The two companies announced an amended partnership that lets OpenAI use other cloud platforms and offer its models to other companies. OpenAI is opening up its partnership with Microsoft in the latest amendment to the major multi-year collaboration between the tech giants. The latest changes allow OpenAI to offer its latest AI models to other companies and through other cloud providers, stripping Microsoft of its exclusivity rights. In a joint announcement posted on OpenAI and Microsoft's websites, Microsoft will still be OpenAI's primary cloud partner with the latest products shipping first on Azure, but OpenAI is now allowed to use any cloud provider. Sam Altman, OpenAI's CEO, posted on X that the company is now able to make our products and services available across all clouds.
Supplementary Materials
We provide the supplements of "Contextual Gaussian Process Bandits with Neural Networks" here. Specifically, we discuss alternative acquisition functions that can be incorporated with the neural network-accompanied Gaussian process (NN-AGP) model in Section 6. In Section 7, we discuss the bandit algorithm with NN-AGP, where the neural network approximation error is considered. In Section 8, we provide the detailed proof of theorems. We provide the experimental details and include additional numerical experiments in Section 9. Last we discuss the limitations of NN-AGP and propose the potential approaches to addressing the limitations for future work, including sparse NN-AGP for alleviating computational burdens and transfer learning with NN-AGP to address cold-start issue; see Section 10. In the main text, we employ the upper confidence bound function as the acquisition function in the contextual Bayesian optimization approach. Here, we provide two alternative choices: Thompson sampling (TS) and knowledge gradient (KG). We describe the two procedures of the contextual GP bandit problems with NN-AGP, where the acquisition function is replaced by TS or KG. It chooses the action that maximizes the expected reward with respect to a random belief that is drawn for a posterior distribution. Besides the multi-armed bandit problems, TS has also achieved both theoretical and practical success in BO and Gaussian process regression. For more detailed discussions on TS, we refer to [87, 88]. Specifically, we propose a neural network-accompanied Gaussian process Thompson sampling (NNAGP-TS) approach to address contextual GP bandits. The approach works as follows. In each iteration, NN-AGP-TS first fits an NN-AGP model with the historic data. Then, given the current contextual variable, a realization of the Gaussian process with respect to x X is sampled from the posterior distribution conditional on the historic data1.