This paper introduces stochastic recurrent neural networks which glue a deterministic recurrent neural network and a state space model together to form a stochastic and sequential neural generative model. The clear separation of deterministic and stochastic layers allows a structured variational inference network to track the factorization of the model's posterior distribution. By retaining both the nonlinear recursive structure of a recurrent neural network and averaging over the uncertainty in a latent path, like a state space model, we improve the state of the art results on the Blizzard and TIMIT speech modeling data sets by a large margin, while achieving comparable performances to competing methods on polyphonic music modeling.

Neural Information Processing Systems http://nips.cc/

This paper introduces hyperspherical prototype networks, which unify classification and regression with prototypes on hyperspherical output spaces. For classification, a common approach is to define prototypes as the mean output vector over training examples per class. Here, we propose to use hyperspheres as output spaces, with class prototypes defined a priori with large margin separation. We position prototypes through data-independent optimization, with an extension to incorporate priors from class semantics. By doing so, we do not require any prototype updating, we can handle any training size, and the output dimensionality is no longer constrained to the number of classes. Furthermore, we generalize to regression, by optimizing outputs as an interpolation between two prototypes on the hypersphere. Since both tasks are now defined by the same loss function, they can be jointly trained for multi-task problems. Experimentally, we show the benefit of hyperspherical prototype networks for classification, regression, and their combination over other prototype methods, softmax cross-entropy, and mean squared error approaches.

Neural Information Processing Systems http://nips.cc/

Neural Information Processing Systems http://nips.cc/

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes the regret incurred by a sub-optimal selection of operations. Unlike previous search relaxations, that require hard pruning of architectures, our method is designed to dynamically wipe out inferior architectures and enhance superior ones. It achieves an optimal worst-case regret bound and suggests the use of multiple learning-rates, based on the amount of information carried by the backward gradients. Experiments show that our algorithm achieves a strong performance over several image classification datasets. Specifically, it obtains an error rate of 1.6% for CIFAR-10, 23.9% for ImageNet under mobile settings, and achieves state-of-the-art results on three additional datasets.

Yet another indie game is becoming a TV show, as an adaptation of is in the works. This is an action survival RPG that was released in 2025 and won British Game of the Year at the recent BAFTA Game Awards. That's fitting, because is an extremely British game. The Fallout-inspired game is set in the 1960s after a nuclear disaster leads to a quarantine zone being established in the Lake District in northern England. Your character wakes up in a bunker with no recollection of how they got there.

At WIRED Health, immunologist Daniel Davis detailed the ways in which new technologies are enabling a better understanding of the human immune system. The immune system operates at a scale scientists are only just beginning to be able to see. That new view could change how diseases like cancer are tackled. Speaking at WIRED Health on April 16, Daniel Davis, an immunologist at Imperial College London, detailed how researchers are using advanced microscopes to uncover previously invisible dynamics in the human immune system, showing that there are multiple processes happening on a "nanoscale" that was previously out of reach. That new view is already reshaping how immunity is understood.