In this work, we propose a novel and surprisingly simple routing strategy called self-routing, where each capsule is routed independently by its subordinate routing network. Therefore, the agreement between capsules is not required anymore, but both poses and activations of upper-level capsules are obtained in a way similar to Mixture-of-Experts. Our experiments on CIFAR10, SVHN, and SmallNORB showthat the self-routing performs more robustly against white-box adversarial attacks and affine transformations, requiring less computation.

In this paper we consider the case of generativemodels. In particular,we investigate generativeadversarialnetworks (GANs) in the task of learning new categories in a sequential fashion.

With the disentangled representations, we synthesize the counterfactual unbiased training samples to further decorrelate causal and bias variables.

Since proxy invariance indiff approaches data.

This paper provides a unified view to explain different adversarial attacks and defensemethods,i.e.

In this paper, we present DSA, the first automated framework for discovering sparsity allocation schemes for layer-wise pruning in Large Language Models (LLMs). LLMs have become increasingly powerful, but their large parameter counts make them computationally expensive. Existing pruning methods for compressing LLMs primarily focus on evaluating redundancies and removing element-wise weights. However, these methods fail to allocate adaptive layerwise sparsities, leading to performance degradation in challenging tasks.

Graph embedding has been intensively studied recently, due to the advance of various neural networkmodels.

Program translation isanimportant tool tomigrate legacycode inone language into an ecosystem built in a different language. In this work, we are the first to employ deep neural networks toward tackling this problem.

Recent progress hasdemonstrated thatsuchmeta-learning methods may exceed scalable human-invented architectures on image classification tasks.

Neural Information Processing Systems http://nips.cc/