Goto

Collaborating Authors

 Deep Learning


42a6845a557bef704ad8ac9cb4461d43-AuthorFeedback.pdf

Neural Information Processing Systems

We thank the reviewers for thoughtful reviews and appreciation of our work. We expanded the "Related work" section We added more experimental details to the main text. We updated our results on Physionet and Human Activity to include error bars, shown in the tables below. ODE and latent landscape to be sufficiently smooth. We added the hyperparameter ranges used.





Towards More Practical Adversarial Attacks on Graph Neural Networks

Neural Information Processing Systems

We demonstrate that the structural inductive biases of GNN models can be an effective source for this type of attacks. Specifically, by exploiting the connection between the backward propagation of GNNs and random walks, we show that the common gradient-based white-box attacks can be generalized to the black-box setting via the connection between the gradient and an importance score similar to PageRank.


Learning Representations from Audio-Visual Spatial Alignment Pedro Morgado Yi Li

Neural Information Processing Systems

While these approaches learn high-quality representations for downstream tasks such as action recognition, their training objectives disregard spatial cues naturally occurring in audio and visual signals.


Rectified Factor Networks

Neural Information Processing Systems

We propose rectified factor networks (RFNs) to efficiently construct very sparse, non-linear, high-dimensional representations of the input. RFN models identify rare and small events in the input, have a low interference between code units, have a small reconstruction error, and explain the data covariance structure. RFN learning is a generalized alternating minimization algorithm derived from the posterior regularization method which enforces non-negative and normalized posterior means.



Gradient Estimation Using Stochastic Computation Graphs

Neural Information Processing Systems

In a variety of problems originating in supervised, unsupervised, and reinforcement learning, the loss function is defined by an expectation over a collection of random variables, which might be part of a probabilistic model or the external world. Estimating the gradient of this loss function, using samples, lies at the core of gradient-based learning algorithms for these problems. We introduce the formalism of stochastic computation graphs --directed acyclic graphs that include both deterministic functions and conditional probability distributions--and describe how to easily and automatically derive an unbiased estimator of the loss function's gradient. The resulting algorithm for computing the gradient estimator is a simple modification of the standard backpropagation algorithm. The generic scheme we propose unifies estimators derived in variety of prior work, along with variance-reduction techniques therein. It could assist researchers in developing intricate models involving a combination of stochastic and deterministic operations, enabling, for example, attention, memory, and control actions.