Goto

Collaborating Authors

 Europe


Precisecharacterizationofthepriorpredictive distributionofdeepReLUnetworks

Neural Information Processing Systems

Whiletheoretical results havebeen obtained for their heavy-tailedness, the full characterization of the prior predictive distribution (i.e. its density, CDF andmoments), remained unknownpriortothiswork.









Supplementary material for: The balancing principle for parameter choice in distance-regularized domain adaptation

Neural Information Processing Systems

The main criterion used to define the balancing principle is as follows. Using the instantiation bound of the balancing principle in Eq. (1) further implies that null ε Figure 1 provides a helpful illustration for the last two steps. Our main theorem is stated as follows. Eq. (1) and the same monotonicity argument as used in the proof of Lemma 1, see also Figure 1. The average count of images of DomainNet in each class, and across all domains is approx.


Diffeomorphic interpolation for efficient persistence-based topological optimization

Neural Information Processing Systems

Topological Data Analysis (TDA) provides a pipeline to extract quantitative topological descriptors from structured objects. This enables the definition of topological loss functions, which assert to what extent a given object exhibits some topological properties. These losses can then be used to perform topological optimization via gradient descent routines. While theoretically sounded, topological optimization faces an important challenge: gradients tend to be extremely sparse, in the sense that the loss function typically depends on only very few coordinates of the input object, yielding dramatically slow optimization schemes in practice. Focusing on the central case of topological optimization for point clouds, we propose in this work to overcome this limitation using diffeomorphic interpolation, turning sparse gradients into smooth vector fields defined on the whole space, with quantifiable Lipschitz constants. In particular, we show that our approach combines efficiently with subsampling techniques routinely used in TDA, as the diffeomorphism derived from the gradient computed on a subsample can be used to update the coordinates of the full input object, allowing us to perform topological optimization on point clouds at an unprecedented scale. Finally, we also showcase the relevance of our approach for black-box autoencoder (AE) regularization, where we aim at enforcing topological priors on the latent spaces associated to fixed, pre-trained, black-box AE models, and where we show that learning a diffeomorphic flow can be done once and then re-applied to new data in linear time (while vanilla topological optimization has to be re-run from scratch). Moreover, reverting the flow allows us to generate data by sampling the topologically-optimized latent space directly, yielding better interpretability of the model.