Goto

Collaborating Authors

 Oceania




Ratio Trace Formulation of Wasserstein Discriminant Analysis

Neural Information Processing Systems

We reformulate the Wasserstein Discriminant Analysis (WDA) as a ratio trace problem and present an eigensolver-based algorithm to compute the discriminative subspace of WDA. This new formulation, along with the proposed algorithm, can be served as an efficient and more stable alternative to the original trace ratio formulation and its gradient-based algorithm. We provide a rigorous convergence analysis for the proposed algorithm under the self-consistent field framework, which is crucial but missing in the literature. As an application, we combine WDA with low-dimensional clustering techniques, such as K-means, to perform subspace clustering. Numerical experiments on real datasets show promising results of the ratio trace formulation of WDA in both classification and clustering tasks.



Relative Flatness and Generalization

Neural Information Processing Systems

Flatness of the loss curve is conjectured to be connected to the generalization ability of machine learning models, in particular neural networks.