Yaghoubi, Ehsan
Select High-Level Features: Efficient Experts from a Hierarchical Classification Network
Kelm, André, Hannemann, Niels, Heberle, Bruno, Schmidt, Lucas, Rolff, Tim, Wilms, Christian, Yaghoubi, Ehsan, Frintrop, Simone
This study introduces a novel expert generation method that dynamically reduces task and computational complexity without compromising predictive performance. It is based on a new hierarchical classification network topology that combines sequential processing of generic low-level features with parallelism and nesting of high-level features. This structure allows for the innovative extraction technique: the ability to select only high-level features of task-relevant categories. In certain cases, it is possible to skip almost all unneeded high-level features, which can significantly reduce the inference cost and is highly beneficial in resource-constrained conditions. We believe this method paves the way for future network designs that are lightweight and adaptable, making them suitable for a wide range of applications, from compact edge devices to large-scale clouds. In terms of dynamic inference our methodology can achieve an exclusion of up to 88.7\,\% of parameters and 73.4\,\% fewer giga-multiply accumulate (GMAC) operations, analysis against comparative baselines showing an average reduction of 47.6\,\% in parameters and 5.8\,\% in GMACs across the cases we evaluated.
Generative Adversarial Graph Convolutional Networks for Human Action Synthesis
Degardin, Bruno, Neves, João, Lopes, Vasco, Brito, João, Yaghoubi, Ehsan, Proença, Hugo
Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements of a specific action (action conditioning). In this paper, we propose Kinetic-GAN, a novel architecture that leverages the benefits of Generative Adversarial Networks and Graph Convolutional Networks to synthesise the kinetics of the human body. The proposed adversarial architecture can condition up to 120 different actions over local and global body movements while improving sample quality and diversity through latent space disentanglement and stochastic variations. Our experiments were carried out in three well-known datasets, where Kinetic-GAN notably surpasses the state-of-the-art methods in terms of distribution quality metrics while having the Figure 1: Synthetic set of actions generated by our graph ability to synthesise more than one order of magnitude regarding convolutional generator trained on NTU RGB D [32] (first the number of different actions.