Statistical Learning
A Semi-Supervised Network Embedding Model for Protein Complexes Detection
Zhao, Wei (SIAT, Chinese Academy of Sciences) | Zhu, Jia (South China Normal University) | Yang, Min (SIAT, Chinese Academy of Sciences) | Xiao, Danyang (South China Normal University) | Fung, Gabriel Pui Cheong (The Chinese University of Hong Kong) | Chen, Xiaojun (Shenzhen University)
Protein complex is a group of associated polypeptide chains which plays essential roles in biological process. Given a graph representing protein-protein interactions (PPI) network, it is critical but non-trivial to detect protein complexes.In this paper, we propose a semi-supervised network embedding model by adopting graph convolutional networks to effectively detect densely connected subgraphs. We conduct extensive experiment on two popular PPI networks with various data sizes and densities. The experimental results show our approach achieves state-of-the-art performance.
Discriminative Semi-Supervised Feature Selection via Rescaled Least Squares Regression-Supplement
Yuan, Guowen (Shenzhen University) | Chen, Xiaojun (Shenzhen University) | Wang, Chen (Shenzhen University) | Nie, Feiping (Northwestern Polytechnical University) | Jing, Liping (Beijing Jiaotong University)
In this paper, we propose a Discriminative Semi-Supervised Feature Selection (DSSFS) method. In this method, a ε-dragging technique is introduced to the Rescaled Linear Square Regression in order to enlarge the distances between different classes. An iterative method is proposed to simultaneously learn the regression coefficients, ε-draggings matrix and predicting the unknown class labels. Experimental results show the superiority of DSSFS.
Fast Approximate Nearest Neighbor Search via k-Diverse Nearest Neighbor Graph
Xiao, Yan (University of Chinese Academy of Sciences;Â Institute of Computing Technology, Chinese Academy of Sciences ) | Guo, Jiafeng (University of Chinese Academy of Sciences;Â Institute of Computing Technology, Chinese Academy of Sciences ) | Lan, Yanyan (University of Chinese Academy of Sciences;Â Institute of Computing Technology, Chinese Academy of Sciences) | Xu, Jun (University of Chinese Academy of Sciences;Â Institute of Computing Technology, Chinese Academy of Sciences) | Cheng, Xueqi (University of Chinese Academy of Sciences;Â Institute of Computing Technology, Chinese Academy of Sciences)
Approximate nearest neighbor search is a fundamental problem and has been studied for a few decades. Recently graph-based indexing methods have demonstrated their great efficiency, whose main idea is to construct neighborhood graph offline and perform a greedy search starting from some sampled points of the graph online. Most existing graph-based methods focus on either the precise k-nearest neighbor (k-NN) graph which has good exploitation ability, or the diverse graph which has good exploration ability. In this paper, we propose the k-diverse nearest neighbor (k-DNN) graph, which balances the precision and diversity of the graph, leading to good exploitation and exploration abilities simultaneously. We introduce an efficient indexing algorithm for the construction of the k-DNN graph inspired by a well-known diverse ranking algorithm in information retrieval (IR). Experimental results show that our method can outperform both state-of-the-art precise graph and diverse graph methods.
Deep Embedding for Determining the Number of Clusters
Wang, Yiqi (National University of Defense Technology) | Shi, Zhan (University of Texas at Austin) | Guo, Xifeng (National University of Defense Technology) | Liu, Xinwang (National University of Defense Technology) | Zhu, En (National University of Defense Technology) | Yin, Jianping (Dongguan University of Technology)
Determining the number of clusters is important but challenging, especially for data of high dimension. In this paper, we propose Deep Embedding Determination (DED), a method that can solve jointly for the unknown number of clusters and feature extraction. DED first combines the virtues of the convolutional autoencoder and the t-SNE technique to extract low dimensional embedded features. Then it determines the number of clusters using an improved density-based clustering algorithm. Our experimental evaluation on image datasets shows significant improvement over state-of-the-art methods and robustness with respect to hyperparameter settings.
Efficient Support Vector Machine Training Algorithm on GPUs
Shi, Jiashuai (South China University of Technology) | Wen, Zeyi (National University of Singapore) | He, Bingsheng (National University of Singapore) | Chen, Jian (South China University of Technology)
Support Vector Machines (SVMs) are popular for many machine learning tasks. With rapid growth of dataset size, the high cost of training limits the wide use of SVMs. Several SVM implementations on GPUs have been proposed to accelerate SVMs. However, they support only classification (SVC) or regression (SVR). In this work, we propose a simple and effective SVM training algorithm on GPUs which can be used for SVC, SVR and one-class SVM. Initial experiments show that our implementation outperforms existing ones. We are in the process of encapsulating our algorithm into an easy-to-use library which has Python, R and MATLAB interfaces.
Deep Modeling of Social Relations for Recommendation
Fan, Wenqi (City University of Hong Kong) | Li, Qing (City University of Hong Kong) | Cheng, Min (City University of Hong Kong)
Social-based recommender systems have been recently proposed by incorporating social relations of users to alleviate sparsity issue of user-to-item rating data and to improve recommendation performance. Many of these social-based recommender systems linearly combine the multiplication of social features between users. However, these methods lack the ability to capture complex and intrinsic non-linear features from social relations. In this paper, we present a deep neural network based model to learn non-linear features of each user from social relations, and to integrate into probabilistic matrix factorization for rating prediction problem. Experiments demonstrate the advantages of the proposed method over state-of-the-art social-based recommender systems.
A Stratified Feature Ranking Method for Supervised Feature Selection
Chen, Renjie (South China University of Technology, Guangzhou) | Chen, Xiaojun (Shenzhen University, Shenzhen) | Yuan, Guowen (Shenzhen University, Shenzhen) | Sun, Wenya (Shenzhen University, Shenzhen) | Wu, Qingyao (South China University of Technology, Guangzhou)
Most feature selection methods usually select the highest rank features which may be highly correlated with each other. In this paper, we propose a Stratified Feature Ranking (SFR) method for supervised feature selection. In the new method, a Subspace Feature Clustering (SFC) is proposed to identify feature clusters, and a stratified feature ranking method is proposed to rank the features such that the high rank features are lowly correlated. Experimental results show the superiority of SFR.
Building More Explainable Artificial Intelligence With Argumentation
Zeng, Zhiwei (Nanyang Technological University) | Miao, Chunyan (Nanyang Technological University) | Leung, Cyril (The University of British Columbia) | Chin, Jing Jih (Institute of Geriatrics and Active Ageing, Tan Tock Seng Hospital)
Currently, much of machine learning is opaque, just like a "black box." However, in order for humans to understand, trust and effectively manage the emerging AI systems, an AI needs to be able to explain its decisions and conclusions. In this paper, I propose an argumentation-based approach to explainable AI, which has the potential to generate more comprehensive explanations than existing approaches.
Predictive Modeling of Learning Continuation in Preschool Education Using Temporal Patterns of Development Tests
Naito, Junpei (Kyoto University) | Baba, Yukino (Kyoto University) | Kashima, Hisashi (Kyoto University) | Takaki, Takenori (Shimane IT Open-Innovation Center) | Funo, Takuya (Shimane Industrial Promotion Foundation)
Learning analytics applies data analysis techniques to learning data in order to support students’ learning processes and to improve the quality of education. Despite the increasing attention to learning analytics for higher education, it has not been fully addressed in primary and preschool education. In this research, we apply learning analytics to preschool education to predict the continuation of learning of preschool children. Based on our hypothesis that temporal patterns in the assessment scores of development tests are effective features for prediction, we extract the temporal patterns using time-series clustering, and use them as the features of prediction models. The experimental results using a real preschool education dataset show that the use of the temporal patterns improves the predictive accuracy of future continuation of study.
Diagnosing University Student Subject Proficiency and Predicting Degree Completion in Vector Space
Luo, Yuetian (UW-Madison) | Pardos, Zachary A. (UC Berkeley)
We investigate the issues of undergraduate on-time graduation with respect to subject proficiencies through the lens of representation learning, training a student vector embeddings from a dataset of 8 years of course enrollments. We compare the per-semester student representations of a cohort of undergraduate Integrative Biology majors to those of graduated students in subject areas involved in their degree requirements. The result is an embedding rich in information about the relationships between majors and pathways taken by students which encoded enough information to improve prediction accuracy of on-time graduation to 95%, up from a baseline of 87.3%. Challenges to preparation of the data for student vectorization and sourcing of validation sets for optimization are discussed.