Shen, Lu
GPU-accelerated Multi-relational Parallel Graph Retrieval for Web-scale Recommendations
Guo, Zhuoning, Chen, Guangxing, Gao, Qian, Liao, Xiaochao, Zheng, Jianjia, Shen, Lu, Liu, Hao
Web recommendations provide personalized items from massive catalogs for users, which rely heavily on retrieval stages to trade off the effectiveness and efficiency of selecting a small relevant set from billion-scale candidates in online digital platforms. As one of the largest Chinese search engine and news feed providers, Baidu resorts to Deep Neural Network (DNN) and graph-based Approximate Nearest Neighbor Search (ANNS) algorithms for accurate relevance estimation and efficient search for relevant items. However, current retrieval at Baidu fails in comprehensive user-item relational understanding due to dissected interaction modeling, and performs inefficiently in large-scale graph-based ANNS because of suboptimal traversal navigation and the GPU computational bottleneck under high concurrency. To this end, we propose a GPU-accelerated Multi-relational Parallel Graph Retrieval (GMP-GR) framework to achieve effective yet efficient retrieval in web-scale recommendations. First, we propose a multi-relational user-item relevance metric learning method that unifies diverse user behaviors through multi-objective optimization and employs a self-covariant loss to enhance pathfinding performance. Second, we develop a hierarchical parallel graph-based ANNS to boost graph retrieval throughput, which conducts breadth-depth-balanced searches on a large-scale item graph and cost-effectively handles irregular neural computation via adaptive aggregation on GPUs. In addition, we integrate system optimization strategies in the deployment of GMP-GR in Baidu. Extensive experiments demonstrate the superiority of GMP-GR in retrieval accuracy and efficiency. Deployed across more than twenty applications at Baidu, GMP-GR serves hundreds of millions of users with a throughput exceeding one hundred million requests per second.
Hibikino-Musashi@Home 2024 Team Description Paper
Isomoto, Kosei, Mizutani, Akinobu, Matsuzaki, Fumiya, Sato, Hikaru, Matsumoto, Ikuya, Yamao, Kosei, Kawabata, Takuya, Shiba, Tomoya, Yano, Yuga, Yokota, Atsuki, Kanaoka, Daiju, Yamaguchi, Hiromasa, Murai, Kazuya, Minje, Kim, Shen, Lu, Suzuka, Mayo, Anraku, Moeno, Yamaguchi, Naoki, Fujimatsu, Satsuki, Tokuno, Shoshi, Mizo, Tadataka, Fujino, Tomoaki, Nakadera, Yuuki, Shishido, Yuka, Nakaoka, Yusuke, Tanaka, Yuichiro, Morie, Takashi, Tamukoh, Hakaru
This paper provides an overview of the techniques employed by Hibikino-Musashi@Home, which intends to participate in the domestic standard platform league. The team has developed a dataset generator for training a robot vision system and an open-source development environment running on a Human Support Robot simulator. The large language model powered task planner selects appropriate primitive skills to perform the task requested by users. The team aims to design a home service robot that can assist humans in their homes and continuously attends competitions to evaluate and improve the developed system.
Hibikino-Musashi@Home 2023 Team Description Paper
Shiba, Tomoya, Mizutani, Akinobu, Yano, Yuga, Ono, Tomohiro, Tokuno, Shoshi, Kanaoka, Daiju, Fukuda, Yukiya, Amano, Hayato, Koresawa, Mayu, Sakai, Yoshifumi, Takemoto, Ryogo, Tamai, Katsunori, Nakahara, Kazuo, Hayashi, Hiroyuki, Fujimatsu, Satsuki, Mizoguchi, Yusuke, Anraku, Moeno, Suzuka, Mayo, Shen, Lu, Maeda, Kohei, Matsuzaki, Fumiya, Matsumoto, Ikuya, Murai, Kazuya, Isomoto, Kosei, Minje, Kim, Tanaka, Yuichiro, Morie, Takashi, Tamukoh, Hakaru
This paper describes an overview of the techniques of Hibikino-Musashi@Home, which intends to participate in the domestic standard platform league. The team has developed a dataset generator for the training of a robot vision system and an open-source development environment running on a human support robot simulator. The robot system comprises self-developed libraries including those for motion synthesis and open-source software works on the robot operating system. The team aims to realize a home service robot that assists humans in a home, and continuously attend the competition to evaluate the developed system. The brain-inspired artificial intelligence system is also proposed for service robots which are expected to work in a real home environment.