Personal Assistant Systems
A Gang of Adversarial Bandits
We consider running multiple instances of multi-armed bandit (MAB) problems in parallel. A main motivation for this study are online recommendation systems, in which each of N users is associated with a MAB problem and the goal is to exploit users' similarity in order to learn users' preferences to K items more efficiently. We consider the adversarial MAB setting, whereby an adversary is free to choose which user and which loss to present to the learner during the learning process. Users are in a social network and the learner is aided by a-priori knowledge of the strengths of the social links between all pairs of users. It is assumed that if the social link between two users is strong then they tend to share the same action. The regret is measured relative to an arbitrary function which maps users to actions. The smoothness of the function is captured by a resistance-based dispersion measure ฮจ.
Temporal Graph Benchmark for Machine Learning on Temporal Graphs Shenyang Huang 1,2, Jacob Danovitch 1,2 Matthias Fey
We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale, spanning years in duration, incorporate both node and edge-level prediction tasks and cover a diverse set of domains including social, trade, transaction, and transportation networks. For both tasks, we design evaluation protocols based on realistic use-cases. We extensively benchmark each dataset and find that the performance of common models can vary drastically across datasets. In addition, on dynamic node property prediction tasks, we show that simple methods often achieve superior performance compared to existing temporal graph models. We believe that these findings open up opportunities for future research on temporal graphs. Finally, TGB provides an automated machine learning pipeline for reproducible and accessible temporal graph research, including data loading, experiment setup and performance evaluation. TGB will be maintained and updated on a regular basis and welcomes community feedback. TGB datasets, data loaders, example codes, evaluation setup, and leaderboards are publicly available at https://tgb.complexdatalab.com/.
Trading Personalization for Accuracy: Data Debugging in Collaborative Filtering (Supplementary Material)
This document contains experimental details and additional experimental results for the paper "Trading Personalization for Accuracy: Data Debugging in Collaborative Filtering". In one run of the experiment, we randomly select 80% ratings for training and use the rest 20% for testing. The training data is further randomly split into four partitions, following the procedure of our proposed algorithm depicted in Fig.1. We then search them from {0.01, 0.05, 0.1, 0.5, 1} via cross-validation. We will show the experimental results later for different values of fold number.