Beyond task diversity: provable representation transfer for sequential multitask linear bandits
–Neural Information Processing Systems
We study lifelong learning in linear bandits, where a learner interacts with a sequence of linear bandit tasks whose parameters lie in an m -dimensional subspace of \mathbb{R} d, thereby sharing a low-rank representation. Current literature typically assumes that the tasks are diverse, i.e., their parameters uniformly span the m -dimensional subspace. This assumption allows the low-rank representation to be learned before all tasks are revealed, which can be unrealistic in real-world applications. In this work, we present the first nontrivial result for sequential multi-task linear bandits without the task diversity assumption. We develop an algorithm that efficiently learns and transfers low-rank representations.
Neural Information Processing Systems
May-26-2025, 22:49:38 GMT
- Technology: