Skip to yearly menu bar Skip to main content


Meta Learning in Bandits within shared affine Subspaces

Steven Bilaj · Sofien Dhouib · Setareh Maghsudi

MR1 & MR2 - Number 80
[ ]
Fri 3 May 8 a.m. PDT — 8:30 a.m. PDT


We study the problem of meta-learning several contextual stochastic bandits tasks by leveraging their concentration around a low dimensional affine subspace, which we learn via online principal component analysis to reduce the expected regret over the encountered bandits. We propose and theoretically analyze two strategies that solve the problem: One based on the principle of optimism in the face of uncertainty and the other via Thompson sampling. Our framework is generic and includes previously proposed approaches as special cases. Besides, the empirical results show that our methods significantly reduce the regret on several bandit tasks.

Live content is unavailable. Log in and register to view live content