Poster
Minimum Empirical Divergence for Sub-Gaussian Linear Bandits
Ngo Nguyen · Kwang-Sung Jun
[
Abstract
]
Abstract:
We propose a novel linear bandit algorithm called LinMED (Linear Minimum Empirical Divergence), which is a linear extension of the MED algorithm that was originally designed for multi-armed bandits.LinMED is a randomized algorithm that admits a closed-form computation of the arm sampling probabilities, unlike the popular randomized algorithm called linear Thompson sampling.Such a feature proves useful for off-policy evaluation where the unbiased evaluation requires accurately computing the sampling probability.We prove that LinMED enjoys a near-optimal regret bound of up to logarithmic factors where is the dimension and is the time horizon.We further show that LinMED enjoys a problem-dependent regret where is the smallest suboptimality gap.Our empirical study shows that LinMED has a competitive performance with the state-of-the-art algorithms.
Live content is unavailable. Log in and register to view live content