Skip to yearly menu bar Skip to main content


Poster

Near-Optimal Convex Simple Bilevel Optimization with a Bisection Method

Jiulin Wang · Xu Shi · Rujun Jiang

MR1 & MR2 - Number 179

Abstract: This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem.Existing methods either provide asymptotic guarantees for the upper-level objective or attain slow sublinear convergence rates.We propose a bisection algorithm to find a solution that is ϵfϵf-optimal for the upper-level objective and ϵgϵg-optimal for the lower-level objective.In each iteration, the binary search narrows the interval by assessing inequality system feasibility.Under mild conditions, the total operation complexity of our method is O(max{Lf1/ϵf,Lg1/ϵg})O(max{Lf1/ϵf,Lg1/ϵg}).Here, a unit operation can be a function evaluation, gradient evaluation, or the invocation of the proximal mapping, Lf1Lf1 and Lg1Lg1 are the Lipschitz constants of the upper- and lower-level objectives' smooth components, and OO hides logarithmic terms.Our approach achieves a near-optimal rate in unconstrained smooth or composite convex optimization when disregarding logarithmic terms.Numerical experiments demonstrate the effectiveness of our method.

Chat is not available.