A numerical analysis approach to convex optimization

Series
ACO Student Seminar
Time
Friday, January 11, 2019 - 1:05pm for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Richard Peng – CS, Georgia Tech – rpeng@cc.gatech.eduhttps://www.cc.gatech.edu/~rpeng/
Organizer
He Guo
In current convex optimization literature, there are significant gaps between algorithms that produce high accuracy (1+1/poly(n))-approximate solutions vs. algorithms that produce O(1)-approximate solutions for symmetrized special cases. This gap is reflected in the differences between interior point methods vs. (accelerated) gradient descent for regression problems, and between exact vs. approximate undirected max-flow. In this talk, I will discuss generalizations of a fundamental building block in numerical analysis, preconditioned iterative methods, to convex functions that include p-norms. This leads to algorithms that converge to high accuracy solutions by crudely solving a sequence of symmetric residual problems. I will then briefly describe several recent and ongoing projects, including p-norm regression using m^{1/3} linear system solves, p-norm flow in undirected unweighted graphs in almost-linear time, and further improvements to the dependence on p in the runtime.