Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexity