Fine-grained Analysis and Faster Algorithms for Iteratively Solving Linear Systems