We appreciate the positive feedbacks from all the reviewers and provide a detailed response as follows

We appreciate the positive feedbacks from all the reviewers and provide a detailed response as follows. R1: "Room for improvement in presenting numerical experiments ... it is better to include test error results" Our initial intention was to conduct experiments reflecting the convergence rate in the theoretical analysis. R1/R2: "It would be interesting to include results using a variance reduction technique" We thank both reviewers for mentioning variance reduction techniques, this is indeed very related. It is conceivable that there might exist a better design for finite sum structure, e.g., by communicating This is definitely an interesting direction which we leave to future work. R2: "I wonder whether the communication cost is lower than that of SSDA in practice. R2: "I wonder whether SSDA+AGD+warm start can achieve the same computation cost by using the proof IDEAL improves upon SSDA in a non-trivial way.