GBA: AT uning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Models

Although synchronous AR training is designed to have higher training efficiency, asynchronous PS training would be a better choice for training speed when there are stragglers (slow workers) in the shared cluster, especially under limited computing resources.