RAPID: Enabling Fast Online Policy Learning in Dynamic Public Cloud Environments