Towards Robust Human Activity Recognition from RGB Video Stream with Limited Labeled Data