Robust and Resource-efficient Machine Learning Aided Viewport Prediction in Virtual Reality