Toward Better Generalisation in Uncertainty Estimators: Leveraging Data-Agnostic Features