Task-Agnostic Machine Learning-Assisted Inference