TaskMet: Task-Driven Metric Learning for Model Learning