"It's a Match!" -- A Benchmark of Task Affinity Scores for Joint Learning