FRACTAL: Fine-Grained Scoring from Aggregate Text Labels