Active Assessment of Prediction Services as Accuracy Surface Over Attribute Combinations

Each attribute combination, called an'arm', is associated with a Beta density from which the service's accuracy is sampled. We expect the GP to smooth the parameters of the Beta density over related arms to mitigate sparsity.