Inferring Inference