Parsimonious Inference