A Knowledge Engineer's Comparison of Three Evidence Aggregation Methods

The comparisons of uncertainty calculi from the last two Uncertainty Workshops have all used theoretical probabilistic accuracy as the sole metric. While mathematical correctness is important, there are other factors which should be considered when developing reasoning systems. These other factors include, among other things, the error in uncertainty measures obtainable for the problem and the effect of this error on the performance of the resulting system. There are some domains in which many of the interesting conditional probabilities can be objectively estimated. For example, census data allows various characterizations of individuals with a reasonable degree of confidence.