Mean estimation and regression under heavy-tailed distributions--a survey

Arguably the most fundamental problem of statistics is that of estimating the expected value µ of a random variable X based on a sample of n independent, identically distributed draws from the distribution of X. The obvious choice of an estimator is, of course, the empirical mean. Its properties are well understood by classical results of probability theory. However, from the early days on, statisticians have been concerned about the quality of the empirical mean, especially when the distribution may be heavy-tailed or outliers may be present in the data. This concern gave rise to the area of robust statistics that addresses the problem of mean estimation (and other statistical problems) for such data.