Outlier Detection with Parametric and Non-Parametric methods

This is a guest repost by Jacob Joseph. An Outlier is an observation or point that is distant from other observations/points. But, how would you quantify the distance of an observation from other observations to qualify it as an outlier. Outliers are also referred to as observations whose probability to occur is low. But, again, what constitutes low??