Automated Weather Sensor Quality Control

In this paper, we investigate the application of data mining to existing techniques for quality control/anomaly detection on weather sensor observations. Specifically we adapt the popular Barnes Spatial interpolation method to use time-series distance rather than spatial distance to develop an online algorithm that uses readings from similar stations based on current and historical observations for interpolation and we demonstrate that this new algorithm exhibits less model error than the Barnes Spatial interpolation-based method. We focus on interpolation, which is a basis for this popular quality control method and other related methods, and examine a dataset of over 233 million temperature observations from California and surrounding areas. Our approach shows improved performance as indicated by mean squared error reduced by approximately one half for predicted values versus reported values.