An adaptive buddy check for observational quality control
Version of Record online: 19 DEC 2006
Copyright © 2001 John Wiley & Sons, Ltd
Quarterly Journal of the Royal Meteorological Society
Volume 127, Issue 577, pages 2451–2471, October 2001 Part A
How to Cite
Dee, D. P., Rukhovets, L., Todling, R., da Silva, A. M. and Larson, J. W. (2001), An adaptive buddy check for observational quality control. Q.J.R. Meteorol. Soc., 127: 2451–2471. doi: 10.1002/qj.49712757714
- Issue online: 19 DEC 2006
- Version of Record online: 19 DEC 2006
- Manuscript Revised: 31 MAR 2001
- Manuscript Received: 22 SEP 2000
- Adaptive tolerances;
- Data assimilation;
- Quality control
An adaptive buddy-check algorithm is presented that adjusts tolerances for suspect observations, based on the variability of surrounding data. The algorithm derives from a statistical hypothesis test combined with maximum-likelihood covariance estimation. Its stability is shown to depend on the initial identification of outliers by a simple background check. The adaptive feature ensures that the final quality-control decisions are not very sensitive to prescribed statistics of first-guess and observation errors, nor on other approximations introduced into the algorithm.
The implementation of the algorithm in a global atmospheric data assimilation is described. Its performance is contrasted with that of a non-adaptive buddy check, for the surface analysis of an extreme storm that took place over Europe on 27 December 1999. The adaptive algorithm allowed the inclusion of many important observations that differed greatly from the first guess and that would have been excluded on the basis of prescribed statistics. The analysis of the storm development was much improved as a result of these additional observations.