Accessibility navigation


Sampling and misspecification errors in the estimation of observation-error covariance matrices using observation-minus-background and observation-minus-analysis statistics

Hu, G. ORCID: https://orcid.org/0000-0003-4305-3658 and Dance, S. L. ORCID: https://orcid.org/0000-0003-1690-3338 (2024) Sampling and misspecification errors in the estimation of observation-error covariance matrices using observation-minus-background and observation-minus-analysis statistics. Quarterly Journal of the Royal Meteorological Society. ISSN 1477-870X

[img]
Preview
Text (Open Access) - Published Version
· Available under License Creative Commons Attribution.
· Please see our End User Agreement before downloading.

3MB
[img] Text - Accepted Version
· Restricted to Repository staff only

765kB

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

To link to this item DOI: 10.1002/qj.4750

Abstract/Summary

Specification of the observation error covariance matrix for data assimilation systems affects the observation information content retained by the analysis, particularly for observations known to have correlated observation errors (e.g., geostationary satellite and Doppler radar data). A widely adopted approach for estimating observation error covariance matrices uses observation-minus-background and observation-minus-analysis residuals, which are routinely produced by most data assimilation systems. Although this approach is known to produce biased and noisy estimates due to sampling and misspecification errors, there has been no systematic study of sampling error with this approach to date. Furthermore, the eigenspectrum of the estimated observation error covariance matrix is known to influence the analysis information content and numerical convergence of variational assimilation schemes. In this work, we provide new theorems for the sampling error and eigenvalues of the estimated observation error covariance matrices with this approach. We also conduct numerical experiments to illustrate our theoretical results. We find that this method produces large sampling error if the true observation error standard deviation is large, while the other error characteristics, including the true background error standard deviation and observation and background error correlation lengthscales, have relatively small effect. We also find that the smallest eigenvalues of the estimated matrices may be smaller or larger than the true eigenvalues, depending on the assumed and true observation and background error statistics. These results may provide insights for practical applications, for example in deciding on appropriate sample sizes and choosing parameters for matrix reconditioning techniques.

Item Type:Article
Refereed:Yes
Divisions:Science > School of Mathematical, Physical and Computational Sciences > Department of Mathematics and Statistics
Science > School of Mathematical, Physical and Computational Sciences > Department of Meteorology
ID Code:116128
Publisher:Royal Meteorological Society

Downloads

Downloads per month over past year

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation