Characterising height assignment error by comparing best-fit...

14
Slide 1 Characterising height assignment error by comparing best-fit pressure statistics from the Met Office and ECMWF system Kirsti Salonen, James Cotton, Niels Bormann, and Mary Forsythe 11th International Winds Workshop 2012

Transcript of Characterising height assignment error by comparing best-fit...

Page 1: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 1

Characterising height assignment

error by comparing best-fit pressure

statistics from the Met Office and

ECMWF system

Kirsti Salonen, James Cotton, Niels Bormann, and Mary Forsythe

11th International Winds Workshop 2012

Page 2: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 2

Motivation

l  Uncertainty in height assignment is one of the largest error sources for AMVs.

l  This uncertainty should be taken into account in data assimilation to ensure effective and realistic use of the data.

11th International Winds Workshop 2012

} ±50 hPa

} ±50 hPa Error ±0.5 ms-1

Error -7.5...-12 ms-1

Page 3: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 3

Height assignment method characteristics

11th International Winds Workshop 2012

l Equivalent black-body temperature (EBBT) §  Works best for opaque clouds.

§  Assigned height for semitransparent and small clouds often too low.

l Cloud base method §  Used only for low level clouds.

l CO2 slicing, H2O intercept §  Corrections for the semi-transparency of the cloud

§  Challenges with low broken clouds, thin cirrus clouds, clouds in two or more layers.

§  WV radiances originate primarily from upper troposphere, height determinations below 600 hPa typically rejected.

Page 4: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 4

Best-fit pressure

l  Pressure level where the vector difference between the observed and model wind is the smallest.

l  Not calculated if

1.  Difference between the observed

and model wind is > 4m/s.

2.  Difference < +2 m/s outside of

±100 hPa from the best-fit p level

l  Minor difference in approaches

-  ECMWF: the minimum closest to

the assigned height.

-  Met Office: the actual minimum.

11th International Winds Workshop 2012

Model best fit pressure

Originally assigned height

Page 5: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 5

How often calculated?

l  Best-fit pressure calculated in 25-30% of the cases.

l  No good agreement between observed and model wind in ca. 7% of the cases.

l  Multiple or broad minima in 63-68% of the cases.

11th International Winds Workshop 2012

Page 6: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 6

Comparison study

l Study the usability of the best-fit pressure in characterising the height assignment error.

§  Met Office and ECMWF systems

§  February – March 2010, 37 000 000 AMV observations

§  QI > 80 for geostationary AMVs, QI > 60 for polar AMVs

§  Satellite, channel, height assignment method, surface type (land/sea)

§  Bias and standard deviation: assigned height – best-fit pressure

§  http://research.metoffice.gov.uk/research/interproj/nwpsaf/satwind_report/investigations/bfpress/10_03/intro.html

11th International Winds Workshop 2012

Page 7: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 7

Meteosat-9, IR, EBBT, land

11th International Winds Workshop 2012

+ Too low

- Too high

Good agreement

Page 8: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 8

Summary of findings: EBBT

11th International Winds Workshop 2012

l Meteosat-9 §  Below 600 hPa strong positive bias over land. Known

problems with semi-transparent clouds over the hot African surface.

l GOES-11, GOES-12 §  VIS channel AMVs negative bias between 800-600 hPa over

sea. Known problems in height assignment in the stratocumulus inversion regions in the Pacific and Atlantic.

l MTSAT-1R §  Positive bias at low levels.

l Aqua, Terra §  Below 500 hPa positive bias and large sdevs especially on

Northern hemisphere.

Page 9: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 9

GOES-12, WV, CO2 slicing, sea

11th International Winds Workshop 2012

+ Too low

- Too high

Good agreement

Page 10: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 10

GOES-12 vs. MET-9, WV, CO2 slicing, sea

11th International Winds Workshop 2012

Page 11: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 11

Summary of findings: H2O intercept

l GOES-11/12 and Meteosat-9 share very similar characteristics in the statistics as the AMVs applying the CO2 slicing method.

l MTSAT-1R statistics are somewhat different §  Below 300 hPa positive bias.

11th International Winds Workshop 2012

Page 12: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 12

MTSAT-1R, WV, H2O intercept, sea

11th International Winds Workshop 2012

+ Too low

- Too high

Good agreement

Page 13: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 13

Comparison of methods: MET-9

11th International Winds Workshop 2012

Page 14: Characterising height assignment error by comparing best-fit ...cimss.ssec.wisc.edu/iwwg/iww11/talks/Session5_Salonen.pdfSlide 8 Summary of findings: EBBT 11th International Winds

Slide 14

Conclusions

11th International Winds Workshop 2012

l Best-fit pressure statistics are rather similar for both systems.

-  Some differences e.g. at mid levels where ECMWF shows

occasionally more pronounced biases and standard deviations.

l Largest biases and standard deviations found typically below 400 hPa height.

l Results are in good agreement with

-  Known characteristics of the height assignment methods.

-  Earlier findings of the quality of the AMVs.

l Best-fit pressure statistics give reliable information about the uncertainties in the AMV height assignment.