13. Delsol Use of reprocessed AMVs in the ECMWF interim...

24
Slide 1 9 th International Winds Workshop Use of reprocessed AMVs in the ECMWF Interim Re-analysis Claire Delsol EUMETSAT Fellow Dick Dee and Sakari Uppala (Re-Analysis), Ioannis Mallas (Data), Niels Bormann, Jean-Noël Thépaut, and Peter Bauer (Satellite section) Leo van de Berg (EUMETSAT)

Transcript of 13. Delsol Use of reprocessed AMVs in the ECMWF interim...

Page 1: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 1

9th International Winds Workshop

Use of reprocessed AMVs in the

ECMWF Interim Re-analysis

Claire DelsolEUMETSAT Fellow

Dick Dee and Sakari Uppala (Re-Analysis),Ioannis Mallas (Data),

Niels Bormann, Jean-Noël Thépaut, and Peter Bauer (Satellite section)Leo van de Berg (EUMETSAT)

Page 2: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 2

9th International Winds Workshop

Talk Outline

• Introduction

• 1989 experiment (Met-3)

• 1995 experiment: XADC period (Met-3 and Met-5)

• Summary

Page 3: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 3

9th International Winds Workshop

1989

VTPR

TOMS/ SBUV

HIRS/ MSU/ SSUCloud motion winds

Buoy dataSSM/I ERS-1

ERS-2AMSU

METEOSAT Reprocessed

Cloud motion winds

Conventional surface and upper-air observationsNCAR/ NCEP, ECMWF, JMA, US Navy, Twerle, GATE, FGGE, TOGA, TAO, COADS, …

Observing systems used in:ERA-40 Interim

Aircraft data

1957 2006

19731979

1982 1988

1973 19791987 1991

19951998

METEOSAT ReprocessedAMVs

+ Clear Sky Radiances

INTRODUCTION

Page 4: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 4

9th International Winds Workshop

EUMETSAT have reprocessed the AMV product for the Interim project:

- improvements in derivation techniques

- fully automated use of IR, VIS, WV images (better approach for h.a.)

- use of QI (allows greater control on usage of data by NWP users)

- better spatial and temporal coverage (1 ½ hrly compared to 2-4 times a day).

AMV monitoring and impact Study I

Interim IFS configuration: CY31R2 T255 (T159) L60 (4DVAR 12hr window) ECMWF Newsletter nº110

QC for new data: Updated blacklist + quality control same as current pre-MSG operational one except for tighter Tropics as a result of findings from previous ERA studies (Bormann, 2003) + thinning at 140km x 140km + use fg-dep QI 1

Data: reprocessed Meteosat-3 (centred on 0º) for 3 months: 4th Feb to 4th May 1989

Page 5: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 5

9th International Winds Workshop

Sample of AMV coverage: 6th Feb 1989

old reprocessed

all

Used (after QC)

4345

69281460

96615

Page 6: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 6

9th International Winds Workshop

71659

19710 1182

5308

Reprocessed: all Reprocessed: used

IR

Cloudy WV

Page 7: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 7

9th International Winds Workshop

5255 438

• increase in numbers at high levels (IR + WV contribution) + low levels (IR + VIS contribution)

• mid level constrained more by strict quality control.

all Used (after QC)

VIS

Page 8: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 8

9th International Winds Workshop

Used U, V Met 8 region

Bias worse at mid to high levels but standard deviation better + largeincrease in number of AMVs

used USATOB-Uwind Met8exp:1180 /DA (black) v. 1179/DA 1989020400-1989030400(12)

nobsexp

48087

86017

11021

5171

23933

27785

20004

8960

1094

19

exp -ref

+46039

+70209

+2776

+1679

+21068

+24483

+14769

+1305

-1225

-118

0 2 4 6

STD.DEV

1000

850

700

500

400

300

250

200

150

100

Pre

ssur

e (h

Pa)

-4 -3 -2 -1 0 1 2 3 4

BIAS

1000

850

700

500

400

300

250

200

150

100

background departure o-b(ref)background departure o-banalysis departure o-a(ref)

analysis departure o-a

used VSATOB-Vwind Met8exp:1180 /DA (black) v. 1179/DA 1989020400-1989030400(12)

nobsexp

48087

86017

11021

5171

23933

27785

20004

8960

1094

19

exp -ref

+46039

+70209

+2776

+1679

+21068

+24483

+14769

+1305

-1225

-118

0 2 4 6

STD.DEV

1000

850

700

500

400

300

250

200

150

100

Pre

ssur

e (h

Pa)

-4 -3 -2 -1 0 1 2 3 4

BIAS

1000

850

700

500

400

300

250

200

150

100

background departure o-b(ref)background departure o-banalysis departure o-a(ref)

analysis departure o-a

Semi-transparency method applied irregularly to IR AMVs.

Statistics for used reprocessed amvs and used original amvs

Page 9: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 9

9th International Winds Workshop

Europe

SH Extra-Trop

Tropics

NH Extra-trop

10%10%5%5

7

5

10%2%2

10%3

3

10%10%2

10%5%7

200hPa500hPa850hPa1000hPaForecast Day

2

10%3

5

10%7

10%7

1.0%2%5

0.1%0.5%3

0.1%0.2%2

Statistical significance (t-test) RMS Vector wind forecast error validated against ERA-40 analysis (90 cases)

No entry means that there is not enough statistical significance

Improved scores in blackDegraded ones in orange.

Page 10: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 10

9th International Winds Workshop

Vector difference of mean wind analysis between ctl and

expt (new Met3)

1000hPa

300hPa

Mean wind analysis (control)

2.5m/s

2.5m/s20m/s

50m/s

Page 11: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 11

9th International Winds Workshop

AMV monitoring and impact study II: XADC periodThis corresponds to period when Meteosat-5 was operational at 0º and Meteosat-3 was leant to the

US due to a faulty GOES satellite. Reprocessing of both datasets gives us an opportunity to look at

the impact of having more reprocessed datasets simultaneously.

Interim IFS configuration: CY31R2 T255 (T159) L60 (4DVAR 12hr window)

Data: reprocessed Meteosat-5 (0º) and Meteosat-3 (75º W) for 3 months: 1st Jan to 31st Mar 1995

QC: as for the 1989 experiment.

Reprocessed Met3 and Met5 (satid: 50 and 52)

Original Met5 (satid: 5)

Example of coverage: 19950102

Page 12: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 12

9th International Winds Workshop

Reprocessed AMVs:blackOld AMVs: red

Highlights large increase in data “used” in assimilation (note no Met3 in original operations)

Expect bias/std to be different

Northern Extra-tropics

Tropics

Met-5 and Met-3Used U

Large bias not as pronounced in 1989 experiment

+ve bias still present in extra-tropics: semi-transparency correction method irregularity?

Page 13: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 13

9th International Winds Workshop

Met5 (used) Met3 (used)

VIS (25352) VIS (29080)

IR (37218)WVcloudy(45641)

WVcloudy(25316)

IR (84751)

1-15 Jan 1995

P (h

Pa)

60S Eq 60N

zonal mean windspeed bias

(obs-fg)

200

600

1000

400

800

200

600

1000

400

800

200

600

1000

400

800

200

600

1000

400

800

200

600

1000

400

800

200

600

1000

400

800

60S 0 60N 60S 0 60N 60S 0 60N 60S 0 60N

60S 0 60N 60S 0 60N

Page 14: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 14

9th International Winds Workshop

3 EXPERIMENTs CTL: original operational set-up

Met5

Met5

Met5

Met3

Met3

Met3

Met3 Met5

reprocessed AMVs

original AMVs

no original AMVs

EXPT1

EXPT2

EXPT3

Page 15: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 15

9th International Winds Workshop

200hPa

500hPa

850hPa

1000hPa

0.5%

5%

5%

5%

10%

10%

4

10%

0.5%

0.2%

2%

76532Forecast Day

0.2%

2%

2%

10%

5%

5%

1%

0.1%

2%

10%

5%

10%

0.5%

0.5%

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

10%

1%5%

5%

5%

Statistical significance RMS Vector wind forecast error validated against ERA-40 analysis

VERY good scores except for Tropics! Improved scores in blackDegraded ones in orange.

Smaller % = more significant impact

EXPT1

Page 16: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 16

9th International Winds Workshop

200hPa

500hPa

850hPa

1000hPa

10%

2%

5%

10%

4

10%

10%

10%

76532Forecast Day

2%

1%

5%

0.1%

1%

5%

10%

10%

5%

5%

0.2%

10%

2%

0.5%

5%

2%

2%

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

5%

10%

10%5%

10%

10%

5%

10%

10%

Statistical significance RMS Vector wind forecast error validated against ERA-40 analysis

Reprocessed Met-5 (no Met-3)

Improved scores in blackDegraded ones in orange.

• NH extra-tr not as good • SH extra-tr particularly good at high levels •Tropics degraded

EXPT2

Page 17: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 17

9th International Winds Workshop

200hPa

500hPa

850hPa

1000hPa

1%

10%

4

10%

5%

0.5%

2%

76532Forecast Day

5%

1%

2%

5%

5%

2%

1%

0.1%

1%

2%

10%

0.5%

10%

1%

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

10%

5%10%

10%

5%

10%

10%

Statistical significance RMS Vector wind forecast error validated against ERA-40 analysis

• NH extra-tropics better • Tropics not as bad!

old Met-5 reprocessed Met-3

Improved scores in blackDegraded ones in orange.

EXPT 3

Page 18: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 18

9th International Winds Workshop

Negative impact in Tropics: WHY?

• Tropics difficult area to validate against other observations

• Subtropical jets area: sensitive (location + intensity)

• Tested blacklisting more strictly (remove the mid-to-high-level biases between 30ºS and 30ºN – up to 300hPa)

- removes negative impact locally but the negative impact still present at the very high levels (ie. 200hPa)

Further Investigation:

• Difference between 1989 and 1995 experiments is in the observing system: ERS-1 scatterometer surface winds.

• Run experiment during the wet season for the ITCZ (more active season)

Page 19: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 19

9th International Winds Workshop

SUMMARYReprocessed winds were monitored as part of the Interim Re-analysis project. EUMETSAT’s support for this has been of great value.

A first quality and impact study: • Reprocessed Met-3 AMVs for Feb-April 1989

• Large increase in the amount of AMVs + improved std dev of departures BUT biases at mid-levels – semi-transparency correction method?

• Forecast impact: relatively neutral in extra-tropics and very positive in low-level Tropics.

A second study: • for XADC period (1995) – Met-3 (75ºW) and Met-5 (0º).

• Mid level bias still present.

• Very positive impact in Extra-Tropics but very negative in Tropics at high levels

• Blacklisting Tropics more strictly reduces the –ve impact locally but more –ve at 200hPa.

Areas to pursue: ITCZ wet season (July-Sept) + impact of the scatterometer data

Page 20: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 20

9th International Winds Workshop

Page 21: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 21

9th International Winds Workshop

Scatterometer surface wind - Interim expt: 1992 (May)

500hPa

200hPa

Page 22: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 22

9th International Winds Workshop

used USATOB-Uwind N.Midlatexp:1323 /DA (black) v. 1332/DA 1995010100-1995040100(12)

nobsexp

43304

128079

14278

6732

40326

53937

21583

3492

351

0

exp -ref

+32373

+59766

+11408

+3336

+30244

+41058

+16695

+2401

+248

-17

0 2 4 6

STD.DEV

1000

850

700

500

400

300

250

200

150

100

Pre

ssur

e (h

Pa)

-4 -3 -2 -1 0 1 2 3 4

BIAS

1000

850

700

500

400

300

250

200

150

100

background departure o-b(ref)background departure o-banalysis departure o-a(ref)

analysis departure o-a

used USATOB-Uwind Tropicsexp:1323 /DA (black) v. 1332/DA 1995010100-1995040100(12)

nobsexp

136465

337835

22118

2831

2613

56886

108992

81128

7108

107

exp -ref

+107562

+211495

+19070

-2508

-5103

+38509

+75569

+16170

-2212

-443

0 2 4 6

STD.DEV

1000

850

700

500

400

300

250

200

150

100

Pre

ssur

e (h

Pa)

-4 -3 -2 -1 0 1 2 3 4

BIAS

1000

850

700

500

400

300

250

200

150

100

background departure o-b(ref)background departure o-banalysis departure o-a(ref)

analysis departure o-a

used USATOB-Uwind S.Midlatexp:1323 /DA (black) v. 1332/DA 1995010100-1995040100(12)

nobsexp

99420

265513

17634

11310

61995

103393

59853

17119

1227

0

exp -ref

+79752

+153402

+11783

+6996

+51856

+81977

+45690

+11291

+414

-37

0 2 4 6

STD.DEV

1000

850

700

500

400

300

250

200

150

100

Pre

ssur

e (h

Pa)

-4 -3 -2 -1 0 1 2 3 4

BIAS

1000

850

700

500

400

300

250

200

150

100

background departure o-b(ref)background departure o-banalysis departure o-a(ref)

analysis departure o-a

Page 23: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 23

9th International Winds Workshop

Vector difference of mean wind analysis between ctl and expt (reprocessed Met-3 and Met-5 with stricter Tropics)

Jan/Feb/Mar 1995

400hPa

300hPa

200hPa

Page 24: 13. Delsol Use of reprocessed AMVs in the ECMWF interim ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/13...Slide 8 9th International Winds Workshop Used U, V Met 8 region Bias

Slide 24

9th International Winds Workshop

200hPa

500hPa

850hPa

1000hPa

0.2%

0.2%

10%

10%

10%

1%

10%

1%

4

10%

2%

10%

76532Forecast Day

0.1%

0.5%

0.5%

0.5%

10%

0.2%

0.1%

1%

0.2%

10%

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

Trop

SH

NH

2%

2%

5%0.2%

10%

2%

2%

5%

Statistical significance RMS Vector wind forecast error validated against ERA-40 analysis

Better in Tropics : -ve impact confined to higher levelsBUT –ve impact in >500hPa in NH Improved scores in black

Degraded ones in orange.

Stricter blacklist