Going seamless - towards

36
Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007 Going seamless - towards Suggested seamless ranges – open to discussion Medium range, monthly, seasonal – WCRP-WWRP interface Seasonal, interannual, decadal - ENSEMBLES Seasonal, interannual, decadal, centennial Suggested seamless approaches Application models across modelling streams – ENSEMBLES Grand ensemble approach – THORPEX medium range Ensemble dressing

description

Going seamless - towards. Suggested seamless ranges – open to discussion Medium range, monthly, seasonal – WCRP-WWRP interface Seasonal, interannual, decadal - ENSEMBLES Seasonal, interannual, decadal, centennial Suggested seamless approaches - PowerPoint PPT Presentation

Transcript of Going seamless - towards

Page 1: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Going seamless - towards

Suggested seamless ranges – open to discussion

• Medium range, monthly, seasonal – WCRP-WWRP interface

• Seasonal, interannual, decadal - ENSEMBLES

• Seasonal, interannual, decadal, centennial

Suggested seamless approaches

• Application models across modelling streams – ENSEMBLES

• Grand ensemble approach – THORPEX medium range

• Ensemble dressing

Page 2: Going seamless - towards

WP6.1 Global changes in biophysical and biogeochemical processes – integrated analysis of impacts and feedbacks- ACC GCM - Colin Prentice - UNIBRIS, UREADMM, PIK, ULUND, METO-HC, CNRS-IPSL

WP6.2 Linking impact models to probabilistic scenarios of climate change- RCM – Tim Carter – SYKE, DIAS, DISAT, FMI, FUB, NOA, PAS, SMHI, UEA, ULUND, UNIK, UREADMM

WP6.3 - Impact modelling at seasonal to decadal timescales- s2d – Andy Morse - UNILIV, UREADMM, ARPA-SIM, JRC-IPSC, METEOSWISS, LSE, IRI, EDF, DWD

ENSEMBLES GA 2006 Lund RT6 Plenary

RT6 Assessments and Impacts of Climate Change

24 partners plus affiliated partners

Page 3: Going seamless - towards

The three WPs – method and model refinement and application and impact model runs with existing climate model data e.g. DEMETER, AR4 etc. And publishing papers.

Partners working within or towards a probabilistic framework.

Range of application models – some themes through all WPs e.g. crops and > 1 WP e.g. fire, wind damage

Tasks on going – and ready to move to ENSEMBLES data streams – Stream 1 - s2d and ACC and, RCM as available

ENSEMBLES GA 2006 Lund RT6 Plenary

RT6 Assessments and Impacts of Climate Change

Page 4: Going seamless - towards

Role of users – malaria plumes

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

1 31 61 91 121 151

Forecast Day

Ma

lari

a P

rev

ale

nc

e

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

180 30 60 90 120 150

Forecast Day

Ma

lari

a p

rev

ale

nc

e

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Botswana malaria forecast for February 1989, LMM driven by DEMETER multi-model

(ERA-driven model shown in red)

All plots unpublished Anne Jones, University of Liverpool

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

180 30 60 90 120 150

Forecast Day

Ma

lari

a p

rev

ale

nc

e

• November 1997 start

• Improvement in skill due to temperature correction

• If temperatures too low, delay in model is increased

95

85

65

35

15

5ERA

Page 5: Going seamless - towards

Tier-3 ROC AreasTier-3 ROC Areasfor November malaria forecastfor November malaria forecast

ROC Area (<0.5 = no skill), Upper Tercile event, forecast 6 month totals for Botswana grid average, () 95% confidence intervals calculated from 1000 bootstrap samples

Validated against Thomson et al (2005) Malaria Index

LMM Input Data ROC Area

ERA-40 0.78

(0.56-0.97)

Raw DEMETER 0.31

(0.11-0.56)

Bias-corrected DEMETER

T correction only

0.67

(0.29-0.80)

0.70

(0.35-0.90)

ERA-40 "persistence"

(wrong year ensemble)

0.32

(0.07-0.63)

Page 6: Going seamless - towards

Tier-1 ROC Areas for November rainfall forecast

Event Uncorrected Corrected

Lower Tercile 0.88

(0.67-1.0)

0.75

(0.45-1.0)

Above the median

0.65

(0.37-0.89)

0.68

(0.39-0.92)

Upper Tercile 0.72

(0.46-0.93)

0.63

(0.37-0.86)

ROC Area (<0.5 = no skill),forecast 6 month totals for Botswana grid average, () 95% confidence intervals calculated from 1000 bootstrap samples

Validated against ERA-40 rainfall totals

Effect of rainfall bias correction Effect of rainfall bias correction

•Bias correction of rainfall causes decrease in skill

ECMWF Forecast User Group Meeting, June 2006 [email protected]

Page 7: Going seamless - towards

15

17

19

21

23

25

27

29

1 31 61 91 121 151

Forecast Day

Me

an

T (

de

gre

es

C)

Effect of temperature bias correctionEffect of temperature bias correction

• Temperature variability not a strong driver of malaria variability in this region

• However malaria model requires realistic temperatures

• DEMETER temperatures need to be bias corrected to achieve this, because models is sensitive to biases in uncorrected data of ~ 2 degrees

DEMETER temperature forecasts for Botswana, November 1997

95

85

65

35

15

5ERA

Uncorrected Temperature Corrected Temperature

15

17

19

21

23

25

27

29

1 31 61 91 121 151

Forecast Day

Me

an

T (

de

gre

es

C)

ECMWF Forecast User Group Meeting, June 2006 [email protected]

Page 8: Going seamless - towards

Tier-3 ROC AreasTier-3 ROC Areas--alternative model outputsalternative model outputs

LMM Input Data LMM Malaria Anomalies

LMM Mosquito Anomalies

ERA-40 0.78

(0.56-0.97)

0.89

(0.71-1.0)

Raw DEMETER 0.31

(0.11-0.56)

0.73

(0.42-0.97)

Bias corrected DEMETER 0.67

(0.29-0.80)

0.56

(0.42-0.91)

ROC Area (<0.5 = no skill), Upper Tercile event, November forecast 6 month totals for Botswana grid average, () 95% confidence intervals calculated from 1000 bootstrap samples

Validated against Thomson et al (2005) Malaria Index

• Skill improved by using model mosquito numbers

• Bias correction decreases skill due to strong rainfall driver

• Cannot use in other areas where temperature a stronger driver

Page 9: Going seamless - towards

Conclusions – Botswana LMM dynamicConclusions – Botswana LMM dynamic

• DEMETER-driven forecasts were skilful, better than climatology and persistence forecasts

• Bias correction of temperature is important even if variability in temperature not important - temperatures must be "realistic" for the application model

• Bias correction of rainfall is unsatisfactory - use of daily rainfall output is problematic and need to consider other methods using monthly anomalies instead (e.g. weather generator)

• Lag in model mean malaria cases may occur outside forecast window - can be solved for Botswana using mosquito model but not applicable to other areas

ECMWF Forecast User Group Meeting, June 2006 [email protected]

Page 10: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Role of users - Statistical Model Malaria PDFs

The probability distribution functions of predicted standardized log malaria annual incidence for the years 1992 (anomalously low incidence, left) and 1993 (anomalously high incidence, right) computed with the DEMETER multi-model ensemble forecast system are depicted in red. Observations Botswana Ministry of health in blue

from M.C. Thomson, F.J. Doblas-Reyes, S.J. Mason, R. Hagedorn, S.J. Connor, T. Phindela, A.P. Morse, and T.N. Palmer (2006). Malaria early warnings based on seasonal climate forecasts from multi-model ensembles, Nature, 439, 576-579.

Page 11: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Role of users - Tanzania statistical malaria model

1991 1992 1993 1994 1995 1996 1997 1998 1999

Year

An

om

alie

sDEMETER median Log Malaria Weather Station

Jones et al. 2007 Fig 5d (submitted)

Statistical model ‘C3’ driven by Feb-Jul DEMETER pptn and Aug-Jan. Tmx ob. Giving box-whisker malaria prediction Apr-Sep – obs. driven control, obs. malaria - all standardised anomalies.

Page 12: Going seamless - towards

Vittorio MarlettoENSEMBLES GA 2006 Lund RT6 Plenary

RT6 WP6.3

Impact modelling at seasonal to decadal timescales

Regional crop yield forecastingTo develop tier-3 validation systems. Dynamic crop model run with 72 downscaled Demeter hindcast members. Comparison with local field data showed interesting skill in forecasting yield two months before harvest.

years

1977

1978

1979

1980

1981

1982

1983

1984

1985

1986

1987

0

2000

4000

6000

8000

10000

12000

Percentile yields (5, 10, 25, 50, 75, 90, 95) obtained using weather data from Cadriano up to the end of April and downscaled Demeter output up to harvest date.Observed yieldsYields simulated only with weather data from Cadriano

kg/ha

Page 13: Going seamless - towards

Andrew Challinor, Tom Osborne, Tim WheelerENSEMBLES GA 2006 Lund RT6 Plenary

RT6 WP5.5

Impacts of mean temperature rise andextreme temperature events on crop yield

The relative importance of mean and extremes of temperature was examined on crop yield (Task 5.5.x). Response varied geographically, and depended upon the parameterised response of the crop. Yields were particularly threatened when the reproductive temperature threshold was exceeded, but not the development rate threshold.

Boxplots of the percentage change in yield, between the baseline and projection climates for groundnut. ‘S’ and ‘T’ refer to sensitive and tolerant genotypes ; Topt is 28 or 36 oC; ‘OF’ without high temperature stress; ‘ON’ with high temperature stress.

Page 14: Going seamless - towards

Paul Della-Marta et al.ENSEMBLES GA Lund RT6 Plenary

RT6 WP6.3

Impact modelling at seasonal to decadal timescales

PreWiStor: Wind storm risk and prediction

Calibration of ERA40 and S2d data to be compatible with Swiss Re wind storms

Preliminary methods over calibrate the wind gust

Unreliable calibrations are masked in white

ERA40 wind storm Calibrated wind storm

Contribution to D2B.12

Page 15: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Going seamless - towards

Suggested seamless ranges – open to discussion

• Medium range, monthly, seasonal – WCRP-WWRP interface

• Seasonal, interannual, decadal - ENSEMBLES

• Seasonal, interannual, decadal, centennial

Suggested seamless approaches

• Application models across modelling streams – ENSEMBLES

• Grand ensemble approach – THORPEX medium range

• Ensemble dressing

Page 16: Going seamless - towards

R index of “reproducibility” (Stern and Miyakoda, 1995)

s

nR

where n is the standard deviation of the ensemble

members about the ensemble mean and s is the

climatological variability calculated over all ensemble members and years.

W. Stern and K. Miyakoda, 1995. Feasibility of Seasonal Forecasts Inferred from Multiple GCM Simulations. Journal of Climate: Vol. 8, No. 5, pp. 1071–1085.

 

“Ratio of variances” used in CEDO BRANKOVIC; T.N. PALMER, 2000. Seasonal skill and predictability of ECMWF PROVOST ensembles. Quarterly Journal of the Royal Meteorological Society, Volume 126, Number 567, July 2000 Part B, pp. 2035-2067(33)

Page 17: Going seamless - towards

Pan-African R scores

Rainfall (uncorrected)Temperature (bias corrected)

DEMETER multimodel ensemble, 1980-2001, Feb forecast totals/mean 1-6 no masking for zero and low CoV

Page 18: Going seamless - towards

Time-averaged R for Botswana Malaria incidence – February forecast

Feb 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel using bias-corrected temperature. Mask ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Feb 2-4

Page 19: Going seamless - towards

Time-averaged R for Botswana Malaria incidence – November forecast

Nov 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel using bias-corrected temperature. Mask ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Nov 4-6

Page 20: Going seamless - towards

Distributions of Malaria Incidence for each model and multi-model

“Epidemic” grid points, Feb 2-4

Page 21: Going seamless - towards

Distributions of Malaria Incidence for each model and multi-model

“Epidemic” grid points, Nov 4-6

Page 22: Going seamless - towards

Rainfall

Page 23: Going seamless - towards

Time-averaged R for Botswana Rainfall – February forecast

Feb 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel using bias-corrected temperature. Mask ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Feb 2-4

Page 24: Going seamless - towards

Time-averaged R for Botswana Rainfall – November forecast

Nov 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel uncorrected normalised rainfall. Mask from incidence ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Nov 4-6

Page 25: Going seamless - towards

Distributions of Rainfall for each model and multi-model

“Epidemic” grid points, Feb 2-4

Page 26: Going seamless - towards

Distributions of Rainfall for each model and multi-model

“Epidemic” grid points, Nov 4-6

Page 27: Going seamless - towards

Temperature

Page 28: Going seamless - towards

Time-averaged R for Botswana temperature – February forecast

Feb 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel bias-corrected temperature. Mask from incidence ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Feb 2-4

Page 29: Going seamless - towards

Time-averaged R for Botswana temperature – November forecast

Nov 2-4

1982-2001 averages of R, malaria incidence for DEMETER multimodel bias-corrected temperature. Mask from incidence ERA<1 case per 100 people per month, CV<0.5

R DEMETER CV

Nov 4-6

Page 30: Going seamless - towards

Distributions of temperature for each model and multi-model

“Epidemic” grid points, Feb 2-4

Page 31: Going seamless - towards

Distributions of temperature (bias-corrected) for each model and multi-model

“Epidemic” grid points, Nov 4-6

Page 32: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Page 33: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Page 34: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

original ERA

Role of users –MARA transmission map

Based on model Craig et al. 1999 www.mara.org.za run with climatology and observations and ERA-40

Page 35: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007

Botswana malaria

MARA map

(Craig et al, 1999)

Tmin

Rain

Tmean

MARA run with ERA-40 1 deg (1958-2001)

MARA limiting variable (Tmin is min of 4 daily values) 5 degree –ve offset

slide from Anne Jones, University of Liverpool

Page 36: Going seamless - towards

Morse IS-EPS WCRP Seasonal Prediction Barcelona 2007