The ICA&D concept

40
The ICA&D concept Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar Albert Klein Tank Gerard van der Schrier http:// eca.knmi.nl

description

Robert Leander Royal Netherlands Meteorological Institute On behalf of the ECA&D project team Aryan van Engelen Else van den Besselaar Albert Klein Tank Gerard van der Schrier. The ICA&D concept. http://eca.knmi.nl. Contents. Contents. Definition and purpose - PowerPoint PPT Presentation

Transcript of The ICA&D concept

Page 1: The ICA&D concept

The ICA&D conceptRobert Leander

Royal Netherlands Meteorological Institute

On behalf of the ECA&D project teamAryan van Engelen

Else van den BesselaarAlbert Klein Tank

Gerard van der Schrier

http://eca.knmi.nl

Page 2: The ICA&D concept

Contents

• Definition and purpose what is the ICA&D concept?

• Key componentsComponents and their connectionImplementation requirements

• Look and feel of the web-portalA swift browse through the ECA&D siteLet’s fantasize about the WACA&D site

Contents

Page 3: The ICA&D concept

Contents

• Daily station data• Quality controlled• Regional• Climate changes indices

Definition and purpose

Characteristics

International ClimateInternational Climate Assessment & Dataset

Page 4: The ICA&D concept

ICA&D examplesECA&D, SACA&D, LACA&D….

Page 5: The ICA&D concept

For example

???

ECA&D, SACA&D, LACA&D….

why not WACA&D ?

Page 6: The ICA&D concept

ContentsKey components

MySQLdatabase

Apache

Webserver

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

DevelopmentMaintenance

of data + metadataUpdate cycle

Page 7: The ICA&D concept

ContentsKey components

MySQLdatabase

Apache

Webserver

MySQLdatabase

Apache

Webserver

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Development OperationalMaintenance

of data + metadataUpdate cycle

Page 8: The ICA&D concept

• Updating series + metadata• Quality control• Blending stations• Indices calculation• Homogeneity tests • Trend analysis

climatology, anomalies and extreme analysis ….

Update cycle

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Bash-scripting,

C/F77 routines

Manual intervention required

Page 9: The ICA&D concept

• Updating raw series + metadata• Quality control• Blending stations• Indices calculation• Homogeneity tests • Trend analysis

climatology, anomalies and extreme analysis ….

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Bash-scripting,

C/F77 routines

Fully automated process

Update cycle

Page 10: The ICA&D concept

“Fullcycle”:

•QC

•Blending•Index calculation•Homogeneity tests•Trends, climatology,

extreme analysis

Update cycle

Blending

• Extending and completing a station series with data from nearby stations

• Stations within certain proximity and within a certain range of altitude are considered, depending on the element

SYNOP data is the least preferred source ….

only used if no suitable historical data available

Page 11: The ICA&D concept

“Fullcycle”:

•QC •Blending

•Index calc.•Homogeneity•Trends, climatology,

extreme analysis

Update cycle

Index calculation

• ETCCDI indices (same as in RClimdex)

• Additional Impact-related indices

• Comfort indices like UTCI, Tourism index

• Specific “agricultural” indices Viticulture-related indices

• Hydrological indices like hydrologic intensity HY-INT (Giorgi)

And more …

new index definitions can smoothly be integrated into the system

Page 12: The ICA&D concept

“Fullcycle”:

•QC •Blending•Index calculation

•Homogeneity •Trends, climatology,

extreme analysis

Update cycle

Homogeneity

• Four tests on some indices (RR, TGG, etc):• Von Neumann Ratio Test

• Buishand Range Test

• Alexanderson SNHT

• Pettit Test} Identify break

• Classification of series: suspect 3 or more tests detect change doubtfull 2 tests detect break usefull not more than 1 test detects break

Page 13: The ICA&D concept

“Fullcycle”:

•QC •Blending•Index calculation•Homogeneity

•Trends, ….

Update cycle

Various analyses

• For those series whose series are not suspect• Climatology

• Anomalies

• Trends

• Returnvalues

Page 14: The ICA&D concept

ContentsDatabase (devel)

MySQLdatabase

•Primary variables (daily resolution): tg,tx,tn,rr,hu,ss,sd,cc,ff,fx,dd

•Raw daily series•Blended daily series•QC results•Annual index series•Homogeneity test results•Station metadata•Analyses results

• Trends• Climatology• Extremes• …..

} Operational database

Upd

ate

cycl

e

Webserver (devel)

Newraw data

Page 15: The ICA&D concept

ContentsWeb server(s)

Apache

Webserver

Apache

Webserver

Internal web-server External web-server

External DatabaseInternal Database

• PHP – based

• JPGRAPH for plotting

• MapServer / MapScript for mapping

Page 16: The ICA&D concept

• Separate linux-baseddevelopment and operational system.

• Web-content generation real-time• Apache 2.0, MySQL 5.0.45, PHP 5.1.6• Mapserver 4.10.2 (maps) , Jpgraph (plots)• C, shell scripting (update cycle)• Fortran (some of the calculations, gridding)

Infrastructure

Summarizing:

Page 17: The ICA&D concept

ECA Website walkthrough..

http://www.ecad.eu

Page 18: The ICA&D concept

2009 ECA&D : data inventory

Page 19: The ICA&D concept

2009 ECA&D : (Raw) Daily data

Raw and blended daily station data for the take…

…..but ONLY the PUBLIC data !! The participant decides

Page 20: The ICA&D concept

2009 ECA&D walkthrough: Daily data

Raw and blended daily station data for the take…

…..but ONLY the PUBLIC data !! The participant decides

Page 21: The ICA&D concept

2009 ECA&D : Extreme events

Page 22: The ICA&D concept

2009 ECA&D : Extreme events

Page 23: The ICA&D concept

2009 ECA&D : Indices

Page 24: The ICA&D concept

2009 ECA&D : Timeseries plots

Page 25: The ICA&D concept

2009 ECA&D : Index time series

May 20May 2010

Page 26: The ICA&D concept

2009 ECA&D : Indices maps

Page 27: The ICA&D concept

2009 ECA&D : Indices maps

Page 28: The ICA&D concept

2009 ECA&D walkthrough

Page 29: The ICA&D concept

2009 ECA&D : Index map: RR1

Page 30: The ICA&D concept

2009 ECA&D : Index map: RH

Page 31: The ICA&D concept

2009 ECA&D : Climatology RR1

Page 32: The ICA&D concept

2009 ECA&D : Anomalies RR1

Page 33: The ICA&D concept

2009 ECA&D : Trend RR1

Page 34: The ICA&D concept

WACA&D : CWD Trend

http://82.157.123.58/rcc/utils/mapserver/trend.php

http://192.168.2.10/rcc/utils/mapserver/trend.php

Page 35: The ICA&D concept

WACA&D : CWD TrendWACA&D : CWD Trend

Page 36: The ICA&D concept

2009 WACA&D : CWD TrendWACA&D : CWD Trend

http://82.157.123.58/rcc/utils/mapserver/index-availability.php

http://192.168.2.10/rcc/utils/mapserver/index-availability.php

Page 37: The ICA&D concept

ICA&D is useful in climate monitoring • Participants can profit from the analyses• Still they have full control over data distribution• The system is simpel in design

and straightforward to maintain and extend• We are there to share the software,

our innovations and assist in the local setup• The ICA&D concept is very well portable

Conclusion

Page 38: The ICA&D concept

Meteorologist:What is the use of climate data ??”

Page 39: The ICA&D concept

Meteorologist:What is the use of climate data ??”

Page 40: The ICA&D concept

Thank You for your attention!

Merci beaucoup pour votre attention!