Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.
-
Upload
gladys-pitts -
Category
Documents
-
view
234 -
download
0
Transcript of Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.
![Page 1: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/1.jpg)
Ensemble Handlingin GrADS
Jennifer M. Adams Brian Doty
IGES/COLA
![Page 2: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/2.jpg)
What is GrADS? • GrADS is an interactive tool that integrates
data access, analysis, and visualization• Handles many data formats:
binary, NetCDF, HDF, GRIB1&2, BUFR • Two data models for gridded and in situ data• Expression handling is flexible, compact, recursive• Programmable interface for scripting• Written in C; code is open source (GPL)
![Page 3: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/3.jpg)
A GrADS Graphics Example
![Page 4: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/4.jpg)
What is the GrADS Data Server?
• GDS is a stable, secure, OPeNDAP data server that provides subsetting and server-side analysis services over the internet
• GDS can serve any GrADS-readable dataset, and unifies all data formats into a NetCDF framework
• Open a data set with http://servername/filename instead of /disk/filename
![Page 5: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/5.jpg)
News from GrADS/GDS Team
GrADS has a 5th grid dimension for ensembles GrADS has a GRIB2 interface GDS can serve any GrADS data set GrADS is a client for all OPeNDAP data sets• GrADS will support GIS-compatible outputs
![Page 6: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/6.jpg)
The New Ensemble Dimension in GrADS
• A 5th grid dimension for ensemble members‘set X, Y, Z, T, or E’ or ‘set lon, lat, lev, time, or ens’
• A virtual dimension for forecast time offset‘display temp(ft=2)’‘display temp(ftime=24hr)’
![Page 7: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/7.jpg)
GrADS Metadata Requirements for Ensemble Members
• Unique name / number• Initial time• Length• If GRIB2, some additional octet values• One time axis spans all members• All members must have common X, Y, Z axes
![Page 8: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/8.jpg)
GrADS GRIB2 Descriptor File
Wesley’s g2ctl works very well, but doesn’t handle EDEF (yet). DSET /gens/prod/gefs.%iy4%im2%id2/%ih2/pgrb2a/ge%e.t%ih2z.pgrb2af%f2TDEF 17 linear 00z09oct2008 6hrEDEF 23avg 17 00z09oct2008 0spr 17 00z09oct2008 2c00 17 00z09oct2008 1,0p01 17 00z09oct2008 3,1p02 17 00z09oct2008 3,2p03 17 00z09oct2008 3,3p04 17 00z09oct2008 3,4. . .p19 17 00z09oct2008 3,19p20 17 00z09oct2008 3,20ENDEDEF@ ens String avg Unweighted mean of all members@ ens String spr Standard deviation with respect to ensemble mean@ ens String c00 Control forecast@ ens String p01 Positively perturbed forecast
The GRIB2 codes are octets 35 and 36 from Section 4 (PDT # 1, 2, 11, and 12)
![Page 9: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/9.jpg)
Examples of Ensemble Data Sets
• NCEP GFS Ensembles (GENS)• NCEP Climate Forecast System (CFS)• NCEP Short Range Ensemble Forecasts (SREF)• ESRL MRF Reforecasting Experiment • WCRP CMIP3 Multi-Model Data (IPCC AR4)• TIGGE
![Page 10: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/10.jpg)
• Data become more usable and accessible
• Subsets over all dimensions
• Server-side analysis
• File aggregation
• Format translation
• Ensemble metadata standards:
Ensemble Data Sets Behind GDS
![Page 11: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/11.jpg)
Ensemble Forecast Time Series (Longitude, Latitude, and Level are fixed)
Forecast Time --->
![Page 12: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/12.jpg)
Ensemble Forecast Grid (Longitude, Latitude, and Level are fixed)
Forecast Time --->
Ens
embl
e M
embe
r
![Page 13: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/13.jpg)
Ten Ensemble Forecasts (Longitude, Latitude, and Level are fixed)
Forecast Time --->
Ens
embl
e M
embe
r
![Page 14: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/14.jpg)
Time Axis ---->
Ens
embl
e M
embe
r
CFS Daily Hindcast (Longitude, Latitude, and Level are fixed)
![Page 15: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/15.jpg)
Ensemble Forecast Time Series (Longitude, Latitude, and Level are fixed)
Forecast Time --->
![Page 16: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/16.jpg)
Ensemble Mean = tloop(ave(Z,e=2,e=23))Ensemble Min/Max = tloop(min(Z,ens=c00,ens=p20)) +/- StdDev of Ensemble Mean = tloop(sqrt(ave(pow(Z-Zave,2),e=1,e=21)))
Forecast Time --->
![Page 17: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/17.jpg)
+ Perfect testbed for ensemble handling and GRIB2 interface+ Boost to usage of TIGGE data+ Forecasts sorted by date and by provider+ Time series of analyses
- Nearly unbearable load on old hardware- 48-hour data embargo- Int’l agreement requires password protection
TIGGE Data Behind GDS at NCAR
![Page 18: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/18.jpg)
TIGGE Multi-Member Multi-Model Ensemble 500mb Geopotential Height valid August 30, 2008
7-day Lead
3-day Lead
5-day Lead
1-day Lead
![Page 19: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/19.jpg)
TIGGE MME Forecast Error and Ensemble Spread 500mb Geopotential Height valid August 30, 2008
7-day Lead
3-day Lead
5-day Lead
1-day Lead
![Page 20: Ensemble Handling in GrADS Jennifer M. Adams Brian Doty IGES/COLA.](https://reader033.fdocuments.us/reader033/viewer/2022061612/56649ec05503460f94bcbecb/html5/thumbnails/20.jpg)
TIGGE Forecasts of Hurricane Ike valid: 12z 9 Sep - 00z 13 Sep in
it:
00z
8 S
epin
it: 1
2z 8
Sep
init
: 00z
9 S
epin
it: 1
2z 9
Sep