Automating Model Skill Assessment with...
Transcript of Automating Model Skill Assessment with...
![Page 1: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/1.jpg)
Automating Model Skill Assessmentwith Python
Rich Signell (USGS, Woods Hole, MA)Filipe Fernandes (SECOORA)
Kyle Wilcox (Axiom Data Science, Wickford, RI)
CEOS WGISS Tech Expo Webinar 2017-08-22
![Page 2: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/2.jpg)
US Integrated Ocean Observing System (IOOS®)
IOOS® Plan defines:• Global Component• Coastal Component
▪ 17 Federal Agencies▪ 11 Regional Associations
![Page 3: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/3.jpg)
IOOS Recommended Web Servicesand Data Encodings
![Page 4: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/4.jpg)
IOOS Model Data Interoperability Design
ROMS
ADCIRC
HYCOM
SELFE
SLOSH NcML
NcML
NcML
NcML
Common Data Model
OPeNDAP+CF+UGRID|SGRID
WCS
NetCDF Subset
THREDDS Data Server (TDS)
Standardized (CF-1.6, UGRID-1.0, SGRID-0.3) Virtual Datasets
NonstandardModel Output Data Files
Web ServicesMatlab
Panoply
IDV
Clients
NetCDF-Java
Libraryor Broker
WMS
ncISO
ArcGISNetCDF4-Python
FVCOM
PythonERDDAP
NetCDF-Java
SOS
Geoportal Server
GeoNetwork
GI-CAT
Observed data (buoy, gauge, ADCP, glider)
Godiva2
pycsw-CKAN
NcML
GridSgridUgridTimeSeriesProfileTrajectoryTimeSeriesProfile
NonstandardData Files
CatalogServices
CMG Portal
Delft3D NcML
sudo apt-get dockerdocker run –d unidata/thredds-docker
![Page 5: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/5.jpg)
IOOS Catalog
5
![Page 6: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/6.jpg)
Interoperable Access in Python (Iris)
![Page 7: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/7.jpg)
Boston Light Swim
8 mile swimNo wet suitHow cold will the water be?
![Page 8: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/8.jpg)
Boston Light Swim Paper
![Page 9: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/9.jpg)
Demo
![Page 10: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/10.jpg)
Conda-Forge is Awesome
![Page 11: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/11.jpg)
2900+ packages and growing!
![Page 12: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/12.jpg)
Summary
• Standardized framework makes skill assessment easy and powerful
• Services are now easy to install and maintain• Skill assessment notebooks are reproducible
by others (for free)• More assessment leads to more appropriate
use of modeling products• More assessment of models leads to better
models
![Page 13: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/13.jpg)
Demo
![Page 14: Automating Model Skill Assessment with Pythonceos.org/document_management/Working_Groups/WGISS... · 2017-08-29 · Automating Model Skill Assessment with Python Rich Signell (USGS,](https://reader030.fdocuments.us/reader030/viewer/2022041105/5f05dd7c7e708231d41519bc/html5/thumbnails/14.jpg)
Boston Light Swim Notebook